Who builds the world's best RAG? Let's find out!

Join top developers and AI enthusiasts in tackling real-world RAG challenges. Showcase your skills, compete for recognition, and drive enterprise solutions to the next level.

All communications will take place on Discord! Make sure to join the Discord server in order to participate!

🗓️ WHERE AND WHEN

The challenge will take place remotely — join from anywhere in the world (or beyond 😉)!
We’ll kick things off on Thursday, February 27th at 10 AM UTC+1 with an opening keynote by Stephan Gillich. Afterwards, we’ll provide the PDF files you’ll need to ingest into your RAG to tackle the challenge questions.

🦸🏼‍♂️ WHO CAN JOIN?

Anyone eager to test and showcase the output quality of their RAG system is welcome! Whether you're a student, freelancer, or professional, this is your chance to join our friendly competition and put your skills to the test.

🤜🤛 CAN WE JOIN AS A TEAM?

Absolutely! You’re welcome to participate as a team. Bring your RAG system and your friends, and tackle the challenge together.

🛠️ HOW DO I PARTICIPATE

Sign up here, and you’ll receive a link to our Discord channel. We’ll keep you posted with all updates, news, and instructions there.

Opening Keynote by Renowned AI Expert Stephan Gillich

"The Power of Context: RAG enhanced AI"

Retrieval Augmented Generation (RAG) has emerged as a transformative paradigm in AI, bridging the gap between AI models trained on public data and the vast ocean of private information available. It enables businesses to get truly intelligent applications without re-training or fine tuning AI models while keeping their core data and IP more private.

In this keynote we'll delve shortly into the challenges businesses have with integration of AI. We will cover the principles of RAG, examining how effectively retrieving and integrating relevant context can enhance the reliability, and factual grounding of generated outputs. Beyond the fundamentals, we'll discuss some forward looking ideas, and address the open challenges and exciting future directions of RAG.

Open Source for Open Minds: Learning Together!

The code for the question generator, submission results, and submission API will be open source. We'll also share reports on winning architectures and encourage participants to share their solutions, fostering a collaborative learning experience. We ensure you’ll have plenty of time to prepare for the task in advance.

You can take a look at the winning solution from the last round here

Code, Create, and Cash In!

The top three RAG solutions will win vouchers of their choice worth:

 

How the challenge works

STEP 1: FEED YOUR RAG

Prepare your RAG by uploading a set of public annual reports. To keep things fair and exciting, we’ll randomly select approximately 100 PDFs from the available reports for you to work with.

STEP 2: PROCESSING TIME

You’ll have at least 6 hours to process the documents before we release the questions your RAG needs to answer. This gives your RAG enough time to handle all the files.

STEP 3: SUBMIT YOUR RAGS' ANSWERS 

We'll be accepting answers for 24-48 hours after the question announcement, to let people experiment with different architectures. Once completed, submit the answers to us via API. 

IBM watsonx: Exclusive Track at the Enterprise RAG Challenge!

Are you interested in exploring the potential of IBM watsonx? As part of the Enterprise RAG Challenge, we’re introducing an exclusive IBM watsonx track designed to give you hands-on experience!

What’s in it for you?

  • IBM watsonx in Action: Get the chance to work directly with IBM watsonx and leverage the platform’s powerful capabilities.
  • Guidance from IBM Experts: You won’t be on your own! Experienced IBM experts will be available to help you with any questions or challenges you encounter.
  • All the Resources You Need: IBM will provide everything you need to get started and succeed.

🏆 Exciting Additional Prizes:
Compete for additional prizes of €500, €350, and €200 in vouchers for the top-performing teams on this track!

 DID YOU BUILD THE WINNING RAG?

Dream Big, Results Drop the Next Week!

Check back on Friday, March 7th, same time and place, in our Discord channel to find out if you’ve won. Celebrate your achievements, connect with fellow participants, and join the excitement as we unveil the winners! 🎉

 ANSWERS TO SOME FREQUENTLY ASKED QUESTIONS

Does everyone receive an own set of pdfs or will everyone receive the same set, dependent on the seed generated?

It will be the same set of PDFs for everybody (it will be the same seed for everybody)

Does everyone receive an own set or will everyone receive the same set of questions?

It will be the same set of questions for everybody (it will be the same seed for everybody)

Do I push my answers to a git repo?

We will setup an API to which you can push your answers (programmatically or upload by hand).

This API will immediately save, sign and timestamp the submission, so it will be provable that is was submitted at a specific point of time.