We’ve written earlier about the first round of our Enterprise RAG Challenge. In this friendly challenge different AI Assistants competed in answering questions based on the annual reports of public companies. Teams from the different countries competed in building such assistants. There were even a few commercial solutions in the mix.
Datum
04.10.2024
content.autor.writtenBy
You can find code for the solutions marked with “TTA” (TimeToAct) on Github. Solutions include description of the approach, code itself, sometimes even the log of failed experiments.
Code is real, without any cleanups and beautification.
In short:
Daniel - winning and surprisingly simple solution that used checklist pattern with structured outputs. First place.
→ Check out Daniel's solution
Felix - multi-agent solution with ChatGPT-4o. 12th place.
→ Check out Felix' solution
Maria - solution using OpenAI Assistants API. 13th place.
→ Check out Maria's solution
Pedro - locally-capable solution using openchat-3.5-0106. ninth place.
→ Check out Pedro's solution
What's next?
Next round of Enterprise RAG Challenge will take place later this fall, with a bigger audience. The exact time depends on the organisation process within the TIMEOTACT GROUP. Perhaps, around November.
In the next round, question generator will be rebalanced, so that:
There are less questions that don't have an answer (agents must respond N/A to these)
There is more variability in the questions, so that “brute force” approach with checklists+structured outputs will not be able to win the competition so easily.
Questionnaires for the participants will also be reworked, so that we all together could learn more about approaches for Enterprise AI that work well in practice.

ChatGPT & Co: LLM Benchmarks for September

ChatGPT & Co: LLM Benchmarks for November

ChatGPT & Co: LLM Benchmarks for December

ChatGPT & Co: LLM Benchmarks for October

ChatGPT & Co: LLM Benchmarks for January

Part 4: Save Time and Analyze the Database File

Strategic Impact of Large Language Models

Let's build an Enterprise AI Assistant

So You are Building an AI Assistant?

AI Contest - Enterprise RAG Challenge

The Intersection of AI and Voice Manipulation

Part 3: How to Analyze a Database File with GPT-3.5

Part 1: Data Analysis with ChatGPT

LLM Performance Series: Batching

Creating a Social Media Posts Generator Website with ChatGPT

SAM Wins First Prize at AIM Hackathon

Second Place - AIM Hackathon 2024: Trustpilot for ESG

Third Place - AIM Hackathon 2024: The Venturers

AIM Hackathon 2024: Sustainability Meets LLMs

Common Mistakes in the Development of AI Assistants

8 tips for developing AI assistants

AI Workshops for Companies

Database Analysis Report

5 Inconvenient Questions when hiring an AI company

License Plate Detection for Precise Car Distance Estimation

Artificial Intelligence in Treasury Management

The Power of Event Sourcing

Innovation Incubator at TIMETOACT GROUP Austria

From the idea to the product: The genesis of Skwill

Part 1: Detecting Truck Parking Lots on Satellite Images

Tracing IO in .NET Core

Make Your Value Stream Visible Through Structured Logging

Part 2: Data Analysis with powerful Python

Introduction to Functional Programming in F#

Machine Learning Pipelines

Revolutionizing the Logistics Industry

Event Sourcing with Apache Kafka

Using NLP libraries for post-processing

ADRs as a Tool to Build Empowered Teams

Why Was Our Project Successful: Coincidence or Blueprint?

Introduction to Functional Programming in F# – Part 8

Introduction to Functional Programming in F# – Part 9

Using a Skill/Will matrix for personal career development

Introduction to Functional Programming in F# – Part 7

Consistency and Aggregates in Event Sourcing

My Workflows During the Quarantine

Learning + Sharing at TIMETOACT GROUP Austria

My Weekly Shutdown Routine

Introduction to Functional Programming in F# – Part 10

Process Pipelines

Introduction to Functional Programming in F# – Part 11

Introduction to Functional Programming in F# – Part 12

Innovation Incubator Round 1

Announcing Domain-Driven Design Exercises

Creating a Cross-Domain Capable ML Pipeline

State of Fast Feedback in Data Science Projects

Part 2: Detecting Truck Parking Lots on Satellite Images

5 lessons from running a (remote) design systems book club

Introduction to Functional Programming in F# – Part 2

How we discover and organise domains in an existing product

Running Hybrid Workshops

So, I wrote a book

7 Positive effects of visualizing the interests of your team

How to gather data from Miro

Introduction to Functional Programming in F# – Part 4

Boosting speed of scikit-learn regression algorithms

CSS :has() & Responsive Design

Introduction to Functional Programming in F# – Part 6

Designing and Running a Workshop series: An outline

Designing and Running a Workshop series: The board

Composite UI with Design System and Micro Frontends

Building and Publishing Design Systems | Part 2

Building a micro frontend consuming a design system | Part 3

Building A Shell Application for Micro Frontends | Part 4

Introduction to Functional Programming in F# – Part 5

Introduction to Functional Programming in F# – Part 3

Celebrating achievements

Introduction to Web Programming in F# with Giraffe – Part 1

Introduction to Web Programming in F# with Giraffe – Part 2

Inbox helps to clear the mind

Introduction to Partial Function Application in F#

Introduction to Web Programming in F# with Giraffe – Part 3
