April 24, 2024

The "CAR" Problem of LLMs

When I teach Retrieval-Augmented Generation (RAG), I defined the “CAR” (Credibility, Accuracy, and Recency) problem to outline the common challenges faced by Large Language Models (LLMs) and to help my students easily remember and articulate the need for RAG. 😉

The “CAR” problem can significantly impact LLMs’ performance and reliability:

Understanding and addressing “CAR” challenges is essential for improving the effectiveness and reliability of LLMs in various applications.

RAG together with better prompt engineering offers an innovative approach to mitigating some of the “CAR” issues of LLMs by combining the internal knowledge of LLMs with dynamic, external data sources such as webpages, files, and databases:

Therefore, teaching RAG should be a critical part of any basic GenAI courses. I used LangChain and ChromaDB to demonstrate basic concepts of RAG by creating a ChatPDF-like Q&A application.

PS. The featured image for this post is generated using HiddenArt.ai.