I Built a RAG System for Our Analytics Team. It Worked Great Until We Added Real Data.
I’ll tell you the moment I knew our RAG implementation was in trouble. A product manager asked our internal knowledge assistant: “What’s our refund policy for enterprise customers?” The system retrieved three chunks from three different documents. One was from 2022. One was from 2024. One was a draft that never got approved. It combined all three into a confident, well-formatted answer that was wrong in ways that would have cost us money if anyone had acted on […]