Q: What about hallucinations, what are the LLM models

Yehia
Aug 18, 2025A: Hello, LLM is OpenAI ChatGPT 4o. Answers are only provided based on the domain knowledge you provide, so no hallucinations.
Thanks. “GPT‑4o + domain knowledge = no hallucinations” isn’t sufficient. Meaningful reduction requires RAG with thresholds, an answer‑only‑if‑grounded policy, citations/snippets from the KB, guardrails to prevent speculation, and fallback/abstain on low confidence. Do you implement these? If yes, please share technical details (e.g., thresholds, abstain behavior, citations, metrics).
Yes we do use RAG, with thresholds, so the chatbot only answers questions related to the knowledge base. Try asking it who's the current president of the United States or how tall is the Eiffel Tower
Thanks for the clarification—great to hear you’re using RAG with thresholds. To satisfy our QA/compliance, could you share a bit more detail: 1. Do you enforce citations/snippets from the KB in answers? 2. What’s the behavior on low confidence (abstain/fallback to agent/ticket)? 3. What retrieval do you use (dense/hybrid) and what thresholds? 4. Do you track metrics;
love the detailed technical inquiries 🙂, (1) citations are not shared in the output answer (2) the bot suggests a handover to an agent (3) dense, around 75% (4) sure we have several dashboards builtin