Ground Truth Heterogeneity: Exploring Development And Non-Clinical Use Of Retrieval-Augmented Generation Chatbot In Healthcare

Engineering notes

Engineering notes will be added by the aipentium editorial team.

Chinese explanation / 中文解读

中文解读待补充：本站会优先为大语言模型、生成式AI、ChatGPT相关技术、计算机视觉、深度学习等高价值论文补充中文说明。

Original abstract

Retrieval-augmented generation (RAG) architecture enhances large language models (LLMs) by incorporating external, domain-specific data sources, thereby reducing hallucinations and improving response accuracy. This approach departs from purely generative systems and offers a scalable, cost-efficient alternative for enhancing LLMs. However, the construction of ground truth to enable evolvability (ability to integrate new data continuously) and adaptability (ability to adjust responses to user context and intents dynamically) remains challenging. This study investigates how the challenges of establishing ground truth manifest at the organizational, unit, team, and individual levels within a countywide Swedish healthcare organization. Our analysis reveals that the main challenges stem from the heterogeneity of knowledge practices, which complicate the creation of reliable retrieval from the knowledge base. Furthermore, we identify a trade-off between attempts to enhance accuracy and maintain contextual relevance. These findings contribute practical insights into the micro-foundations of evolvability and adaptability in RAG-based chatbot development.

Links and sources

• PDF from original source

Comments