Ragas: Automated Evaluation of Retrieval Augmented Generation

26 September 2023

Papers citing "Ragas: Automated Evaluation of Retrieval Augmented Generation"

50 / 94 papers shown

Title
ConSens: Assessing context grounding in open-book question answering Ivan Vankov Matyo Ivanov Adriana Correia Victor Botev ELM 25 0 0 30 Apr 2025
Knowledge Distillation of Domain-adapted LLMs for Question-Answering in Telecom Rishika Sen Sujoy Roychowdhury Sumit Soman H. G. Ranjani Srikhetra Mohanty 21 26 0 28 Apr 2025
Can LLMs Be Trusted for Evaluating RAG Systems? A Survey of Methods and Datasets Lorenz Brehme Thomas Ströhle Ruth Breu 35 0 0 28 Apr 2025
Privacy-Preserving Federated Embedding Learning for Localized Retrieval-Augmented Generation Qianren Mao Qili Zhang Hanwen Hao Zhentao Han Runhua Xu ... Bo Li Y. Song Jin Dong Jianxin Li Philip S. Yu 38 1 0 27 Apr 2025
Test It Before You Trust It: Applying Software Testing for Trustworthy In-context Learning Teeradaj Racharak Chaiyong Ragkhitwetsagul Chommakorn Sontesadisai Thanwadee Sunetnanta 16 1 0 26 Apr 2025
SMARTFinRAG: Interactive Modularized Financial RAG Benchmark Yiwei Zha 24 0 0 25 Apr 2025
FinDER: Financial Dataset for Question Answering and Evaluating Retrieval-Augmented Generation Chanyeol Choi Jihoon Kwon Jaeseon Ha Hojun Choi Chaewoon Kim Yongjae Lee Jy-yong Sohn Alejandro Lopez-Lira RALM 37 0 0 22 Apr 2025
Retrieval Augmented Generation Evaluation in the Era of Large Language Models: A Comprehensive Survey Aoran Gan Hao Yu Kai Zhang Qi Liu Wenyu Yan Zhenya Huang Shiwei Tong Guoping Hu RALM 3DV 21 0 0 21 Apr 2025
A System for Comprehensive Assessment of RAG Frameworks Mattia Rengo Senad Beadini Domenico Alfano Roberto Abbruzzese 21 1 0 10 Apr 2025
A Survey of Large Language Models in Mental Health Disorder Detection on Social Media Zhuohan Ge Nicole Hu Darian Li Yubo Wang Shihao Qi Yuming Xu Han Shi J. Zhang AI4MH 30 0 0 03 Apr 2025
GeoRAG: A Question-Answering Approach from a Geographical Perspective Jian Wang Zhuo Zhao Z. Wang Bo Da Cheng Lei Nie Wen Luo Zhao Yuan Yu Ling Wang Yuan 27 0 0 02 Apr 2025
Enhancing Negation Awareness in Universal Text Embeddings: A Data-efficient and Computational-efficient Approach Hongliu Cao 43 0 0 01 Apr 2025
Multi-Agent LLM Judge: automatic personalized LLM judge design for evaluating natural language generation applications Hongliu Cao Ilias Driouich Robin Singh Eoin Thomas ELM 19 0 0 01 Apr 2025
Hyper-RAG: Combating LLM Hallucinations using Hypergraph-Driven Retrieval-Augmented Generation Yifan Feng Hao Hu Xingliang Hou Shiquan Liu Shihui Ying S. Du Han Hu Yue Gao 17 0 0 30 Mar 2025
Towards Lighter and Robust Evaluation for Retrieval Augmented Generation Alex-Razvan Ispas Charles-Elie Simon Fabien Caspani Vincent Guigue RALM 45 0 0 20 Mar 2025
Validating LLM-as-a-Judge Systems in the Absence of Gold Labels Luke M. Guerdan Solon Barocas Kenneth Holstein Hanna M. Wallach Zhiwei Steven Wu Alexandra Chouldechova ALM ELM 86 0 0 13 Mar 2025
Taxonomic Reasoning for Rare Arthropods: Combining Dense Image Captioning and RAG for Interpretable Classification Nathaniel Lesperance S. Ratnasingham Graham W. Taylor VLM 53 0 0 13 Mar 2025
SePer: Measure Retrieval Utility Through The Lens Of Semantic Perplexity Reduction Lu Dai Yijie Xu Jinhui Ye Hao Liu Hui Xiong 3DV RALM 38 2 0 03 Mar 2025
Towards Efficient Educational Chatbots: Benchmarking RAG Frameworks Umar Ali Khan Ekram Khan Fiza Khan A. A. Moinuddin 24 0 0 02 Mar 2025
Faster, Cheaper, Better: Multi-Objective Hyperparameter Optimization for LLM and RAG Systems Matthew Barker Andrew Bell Evan Thomas James Carr Thomas Andrews Umang Bhatt 52 0 0 25 Feb 2025
LawPal : A Retrieval Augmented Generation Based System for Enhanced Legal Accessibility in India Dnyanesh Panchal Aaryan Gole Vaibhav Narute Raunak Joshi AILaw 43 0 0 23 Feb 2025
From Local to Global: A Graph RAG Approach to Query-Focused Summarization Darren Edge Ha Trinh Newman Cheng Joshua Bradley Alex Chao Apurva Mody Steven Truitt Dasha Metropolitansky Robert Osazuwa Ness Jonathan Larson RALM 93 293 0 20 Feb 2025
CondAmbigQA: A Benchmark and Dataset for Conditional Ambiguous Question Answering Zongxi Li Y. Li Haoran Xie S. J. Qin 54 0 0 03 Feb 2025
Position: Empowering Time Series Reasoning with Multimodal LLMs Yaxuan Kong Yiyuan Yang Shiyu Wang Chenghao Liu Yuxuan Liang Ming Jin Stefan Zohren Dan Pei Y. Liu Qingsong Wen AI4TS LRM 35 2 0 03 Feb 2025
RAGBench: Explainable Benchmark for Retrieval-Augmented Generation Systems Robert Friel Masha Belyi Atindriyo Sanyal 55 17 0 17 Jan 2025
ASTRID -- An Automated and Scalable TRIaD for the Evaluation of RAG-based Clinical Question Answering Systems Mohita Chowdhury Yajie Vera He Aisling Higham Ernest Lim 43 1 0 14 Jan 2025
QuIM-RAG: Advancing Retrieval-Augmented Generation with Inverted Question Matching for Enhanced QA Performance Binita Saha Utsha Saha Muhammad Zubair Malik RALM 3DV 29 2 0 06 Jan 2025
Federated Learning and RAG Integration: A Scalable Approach for Medical Large Language Models Jincheol Jung Hongju Jeong Eui-Nam Huh 66 0 0 18 Dec 2024
SynthLens: Visual Analytics for Facilitating Multi-step Synthetic Route Design Qipeng Wang Rui Sheng Shaolun Ruan Xiaofu Jin Chuhan Shi Min Zhu 76 0 0 01 Dec 2024
Context Awareness Gate For Retrieval Augmented Generation Mohammad Hassan Heydari Arshia Hemmat Erfan Naman Afsaneh Fatemi RALM 65 2 0 25 Nov 2024
Leveraging Retrieval-Augmented Generation for Persian University Knowledge Retrieval Arshia Hemmat Kianoosh Vadaei Mohammad Hassan Heydari Afsaneh Fatemi RALM 30 1 0 09 Nov 2024
RAGulator: Lightweight Out-of-Context Detectors for Grounded Text Generation Ian Poey Jiajun Liu Qishuai Zhong Adrien Chenailler 34 0 0 06 Nov 2024
TeleOracle: Fine-Tuned Retrieval-Augmented Generation with Long-Context Support for Network Nouf Alabbasi Omar Erak Omar Alhussein Ismail Lotfi Sami Muhaidat Merouane Debbah RALM 25 0 0 04 Nov 2024
GraphAide: Advanced Graph-Assisted Query and Reasoning System Sumit Purohit George Chin Patrick S Mackey Joseph A Cottam 18 0 0 29 Oct 2024
SleepCoT: A Lightweight Personalized Sleep Health Model via Chain-of-Thought Distillation Huimin Zheng Xiaofeng Xing Xiangmin Xu VLM 24 1 0 22 Oct 2024
HEnRY: A Multi-Agent System Framework for Multi-Domain Contexts Emmanuele Lacavalla Shuyi Yang Riccardo Crupi Joseph E. Gonzalez LLMAG 21 0 0 16 Oct 2024
ReDeEP: Detecting Hallucination in Retrieval-Augmented Generation via Mechanistic Interpretability ZhongXiang Sun Xiaoxue Zang Kai Zheng Yang Song Jun Xu Xiao Zhang Weijie Yu Yang Song Han Li 23 1 0 15 Oct 2024
News Reporter: A Multi-lingual LLM Framework for Broadcast T.V News Tarun Jain Yufei Gao Sridhar Vanga Karan Singla 18 0 0 10 Oct 2024
An Approach for Auto Generation of Labeling Functions for Software Engineering Chatbots Ebube Alor Ahmad Abdellatif SayedHassan Khatoonabadi Emad Shihab 16 1 0 09 Oct 2024
LightRAG: Simple and Fast Retrieval-Augmented Generation Zirui Guo Lianghao Xia Yanhua Yu Tu Ao Chao Huang 24 11 0 08 Oct 2024
Auto-GDA: Automatic Domain Adaptation for Efficient Grounding Verification in Retrieval-Augmented Generation Tobias Leemann Periklis Petridis G. Vietri Dionysis Manousakas Aaron Roth Sergul Aydore 27 0 0 04 Oct 2024
Recursive Abstractive Processing for Retrieval in Dynamic Datasets Charbel Chucri Rami Azouz Joachim Ott 27 0 0 02 Oct 2024
LLMs Can Check Their Own Results to Mitigate Hallucinations in Traffic Understanding Tasks Malsha Ashani Mahawatta Dona Beatriz Cabrero-Daniel Yinan Yu Christian Berger 18 1 0 19 Sep 2024
Towards Fair RAG: On the Impact of Fair Ranking in Retrieval-Augmented Generation To Eun Kim Fernando Diaz 33 2 0 17 Sep 2024
Measuring text summarization factuality using atomic facts entailment metrics in the context of retrieval augmented generation N. E. Kriman HILM 22 1 0 27 Aug 2024
Improving embedding with contrastive fine-tuning on small datasets with expert-augmented scores Jun Lu David Li Bill Ding Yu Kang 32 2 0 19 Aug 2024
RAGChecker: A Fine-grained Framework for Diagnosing Retrieval-Augmented Generation Dongyu Ru Lin Qiu Xiangkun Hu Tianhang Zhang Peng Shi ... Tong He Zhiguo Wang Pengfei Liu Yue Zhang Zheng Zhang 36 1 0 15 Aug 2024
A RAG-Based Question-Answering Solution for Cyber-Attack Investigation and Attribution Sampath Rajapaksha Ruby Rani Erisa Karafili 29 3 0 12 Aug 2024
RAG Foundry: A Framework for Enhancing LLMs for Retrieval Augmented Generation Daniel Fleischer Moshe Berchansky Moshe Wasserblat Peter Izsak 3DV 25 4 0 05 Aug 2024
MoRSE: Bridging the Gap in Cybersecurity Expertise with Retrieval Augmented Generation Marco Simoni Andrea Saracino Vinod Puthuvath Maurco Conti 26 1 0 22 Jul 2024