CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Models

30 January 2024

Yuanjie Lyu

Enhong Chen

Papers citing "CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Models"

28 / 28 papers shown

Title
Can LLMs Be Trusted for Evaluating RAG Systems? A Survey of Methods and Datasets Lorenz Brehme Thomas Ströhle Ruth Breu 59 0 0 28 Apr 2025
Retrieval Augmented Generation Evaluation in the Era of Large Language Models: A Comprehensive Survey Aoran Gan Hao Yu Kai Zhang Qi Liu Wenyu Yan Zhenya Huang Shiwei Tong Guoping Hu RALM 3DV 38 0 0 21 Apr 2025
Retrieval-Augmented Purifier for Robust LLM-Empowered Recommendation Liangbo Ning Wenqi Fan Qing Li AAML 33 1 0 03 Apr 2025
RAS: Retrieval-And-Structuring for Knowledge-Intensive LLM Generation Pengcheng Jiang Lang Cao Ruike Zhu Minhao Jiang Yunyi Zhang J. Sun J. Han RALM 77 0 0 16 Feb 2025
A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Models Qinggang Zhang Shengyuan Chen Yuanchen Bei Zheng Yuan Huachi Zhou Zijin Hong Junnan Dong Hao-Heng Chen Yi-Ju Chang Xiao Huang 3DV 66 7 0 21 Jan 2025
ASTRID -- An Automated and Scalable TRIaD for the Evaluation of RAG-based Clinical Question Answering Systems Mohita Chowdhury Yajie Vera He Aisling Higham Ernest Lim 58 1 0 14 Jan 2025
PersianRAG: A Retrieval-Augmented Generation System for Persian Language Hossein Hosseini Mohammad Sobhan Zare Amir Hossein Mohammadi Arefeh Kazemi Zahra Zojaji Mohammad Ali Nematbakhsh VLM RALM 34 0 0 05 Nov 2024
Meta-Chunking: Learning Efficient Text Segmentation via Logical Perception Jihao Zhao Zhiyuan Ji Pengnian Qi Simin Niu Bo Tang Feiyu Xiong Z. Li Zhiyu Li 74 4 0 16 Oct 2024
LightRAG: Simple and Fast Retrieval-Augmented Generation Zirui Guo Lianghao Xia Yanhua Yu Tu Ao Chao Huang 49 12 0 08 Oct 2024
RAGChecker: A Fine-grained Framework for Diagnosing Retrieval-Augmented Generation Dongyu Ru Lin Qiu Xiangkun Hu Tianhang Zhang Peng Shi ... Tong He Zhiguo Wang Pengfei Liu Yue Zhang Zheng Zhang 47 12 0 15 Aug 2024
Modular RAG: Transforming RAG Systems into LEGO-like Reconfigurable Frameworks Yunfan Gao Yun Xiong Meng Wang Haofen Wang 36 17 0 26 Jul 2024
CANDY: A Benchmark for Continuous Approximate Nearest Neighbor Search with Dynamic Data Ingestion Xianzhi Zeng Zhuoyan Wu Xinjing Hu Xuanhua Shi Shixuan Sun Shuhao Zhang 36 2 0 28 Jun 2024
Towards Fine-Grained Citation Evaluation in Generated Text: A Comparative Analysis of Faithfulness Metrics Weijia Zhang Mohammad Aliannejadi Yifei Yuan Jiahuan Pei Jia-Hong Huang Evangelos Kanoulas HILM 29 12 0 21 Jun 2024
UDA: A Benchmark Suite for Retrieval Augmented Generation in Real-world Document Analysis Yulong Hui Yao Lu Huanchen Zhang RALM 33 9 0 21 Jun 2024
ALiiCE: Evaluating Positional Fine-grained Citation Generation Yilong Xu Jinhua Gao Xiaoming Yu Baolong Bi Huawei Shen Xueqi Cheng HILM 29 5 0 19 Jun 2024
Empowering Large Language Models to Set up a Knowledge Retrieval Indexer via Self-Learning Xun Liang Simin Niu Zhiyu Li Sensen Zhang Shichao Song Hanyu Wang Jiawei Yang Feiyu Xiong Bo Tang Chenyang Xi RALM 15 6 0 27 May 2024
Evaluation of Retrieval-Augmented Generation: A Survey Hao Yu Aoran Gan Kai Zhang Shiwei Tong Qi Liu Zhaofeng Liu 3DV 57 79 0 13 May 2024
Retrieval-Augmented Generation for AI-Generated Content: A Survey Penghao Zhao Hailin Zhang Qinhan Yu Zhengren Wang Yunteng Geng Fangcheng Fu Ling Yang Wentao Zhang Jie Jiang Bin Cui 3DV 110 220 0 29 Feb 2024
Mafin: Enhancing Black-Box Embeddings with Model Augmented Fine-Tuning Mingtian Zhang Shawn Lan Peter Hayes David Barber 21 2 0 19 Feb 2024
Large Language Models for Generative Information Extraction: A Survey Derong Xu Wei-neng Chen Wenjun Peng Chao Zhang Tong Bill Xu Xiangyu Zhao Xian Wu Yefeng Zheng Yang Wang Enhong Chen 38 143 0 29 Dec 2023
Retrieval-Augmented Generation for Large Language Models: A Survey Yunfan Gao Yun Xiong Xinyu Gao Kangxiang Jia Jinliu Pan Yuxi Bi Yi Dai Jiawei Sun Meng Wang Haofen Wang 3DV RALM 52 1,499 1 18 Dec 2023
Chain-of-Note: Enhancing Robustness in Retrieval-Augmented Language Models W. Yu Hongming Zhang Xiaoman Pan Kaixin Ma Hongwei Wang Dong Yu KELM RALM LRM 65 101 0 15 Nov 2023
ChatGPT Hallucinates when Attributing Answers Guido Zuccon Bevan Koopman Razia Shaik RALM LRM HILM 41 25 0 17 Sep 2023
Lift Yourself Up: Retrieval-augmented Text Generation with Self Memory Xin Cheng Di Luo Xiuying Chen Lemao Liu Dongyan Zhao Rui Yan RALM 145 91 0 03 May 2023
Sparks of Artificial General Intelligence: Early experiments with GPT-4 Sébastien Bubeck Varun Chandrasekaran Ronen Eldan J. Gehrke Eric Horvitz ... Scott M. Lundberg Harsha Nori Hamid Palangi Marco Tulio Ribeiro Yi Zhang ELM AI4MH AI4CE ALM 233 2,232 0 22 Mar 2023
Large Language Model Is Not a Good Few-shot Information Extractor, but a Good Reranker for Hard Samples! Yubo Ma Yixin Cao YongChing Hong Aixin Sun RALM 80 85 0 15 Mar 2023
Rethinking with Retrieval: Faithful Large Language Model Inference Hangfeng He Hongming Zhang Dan Roth KELM LRM 141 156 0 31 Dec 2022
Factual Error Correction for Abstractive Summarization Models Mengyao Cao Yue Dong Jiapeng Wu Jackie C.K. Cheung HILM KELM 167 159 0 17 Oct 2020