Smaller Language Models are Better Black-box Machine-Generated Text Detectors

17 May 2023

Niloofar Mireshghallah

Justus Mattern

Sicun Gao

Reza Shokri

Taylor Berg-Kirkpatrick

DeLMO

ArXiv PDF HTML

Papers citing "Smaller Language Models are Better Black-box Machine-Generated Text Detectors"

35 / 35 papers shown

Title
Glimpse: Enabling White-Box Methods to Use Proprietary Models for Zero-Shot LLM-Generated Text Detection Guangsheng Bao Yanbin Zhao Juncai He Yue Zhang VLM 92 1 0 20 Feb 2025
Synthetic Data Can Mislead Evaluations: Membership Inference as Machine Text Detection Ali Naseh Niloofar Mireshghallah 49 0 0 20 Jan 2025
What is the Role of Small Models in the LLM Era: A Survey Lihu Chen Gaël Varoquaux ALM 56 23 0 10 Sep 2024
An Evaluation of Explanation Methods for Black-Box Detectors of Machine-Generated Text Loris Schoenegger Yuxi Xia Benjamin Roth FAtt 22 0 0 26 Aug 2024
Investigating the Influence of Prompt-Specific Shortcuts in AI Generated Text Detection Choonghyun Park Hyuhng Joon Kim Junyeob Kim Youna Kim Taeuk Kim Hyunsoo Cho Hwiyeol Jo Sang-goo Lee Kang Min Yoo AAML 34 1 0 24 Jun 2024
Navigating the Shadows: Unveiling Effective Disturbances for Modern AI Content Detectors Ying Zhou Ben He Le Sun DeLMO 34 1 0 13 Jun 2024
Improving Logits-based Detector without Logits from Black-box LLMs Cong Zeng Shengkun Tang Xianjun Yang Yuanzhou Chen Yiyou Sun zhiqiang xu Yao Li Haifeng Chen Wei Cheng Dongkuan Xu DeLMO 55 1 0 07 Jun 2024
Survey on Plagiarism Detection in Large Language Models: The Impact of ChatGPT and Gemini on Academic Integrity Shushanta Pudasaini Luis Miralles-Pechuán David Lillis Marisa Llorens-Salvador 34 1 0 04 Jun 2024
Humanizing Machine-Generated Content: Evading AI-Text Detection through Adversarial Attack Ying Zhou Ben He Le Sun DeLMO AAML 23 2 0 02 Apr 2024
The Impact of Prompts on Zero-Shot Detection of AI-Generated Text Kaito Taguchi Yujie Gu Kouichi Sakurai AAML DeLMO 24 6 0 29 Mar 2024
EAGLE: A Domain Generalization Framework for AI-generated Text Detection Amrita Bhattacharjee Raha Moraffah Joshua Garland Huan Liu DeLMO 29 5 0 23 Mar 2024
Duwak: Dual Watermarks in Large Language Models Chaoyi Zhu Jeroen Galjaard Pin-Yu Chen Lydia Y. Chen AAML WaLM 24 1 0 12 Mar 2024
GumbelSoft: Diversified Language Model Watermarking via the GumbelMax-trick Jiayi Fu Xuandong Zhao Ruihan Yang Yuan Zhang Jiangjie Chen Yanghua Xiao WaLM 38 7 0 20 Feb 2024
Stumbling Blocks: Stress Testing the Robustness of Machine-Generated Text Detectors Under Attacks Yichen Wang Shangbin Feng Abe Bohan Hou Xiao Pu Chao Shen Xiaoming Liu Yulia Tsvetkov Tianxing He DeLMO 25 17 0 18 Feb 2024
Hidding the Ghostwriters: An Adversarial Evaluation of AI-Generated Student Essay Detection Xinlin Peng Ying Zhou Ben He Le Sun Yingfei Sun DeLMO 11 10 0 01 Feb 2024
Does DetectGPT Fully Utilize Perturbation? Bridging Selective Perturbation to Fine-tuned Contrastive Learning Detector would be Better Shengchao Liu Xiaoming Liu Yichen Wang Zehua Cheng Chengzhengxu Li Zhaohan Zhang Y. Lan Chao Shen DeLMO 22 2 0 01 Feb 2024
Raidar: geneRative AI Detection viA Rewriting Chengzhi Mao Carl Vondrick Hao Wang Junfeng Yang DeLMO 18 22 0 23 Jan 2024
Between Lines of Code: Unraveling the Distinct Patterns of Machine and Human Programmers Yuling Shi Hongyu Zhang Chengcheng Wan Xiaodong Gu DeLMO 16 3 0 12 Jan 2024
Assaying on the Robustness of Zero-Shot Machine-Generated Text Detectors Yi-Fan Zhang Zhang Zhang Liang Wang Tien-Ping Tan Rong Jin DeLMO 71 8 0 20 Dec 2023
A Survey on Detection of LLMs-Generated Content Xianjun Yang Liangming Pan Xuandong Zhao Haifeng Chen Linda R. Petzold William Yang Wang Wei Cheng DeLMO 30 50 0 24 Oct 2023
Towards Possibilities & Impossibilities of AI-generated Text Detection: A Survey Soumya Suvra Ghosal Souradip Chakraborty Jonas Geiping Furong Huang Dinesh Manocha Amrit Singh Bedi DeLMO 14 25 0 23 Oct 2023
On the Zero-Shot Generalization of Machine-Generated Text Detectors Xiao Pu Jingyu Zhang Xiaochuang Han Yulia Tsvetkov Tianxing He DeLMO 20 14 0 08 Oct 2023
Zero-Shot Detection of Machine-Generated Codes Xianjun Yang Kexun Zhang Haifeng Chen Linda R. Petzold William Yang Wang Wei Cheng DeLMO 13 11 0 08 Oct 2023
SemStamp: A Semantic Watermark with Paraphrastic Robustness for Text Generation Abe Bohan Hou Jingyu Zhang Tianxing He Yichen Wang Yung-Sung Chuang Hongwei Wang Lingfeng Shen Benjamin Van Durme Daniel Khashabi Yulia Tsvetkov WaLM 32 0 0 06 Oct 2023
Can LLM-Generated Misinformation Be Detected? Canyu Chen Kai Shu DeLMO 27 157 0 25 Sep 2023
From Text to Source: Results in Detecting Large Language Model-Generated Content Wissam Antoun Benoît Sagot Djamé Seddah DeLMO 20 11 0 23 Sep 2023
An Unforgeable Publicly Verifiable Watermark for Large Language Models Aiwei Liu Leyi Pan Xuming Hu Shuang Li Lijie Wen Irwin King Philip S. Yu WaLM 34 30 0 30 Jul 2023
Membership Inference Attacks against Language Models via Neighbourhood Comparison Justus Mattern Fatemehsadat Mireshghallah Zhijing Jin Bernhard Schölkopf Mrinmaya Sachan Taylor Berg-Kirkpatrick MIALM 15 167 0 29 May 2023
DNA-GPT: Divergent N-Gram Analysis for Training-Free Detection of GPT-Generated Text Xianjun Yang Wei Cheng Yue Wu Linda R. Petzold William Yang Wang Haifeng Chen DeLMO 12 84 0 27 May 2023
Large Language Models can be Guided to Evade AI-Generated Text Detection Ning Lu Shengcai Liu Ruidan He Qi Wang Yew-Soon Ong Ke Tang SILM 20 42 0 18 May 2023
MGTBench: Benchmarking Machine-Generated Text Detection Xinlei He Xinyue Shen Z. Chen Michael Backes Yang Zhang DeLMO 51 99 0 26 Mar 2023
DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvature E. Mitchell Yoonho Lee Alexander Khazatsky Christopher D. Manning Chelsea Finn 16 471 0 26 Jan 2023
CoCo: Coherence-Enhanced Machine-Generated Text Detection Under Data Limitation With Contrastive Learning Xiaoming Liu Zhaohan Zhang Yichen Wang Hang Pu Y. Lan Chao Shen 17 40 0 20 Dec 2022
The Pile: An 800GB Dataset of Diverse Text for Language Modeling Leo Gao Stella Biderman Sid Black Laurence Golding Travis Hoppe ... Horace He Anish Thite Noa Nabeshima Shawn Presser Connor Leahy AIMat 245 1,977 0 31 Dec 2020
Generating Natural Language Adversarial Examples M. Alzantot Yash Sharma Ahmed Elgohary Bo-Jhang Ho Mani B. Srivastava Kai-Wei Chang AAML 233 909 0 21 Apr 2018