On Testing for Biases in Peer Review

31 December 2019

Aarti Singh

Papers citing "On Testing for Biases in Peer Review"

27 / 27 papers shown

Title
Paper Quality Assessment based on Individual Wisdom Metrics from Open Peer Review Andrii Zahorodnii Jasper J.F. van den Bosch Ian Charest Christopher Summerfield Ila R. Fiete 135 0 0 22 Jan 2025
When Reviewers Lock Horn: Finding Disagreement in Scientific Peer Reviews Sandeep Kumar Tirthankar Ghosal Asif Ekbal 101 1 0 28 Oct 2023
Testing for Reviewer Anchoring in Peer Review: A Randomized Controlled Trial Ryan Liu Steven Jecmen Vincent Conitzer Fei Fang Nihar B. Shah 434 3 0 11 Jul 2023
Investigating Fairness Disparities in Peer Review: A Language Model Enhanced Approach Jiayao Zhang Hongming Zhang Zhun Deng Dan Roth 84 16 0 07 Nov 2022
A Blockchain Cloud Computing Middleware for Academic Manuscript Submission Alexandros Gazis G. Anagnostakis Stavros Kourmpetis E. Katsiri 13 5 0 09 Feb 2022
Calibration with Privacy in Peer Review Wenxin Ding Gautam Kamath Weina Wang Nihar B. Shah 72 7 0 27 Jan 2022
Strategyproofing Peer Assessment via Partitioning: The Price in Terms of Evaluators' Expertise Komal Dhull Steven Jecmen Pravesh Kothari Nihar B. Shah 77 13 0 25 Jan 2022
You Are the Best Reviewer of Your Own Papers: An Owner-Assisted Scoring Mechanism Weijie J. Su 37 20 0 27 Oct 2021
Near-Optimal Reviewer Splitting in Two-Phase Paper Reviewing and Conference Experiment Design Steven Jecmen Hanrui Zhang Ryan Liu Fei Fang Vincent Conitzer Nihar B. Shah 141 10 0 13 Aug 2021
What do writing features tell us about AI papers? Zining Zhu Bai Li Yang Xu Frank Rudzicz 24 0 0 13 Jul 2021
Making Paper Reviewing Robust to Bid Manipulation Attacks Ruihan Wu Chuan Guo Felix Wu Rahul Kidambi Laurens van der Maaten Kilian Q. Weinberger AAML 68 24 0 09 Feb 2021
Can We Automate Scientific Reviewing? Weizhe Yuan Pengfei Liu Graham Neubig 151 90 0 30 Jan 2021
Debiasing Evaluations That are Biased by Evaluations Jingyan Wang Ivan Stelmakh Yuting Wei Nihar B. Shah CML 41 22 0 01 Dec 2020
A Large Scale Randomized Controlled Trial on Herding in Peer-Review Discussions Ivan Stelmakh Charvi Rastogi Nihar B. Shah Aarti Singh Hal Daumé CML 77 23 0 30 Nov 2020
A Novice-Reviewer Experiment to Address Scarcity of Qualified Reviewers in Large Conferences Ivan Stelmakh Nihar B. Shah Aarti Singh Hal Daumé 47 29 0 30 Nov 2020
Prior and Prejudice: The Novice Reviewers' Bias against Resubmissions in Conference Peer Review Ivan Stelmakh Nihar B. Shah Aarti Singh Hal Daumé 44 11 0 30 Nov 2020
Uncovering Latent Biases in Text: Method and Application to Peer Review Emaad Manzoor Nihar B. Shah 64 39 0 29 Oct 2020
ArXiving Before Submission Helps Everyone Dmytro Mishkin A. Tabb Jirí Matas AI4CE 16 2 0 11 Oct 2020
Catch Me if I Can: Detecting Strategic Behaviour in Peer Assessment Ivan Stelmakh Nihar B. Shah Aarti Singh 54 38 0 08 Oct 2020
Mitigating Manipulation in Peer Review via Randomized Reviewer Assignments Steven Jecmen Hanrui Zhang Ryan Liu Nihar B. Shah Vincent Conitzer Fei Fang 131 70 0 29 Jun 2020
On the Privacy-Utility Tradeoff in Peer-Review Data Analysis Wenxin Ding Nihar B. Shah Weina Wang 35 12 0 29 Jun 2020
A SUPER* Algorithm to Optimize Paper Bidding in Peer Review Tanner Fiez Nihar B. Shah Lillian J. Ratliff 57 38 0 27 Jun 2020
Loss Functions, Axioms, and Peer Review Ritesh Noothigattu Nihar B. Shah Ariel D. Procaccia 65 43 0 27 Aug 2018
On Strategyproof Conference Peer Review Yichong Xu Haiying Zhao Xiaofei Shi Jeremy Zhang Nihar B. Shah 100 49 0 16 Jun 2018
PeerReview4All: Fair and Accurate Reviewer Assignment in Peer Review Ivan Stelmakh Nihar B. Shah Aarti Singh 59 97 0 16 Jun 2018
Low Permutation-rank Matrices: Structural Properties and Noisy Completion Nihar B. Shah Sivaraman Balakrishnan Martin J. Wainwright 188 18 0 01 Sep 2017
A Permutation-based Model for Crowd Labeling: Optimal Estimation and Robustness Nihar B. Shah Sivaraman Balakrishnan Martin J. Wainwright FedML 92 44 0 30 Jun 2016