ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1806.01156
93
659
v1v2v3 (latest)

Rigging Research Results by Manipulating Top Websites Rankings

4 June 2018
Victor Le Pochat
Tom van Goethem
Samaneh Tajalizadehkhoob
ArXiv (abs)PDFHTML
Abstract

Researchers often use rankings of popular websites when measuring security practices, evaluating defenses or analyzing ecosystems. However, little is known about the data collection and processing methodologies of these rankings. In this paper, we uncover how both inherent properties and vulnerabilities to adversarial manipulation of these rankings may affect the conclusions of security studies. To that end, we compare four main rankings used in recent studies in terms of their agreement with each other, stability, representation bias and potential impact on research cases. Additionally, we introduce and illustrate novel ways for the adversary to manipulate the rankings and bend research results to their will. Overall, our study reveals significant shortcomings of current rankings and calls for a more cautious approach from the research community.

View on arXiv
Comments on this paper