Scaling Down to Scale Up: A Cost-Benefit Analysis of Replacing OpenAI's
LLM with Open Source SLMs in Production

v1v2v3 (latest)

Scaling Down to Scale Up: A Cost-Benefit Analysis of Replacing OpenAI's LLM with Open Source SLMs in Production

20 December 2023

Chandra Irugalbandara

Ashish Mahendra

Roland Daynauth

Kugesan Sivasothynathan

Krisztian Flautner

ArXiv (abs)PDF HTML HuggingFace (1 upvotes)

Papers citing "Scaling Down to Scale Up: A Cost-Benefit Analysis of Replacing OpenAI's LLM with Open Source SLMs in Production"

14 / 14 papers shown

Title
Small Language Models for Phishing Website Detection: Cost, Performance, and Privacy Trade-Offs Georg Goldenits Philip Koenig Sebastian Raubitzek Andreas Ekelhart 28 0 0 19 Nov 2025
On-Premise SLMs vs. Commercial LLMs: Prompt Engineering and Incident Classification in SOCs and CSIRTs Gefté Almeida Marcio Pohlmann Alex Severo Diego Kreutz Tiago Heinrich Lourenço Pereira 12 0 0 18 Nov 2025
Metamorphic Testing of Large Language Models for Natural Language ProcessingIEEE International Conference on Software Maintenance and Evolution (ICSME), 2025 Steven Cho Stefano Ruberto Valerio Terragni 104 2 0 03 Nov 2025
Bridging the Digital Divide: Small Language Models as a Pathway for Physics and Photonics Education in Underdeveloped Regions Asghar Ghorbani Hanieh Fattahi 213 1 0 14 Jun 2025
Position: Federated Foundation Language Model Post-Training Should Focus on Open-Source Models Nikita Agrawal Simon Mertel R. Mayer 291 0 0 29 May 2025
SLMEval: Entropy-Based Calibration for Human-Aligned Evaluation of Large Language Models Roland Daynauth Christopher Clarke Krisztian Flautner Lingjia Tang Jason Mars ALM 126 0 0 21 May 2025
Reliable Decision Support with LLMs: A Framework for Evaluating Consistency in Binary Text Classification Applications Fadel M. Megahed Ying-Ju Chen L. Allision Jones-Farmer Younghwa Lee Jiawei Brooke Wang Inez M. Zwetsloot 230 1 0 20 May 2025
Aleph-Alpha-GermanWeb: Improving German-language LLM pre-training with model-based data curation and synthetic data generation Thomas F Burns Letitia Parcalabescu Stephan Wäldchen Michael Barlow Gregor Ziegltrum Volker Stampa Bastian Harren Björn Deiseroth SyDa 401 1 0 24 Apr 2025
Beyond Release: Access Considerations for Generative AI Systems Irene Solaiman Rishi Bommasani Dan Hendrycks Ariel Herbert-Voss Yacine Jernite Aviya Skowron Andrew Trask 432 3 0 23 Feb 2025
From Cool Demos to Production-Ready FMware: Core Challenges and a Technology Roadmap Gopi Krishnan Rajbahadur G. Oliva Dayi Lin Ahmed E. Hassan 236 3 0 28 Jan 2025
SLM-Mod: Small Language Models Surpass LLMs at Content ModerationNorth American Chapter of the Association for Computational Linguistics (NAACL), 2024 Xianyang Zhan Agam Goyal Yilun Chen Eshwar Chandrasekharan Koustuv Saha AI4MH 853 16 0 17 Oct 2024
Benchmarking LLMs in Political Content Text-Annotation: Proof-of-Concept with Toxicity and Incivility Data Bastián González-Bustamante 131 8 0 15 Sep 2024
Large Model Strategic Thinking, Small Model Efficiency: Transferring Theory of Mind in Large Language Models Nunzio Lorè Alireza Ilami Babak Heydari LRM 319 4 0 05 Aug 2024
Aligning Model Evaluations with Human Preferences: Mitigating Token Count Bias in Language Model Assessments Roland Daynauth Jason Mars ALM 138 0 0 05 Jul 2024