Masked Particle Modeling on Sets: Towards Self-Supervised High Energy
Physics Foundation Models

Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Models

24 January 2024

Margarita Osadchy

Papers citing "Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Models"

15 / 15 papers shown

Title
Towards Foundation Models for Experimental Readout Systems Combining Discrete and Continuous Data J. Giroux C. Fanelli 21 0 0 13 May 2025
Particle Trajectory Representation Learning with Masked Point Modeling Sam Young Yeon-jae Jwa Kazuhiro Terao 3DPC 69 1 0 04 Feb 2025
Extrapolating Jet Radiation with Autoregressive Transformers A. Butter François Charton Javier Marino Villadamigo Ayodele Ore Tilman Plehn Jonas Spinner 78 0 0 16 Dec 2024
Pretrained Event Classification Model for High Energy Physics Analysis Joshua Ho Benjamin Ryan Roberts Shuo Han Haichen Wang 97 1 0 14 Dec 2024
Is Tokenization Needed for Masked Particle Modelling? Matthew Leigh Samuel Klein François Charton Tobias Golling Lukas Heinrich Michael Kagan Ines Ochoa Margarita Osadchy 37 7 0 19 Sep 2024
TrackSorter: A Transformer-based sorting algorithm for track finding in High Energy Physics Yash Melkani Xiangyang Ju 37 1 0 31 Jul 2024
Calo-VQ: Vector-Quantized Two-Stage Generative Model in Calorimeter Simulation Qibin Liu Chase Shimmin Xiulong Liu Eli Shlizerman Shu Li Shih-Chieh Hsu DRL MQ 43 7 0 10 May 2024
PAPERCLIP: Associating Astronomical Observations and Natural Language with Multi-Modal Models S. Mishra-Sharma Yiding Song Jesse Thaler 34 7 0 13 Mar 2024
Re-Simulation-based Self-Supervised Learning for Pre-Training Foundation Models Philip Harris Michael Kagan J. Krupa B. Maier Nathaniel Woodward 38 4 0 11 Mar 2024
OmniJet- $α$ : The first cross-task foundation model for particle physics Joschka Birk Anna Hallin Gregor Kasieczka AI4CE 40 22 0 08 Mar 2024
Finetuning Foundation Models for Joint Analysis Optimization M. Vigl N. Hartman L. Heinrich 43 12 0 24 Jan 2024
Towards Galaxy Foundation Models with Hybrid Contrastive Learning Mike Walmsley I. V. Slijepcevic Micah Bowles A. Scaife VLM 40 16 0 23 Jun 2022
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 341 5,785 0 29 Apr 2021
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 255 4,781 0 24 Feb 2021
Permutationless Many-Jet Event Reconstruction with Symmetry Preserving Attention Networks M. Fenton Alexander Shmakov Ta-Wei Ho S. Hsu D. Whiteson Pierre Baldi 41 37 0 19 Oct 2020