DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery
through Sophisticated AI System Technologies

DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies

6 October 2023

Chengming Zhang

Masahiro Tanaka

Yuxiong He

Jonathan A. Weyn

Sylwester Klocek

Mohammed AlQuraishi

Arvind Ramanathan

Alexander Brace

Cindy Orozco Bohorquez

Austin R. Clyde

Danilo Perez-Rivera

Prasanna Balaprakash

John P. Gounley

Massimiliano Lupo Pasini

Feiyi Wang

Alexey Svyatkovskiy

Michael Schulte

Christian Dallago

Anima Anandkumar

Papers citing "DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies"

3 / 3 papers shown

Title
Every FLOP Counts: Scaling a 300B Mixture-of-Experts LING LLM without Premium GPUs Ling Team B. Zeng C. Huang Chao Zhang Changxin Tian ... Zhaoxin Huan Zujie Wen Zhenhang Sun Zhuoxuan Du Z. He MoE ALM 89 2 0 07 Mar 2025
Activating Distributed Visual Region within LLMs for Efficient and Effective Vision-Language Training and Inference Siyuan Wang Dianyi Wang Chengxing Zhou Zejun Li Zhihao Fan Xuanjing Huang Zhongyu Wei VLM 72 0 0 17 Dec 2024
EVF-SAM: Early Vision-Language Fusion for Text-Prompted Segment Anything Model Yuxuan Zhang Tianheng Cheng Lianghui Zhu Lei Liu Heng Liu Longjin Ran Xiaoxin Chen Xiaoxin Chen Wenyu Liu Xinggang Wang VLM 44 23 0 28 Jun 2024