mt logoMyToken
ETH Gas
한국어

NVIDIA, AMD, and Intel Unite Rarely: 9 Companies Join Forces to Establish the SGLang Open-Source Inference Consortium

2026-11-18 10:52:33
공유하다share

Insight: Beating AI News, at the inaugural SGLang Summit, NVIDIA, AMD, and Intel—typically fierce competitors—rarely stood together in the same camp.


Nine founding members of the SGLang Alliance include the three chip giants alongside Google, Meta, Thinking Machines Lab, Cloudflare, Modal, and RadixArk, jointly shaping the future roadmap of this open-source AI inference engine. The summit attracted over 2,000 attendees on-site.


SGLang is foundational software for large model runtime, responsible for handling user requests, scheduling GPUs, managing GPU memory, and reusing computation results. It directly determines how fast and cost-effectively a chip can run AI models.


SGLang has previously supported multiple hardware platforms including NVIDIA, AMD, and Intel. The formation of this alliance means chip manufacturers will now more systematically participate in joint development, contributing engineers, testing resources, and driving performance optimization for their respective hardware.


The alliance holds two roadmap meetings annually, but final technical decisions and code merge authority remain with the SGLang maintenance team.


The SGLang official stated that 332 institutions have already adopted the project. Meta also disclosed at the summit that migrating to SGLang has reduced GPU resource usage by over 50% in its large-scale production environments compared to previous inference solutions.


The summit also announced the development direction for SGLang v1.0, focusing on enhancing stability and compatibility in production environments; the official release is still under development. Additionally, public preview support for AWS Trainium chips has been launched, and collaboration with Intel continues to optimize its CPUs, GPUs, and accelerators. The reinforcement learning framework Miles v0.2 has also been released.

면책 조항: 이 기사의 저작권은 원저자에게 있으며 MyToken을 대표하지 않습니다.(www.mytokencap.com)의견 및 입장 콘텐츠에 대한 질문이 있는 경우 저희에게 연락하십시오
community_x_prefix
X(https://x.com/MyTokencap)
community_tg_prefixcommunity_tg_name
(https://t.me/mytokenGroup)