Ling和Ring 2.6技术报告:在万亿参数规模下实现高效且实时的智能代理系统
Ling and Ring 2.6 Technical Report: Efficient and Instant Agentic Intelligence at Trillion-Parameter Scale
摘要
高效且可扩展的智能体系统需要能够同时提供低延迟响应以及强大的推理能力的模型。同时,这些模型还需要在训练、服务部署等方面具有实用性。在本报告中,我们介绍了Ling-2.6和Ring-2.6这两个模型系列。Ling-2.6旨在实现即时响应生成,每个输出token都能表现出较高的能力;而Ring-2.6则适用于更复杂的推理任务,能够处理更高级的智能体工作流程。我们并没有从零开始训练模型,而是通过架构迁移预训练和大规模后训练的方式,对Ling-2.0基础模型进行升级。这种升级是结合模型架构、优化目标、服务系统以及智能体训练环境的协同设计来实现的,从而提升了模型的性能和部署效率。在架构层面,我们采用了混合线性注意力机制,将Lightning Attention与MLA相结合,从而提高了长上下文训练和解码的效率。为了进一步提高token的利用效率,我们通过进化式思维链、语言单元策略优化、双向偏好对齐以及最短正确响应蒸馏等技术,优化了每个输出token的能力。在智能体能力方面,我们提出了KPop框架,该框架旨在支持在大规模基于环境的数据上对Ring-2.6-1T进行稳定训练。KPop通过跨编码、搜索、工具使用以及工作流程执行的异步调度,提高了训练效率,使得从复杂的智能体与环境交互中学习成为可能。总的来说,Ling-2.6和Ring-2.6为构建高效、可扩展且开放的智能体系统提供了实用的方法。我们将2.6系列的所有模型文件以开源形式提供,以支持更多关于智能体系统的研究和开发工作。
English Abstract
Efficient and scalable agentic intelligence requires models that can deliver both low-latency responses and strong reasoning capabilities while remaining practical to train, serve, and deploy. In this report, we present Ling-2.6 and Ring-2.6, a family of models designed to address this challenge at scale. Ling-2.6 is optimized for instant response generation and high capability per output token, whereas Ring-2.6 is tailored for deeper reasoning and more advanced agentic workflows. Instead of training from scratch, we upgrade the Ling-2.0 base model through architectural migration pre-training and large-scale post-training. This upgrade is guided by a unified co-design of model architecture, optimization objectives, serving systems, and agent training environments, enabling improvements in both model capability and deployment efficiency. At the architectural level, we introduce a hybrid linear attention design that integrates Lightning Attention with MLA, improving the efficiency of long-context training and decoding. To further enhance token efficiency, we optimize capability per output token through Evolutionary Chain-of-Thought, Linguistic Unit Policy Optimization, bidirectional preference alignment, and shortest-correct-response distillation. For agentic capabilities, we propose KPop, a reinforcement learning framework designed to support stable training of Ring-2.6-1T on large-scale environment-grounded data. KPop improves training efficiency through asynchronous scheduling across coding, search, tool use, and workflow execution, enabling scalable learning from complex agent-environment interactions. Together, Ling-2.6 and Ring-2.6 provide a practical pathway toward efficient, scalable, and open agentic systems. We open-source all checkpoints in the 2.6 family to support further research and development in practical agentic intelligence.