Paper Detail

Kimi K3: Open Frontier Intelligence

Kimi Team, Tongtong Bai, Yifan Bai, Yiping Bao, M. C., Jianfeng Cai, Xinyuan Cai, Peizhou Cao, Yuxuan Cao, Ziwei Chai, Y. Charles, H. S. Che, Guanduo Chen, Guangyu Chen, Guanzheng Chen, Huarong Chen, Jia Chen, Jianlong Chen, Jun Chen, Kexin Chen, Peng Chen, Ruijue Chen, Wentao Chen, Xin Chen, Yang Chen, Yanru Chen, Yifei Chen, Yingjiang Chen, Yuankun Chen, Yujie Chen, Yutian Chen, Zhirong Chen, Dazhi Cheng, Yean Cheng, Jialei Cui, Jingbing Cui, Anqi Dai, Jiaqi Deng, Hao Ding, Rui Ding, Shaofeng Ding, Mengfan Dong, Mengnan Dong, Yuhao Dong, Yuxin Dong, Angang Du, Chenzhuang Du, Dikang Du, Jusen Du, Yulun Du, Yu Fan, Jing Feng, Qiulin Feng, Yichen Feng, Kelin Fu, Qiang Fu, Fuxuan Gao, Hongcheng Gao, Jingyue Gao, Tong Gao, Weijia Gao, Shangyi Geng, Jie Gong, Linhu Gong, Shengao Gong, Xiaochen Gong, Qizheng Gu, Yicheng Gu, Shuhao Guan, Haiqing Guo, Shiqi Guo, Xiang Guo, Zhengyan Guo, Beixi Hao, Wenxin Hao, Xiaoru Hao, Dailan He, Haotian He, Lehan He, Qi He, Weiran He, Xinran He, Xinyi He, Yibo He, Yunjia He, Chao Hong, Tiange Hong, Hao Hu, Jiaxi Hu, Ruikun Hu, Weiming Hu, Yangyang Hu, Zhenxing Hu, Liang Hua, Jinbin Huang, Ke Huang, Ruiyuan Huang, Siying Huang, Weixiao Huang, Yan Huang, Zhengjie Huang, Zhiqi Huang, Yulong Hui, Chaobo Jia, Yutong Jiang, Zhejun Jiang, Zuoyou Jiang, Wenyi Jin, Xinyi Jin, Yu Jing, Huanjun Kong, Guokun Lai, Aidi Li, Cheng Li, Chengyuan Li, Cong Li, Fang Li, Guanyu Li, Haoyang Li, Jia Li, Junxiong Li, Lei Li, Letian Li, Lincan Li, Weihong Li, Wentao Li, Xintong Li, Yang Li, Yishen Li, Yiwei Li, Yuxiao Li, Zhaowei Li, Zhaoxi Li, Zheming Li, Zhengxiao Li, Zhiyuan Li, Jiawei Lin, Xiaohan Lin, Yibo Lin, Zichao Lin, Ziyan Lin, Bill Liu, Boxiao Liu, Chuan Liu, Liang Liu, Shaowei Liu, Shudong Liu, Shuran Liu, Tianwei Liu, Weizhou Liu, Yangyang Liu, Yanming Liu, Yibo Liu, Yipeng Liu, Zhengying Liu, Zhiheng Liu, Enzhe Lu, Haoyu Lu, Linqiang Lu, Tingzhan Lu, Zhiyuan Lu, Aotian Luo, G. Luo, Junyu Luo, Yifan Luo, B. Lyu, Wenzhou Lyu, Shaoguang Mao, Yuan Mei, Xin Men, Minqing Ni, Yixuan Niu, Siyuan Pan, Shujun Peng, Zhangyang Qi, Ruoyu Qin, ZeChao Qin, Zeyu Qin, Haiquan Qiu, Jianxin Qiu, Jiezhong Qiu, Bowen Qu, Yuhao Qu, Zeyu Shang, Youbo Shao, Han Shen, Jincheng Shi, Juanfeng Shi, Lidong Shi, Shengyuan Shi, Wingchun Siu, Pengwei Song, Xiaoxi Song, Jianlin Su, Yunfeng Su, Zhaochen Su, Lin Sui, Jingsong Sun, Junyao Sun, Shaoning Sun, Shuzhe Sun, Tongyu Sun, Yujun Sun, Yunpeng Tai, Chuning Tang, Heyi Tang, Sirui Tang, Zecheng Tang, Chaoran Tian, Rongpeng Tian, Yu Tian, Wei Tu, Chensi Wang, Chuang Wang, Chunjie Wang, Dinglu Wang, Feng Wang, Hailong Wang, Haiming Wang, Hao Wang, Huaqing Wang, Hui Wang, Jiayi Wang, Jinglong Wang, Jinhong Wang, Jiuzheng Wang, Linian Wang, Shaobo Wang, Shenzhi Wang, Shuyi Wang, Si Wang, Siyuan Wang, Tianfu Wang, Wenjue Wang, Xingran Wang, Xinmei Wang, Xinyuan Wang, Xusheng Wang, Yalin Wang, Yangkun Wang, Yao Wang, Yaoyu Wang, Yejie Wang, Yiqin Wang, Yucheng Wang, Yuzhi Wang, Zhaoji Wang, Zhaowei Wang, Zhengtao Wang, Zhenhao Wang, Zhongsheng Wang, Zifan Wang, Chu Wei, Ming Wei, Shouxin Wei, Zichen Wen, Fan Wu, Haoning Wu, Rucong Wu, Wenhao Wu, Xiaoxue Wu, Yingcong Wu, Yongqi Wu, Yuxin Wu, Zijian Wu, Xinglang Xian, Chenxuan Xiang, Yuye Xiang, Bocheng Xiao, Chenjun Xiao, Xin Xiao, Jin Xie, Xiaotong Xie, Yifeng Xie, Zhe Xie, Bowei Xing, Yiming Xiong, Baosheng Xu, Boyu Xu, Jiale Xu, Jianfan Xu, Jing Xu, Jinjing Xu, L. H. Xu, Qingtao Xu, Shuyao Xu, Suting Xu, Tiantian Xu, Tianxiang Xu, Weixin Xu, Xinran Xu, Yangchuan Xu, Ye Xu, Yueni Xu, Ziyao Xu, Haonan Xue, Junjie Yan, Yaoyao Yan, Fan Yang, Guangyao Yang, Hao Yang, Junwei Yang, Ruoyu Yang, Wenjie Yang, Xiaofei Yang, Xinyu Yang, Yi Yang, Yiling Yang, Ying Yang, Yuchen Yang, Zhen Yang, Zhilin Yang, Zian Yang, Zuhao Yang, Haotian Yao, Dan Ye, Haoran Ye, Wenjie Ye, Zhanbo Ye, Bohong Yin, Haoxiang Yin, Xietong Yin, Chengzhen Yu, Haozhen Yu, Longhui Yu, Shengnan Yu, Shuying Yu, Tianxiang Yu, Enming Yuan, Mengjie Yuan, Tongtian Yue, Wei Yue, Yang Yue, Dunyuan Zha, Haobing Zhan, B. H. Zhang, Dehao Zhang, Fei Zhang, Hao Zhang, Haoyuan Zhang, Huanyu Zhang, Jiapei Zhang, Jiaxuan Zhang, Jin Zhang, Kaiyi Zhang, Miaozhen Zhang, Puqi Zhang, Qinglei Zhang, Rong Zhang, Rui Zhang, Shaoshuai Zhang, Shiyi Zhang, Xiaobin Zhang, Xiaoyun Zhang, Y. Zhang, Yangkun Zhang, Ye Zhang, Yichi Zhang, Yikun Zhang, Yizhi Zhang, Yongting Zhang, Yu Zhang, Yutao Zhang, Yutong Zhang, Zheng Zhang, Zijing Zhang, Bin Zhao, Chenguang Zhao, Feifan Zhao, Jinglun Zhao, Jinxiang Zhao, Shuai Zhao, Wenshuo Zhao, Xiangyu Zhao, Xuanle Zhao, Yikai Zhao, Zijia Zhao, Haozhi Zheng, Huabin Zheng, Ruihan Zheng, Shaojie Zheng, Tengyang Zheng, Haofeng Zhong, Lei Zhong, Longguang Zhong, M. Zhou, Qiankang Zhou, Runjie Zhou, Ruozhang Zhou, Xinyu Zhou, Yiqiao Zhou, Zaida Zhou, Jinguo Zhu, Liya Zhu, Xinhao Zhu, Yangjunfeng Zhu, Yuxuan Zhu, Zhen Zhu, Chen Zhuang, Weiyu Zhuang, Xinxing Zu

arxiv Score 18.3

Published 2026-07-27 · First seen 2026-07-28

General AI

Abstract

We introduce Kimi K3, a 2.8T parameter Mixture-of-Experts model with 104 billion activated parameters, native vision capabilities, and a 1-million-token context window. Kimi K3 is built on Kimi Delta Attention and Attention Residuals, which improve information flow across sequence length and model depth. Together with Stable LatentMoE, which effectively activates 16 of 896 routed experts per token, and refined training and data recipes, these advances yield an approximately 2.5x improvement in overall scaling efficiency over Kimi K2. Post-training highlights reinforcement learning across general, agentic, and coding domains and multiple reasoning-effort levels, enabling compositional generalization and robust long-horizon execution. At 2.8T scale, Kimi K3 is supported by infrastructure advances in multiple areas: algorithm-system co-design for KDA, perfectly balanced expert-parallel training with efficient memory management, million-token agentic RL with persistent rollout and sandbox states, and deployment innovations. Extensive evaluations show that Kimi K3 achieves frontier-level performance across long-horizon coding, agentic, knowledge, reasoning, and vision tasks. While its overall performance still trails the most powerful proprietary models, namely Claude Fable 5 and GPT-5.6 Sol, Kimi K3 consistently outperforms other open and proprietary models evaluated in our suite. We release the full Kimi K3 model weights to facilitate future research and accelerate the broader deployment and adoption of frontier intelligence.

Workflow Status

Review status
pending
Role
unreviewed
Read priority
now
Vote
Not set.
Saved
no
Collections
Not filed yet.
Next action
Not filled yet.

Reading Brief

No structured notes yet. Add `summary_sections`, `why_relevant`, `claim_impact`, or `next_action` in `papers.jsonl` to enrich this view.

Why It Surfaced

No ranking explanation is available yet.

Tags

No tags.

BibTeX

@article{team2026kimi,
  title = {Kimi K3: Open Frontier Intelligence},
  author = {Kimi Team and Tongtong Bai and Yifan Bai and Yiping Bao and M. C. and Jianfeng Cai and Xinyuan Cai and Peizhou Cao and Yuxuan Cao and Ziwei Chai and Y. Charles and H. S. Che and Guanduo Chen and Guangyu Chen and Guanzheng Chen and Huarong Chen and Jia Chen and Jianlong Chen and Jun Chen and Kexin Chen and Peng Chen and Ruijue Chen and Wentao Chen and Xin Chen and Yang Chen and Yanru Chen and Yifei Chen and Yingjiang Chen and Yuankun Chen and Yujie Chen and Yutian Chen and Zhirong Chen and Dazhi Cheng and Yean Cheng and Jialei Cui and Jingbing Cui and Anqi Dai and Jiaqi Deng and Hao Ding and Rui Ding and Shaofeng Ding and Mengfan Dong and Mengnan Dong and Yuhao Dong and Yuxin Dong and Angang Du and Chenzhuang Du and Dikang Du and Jusen Du and Yulun Du and Yu Fan and Jing Feng and Qiulin Feng and Yichen Feng and Kelin Fu and Qiang Fu and Fuxuan Gao and Hongcheng Gao and Jingyue Gao and Tong Gao and Weijia Gao and Shangyi Geng and Jie Gong and Linhu Gong and Shengao Gong and Xiaochen Gong and Qizheng Gu and Yicheng Gu and Shuhao Guan and Haiqing Guo and Shiqi Guo and Xiang Guo and Zhengyan Guo and Beixi Hao and Wenxin Hao and Xiaoru Hao and Dailan He and Haotian He and Lehan He and Qi He and Weiran He and Xinran He and Xinyi He and Yibo He and Yunjia He and Chao Hong and Tiange Hong and Hao Hu and Jiaxi Hu and Ruikun Hu and Weiming Hu and Yangyang Hu and Zhenxing Hu and Liang Hua and Jinbin Huang and Ke Huang and Ruiyuan Huang and Siying Huang and Weixiao Huang and Yan Huang and Zhengjie Huang and Zhiqi Huang and Yulong Hui and Chaobo Jia and Yutong Jiang and Zhejun Jiang and Zuoyou Jiang and Wenyi Jin and Xinyi Jin and Yu Jing and Huanjun Kong and Guokun Lai and Aidi Li and Cheng Li and Chengyuan Li and Cong Li and Fang Li and Guanyu Li and Haoyang Li and Jia Li and Junxiong Li and Lei Li and Letian Li and Lincan Li and Weihong Li and Wentao Li and Xintong Li and Yang Li and Yishen Li and Yiwei Li and Yuxiao Li and Zhaowei Li and Zhaoxi Li and Zheming Li and Zhengxiao Li and Zhiyuan Li and Jiawei Lin and Xiaohan Lin and Yibo Lin and Zichao Lin and Ziyan Lin and Bill Liu and Boxiao Liu and Chuan Liu and Liang Liu and Shaowei Liu and Shudong Liu and Shuran Liu and Tianwei Liu and Weizhou Liu and Yangyang Liu and Yanming Liu and Yibo Liu and Yipeng Liu and Zhengying Liu and Zhiheng Liu and Enzhe Lu and Haoyu Lu and Linqiang Lu and Tingzhan Lu and Zhiyuan Lu and Aotian Luo and G. Luo and Junyu Luo and Yifan Luo and B. Lyu and Wenzhou Lyu and Shaoguang Mao and Yuan Mei and Xin Men and Minqing Ni and Yixuan Niu and Siyuan Pan and Shujun Peng and Zhangyang Qi and Ruoyu Qin and ZeChao Qin and Zeyu Qin and Haiquan Qiu and Jianxin Qiu and Jiezhong Qiu and Bowen Qu and Yuhao Qu and Zeyu Shang and Youbo Shao and Han Shen and Jincheng Shi and Juanfeng Shi and Lidong Shi and Shengyuan Shi and Wingchun Siu and Pengwei Song and Xiaoxi Song and Jianlin Su and Yunfeng Su and Zhaochen Su and Lin Sui and Jingsong Sun and Junyao Sun and Shaoning Sun and Shuzhe Sun and Tongyu Sun and Yujun Sun and Yunpeng Tai and Chuning Tang and Heyi Tang and Sirui Tang and Zecheng Tang and Chaoran Tian and Rongpeng Tian and Yu Tian and Wei Tu and Chensi Wang and Chuang Wang and Chunjie Wang and Dinglu Wang and Feng Wang and Hailong Wang and Haiming Wang and Hao Wang and Huaqing Wang and Hui Wang and Jiayi Wang and Jinglong Wang and Jinhong Wang and Jiuzheng Wang and Linian Wang and Shaobo Wang and Shenzhi Wang and Shuyi Wang and Si Wang and Siyuan Wang and Tianfu Wang and Wenjue Wang and Xingran Wang and Xinmei Wang and Xinyuan Wang and Xusheng Wang and Yalin Wang and Yangkun Wang and Yao Wang and Yaoyu Wang and Yejie Wang and Yiqin Wang and Yucheng Wang and Yuzhi Wang and Zhaoji Wang and Zhaowei Wang and Zhengtao Wang and Zhenhao Wang and Zhongsheng Wang and Zifan Wang and Chu Wei and Ming Wei and Shouxin Wei and Zichen Wen and Fan Wu and Haoning Wu and Rucong Wu and Wenhao Wu and Xiaoxue Wu and Yingcong Wu and Yongqi Wu and Yuxin Wu and Zijian Wu and Xinglang Xian and Chenxuan Xiang and Yuye Xiang and Bocheng Xiao and Chenjun Xiao and Xin Xiao and Jin Xie and Xiaotong Xie and Yifeng Xie and Zhe Xie and Bowei Xing and Yiming Xiong and Baosheng Xu and Boyu Xu and Jiale Xu and Jianfan Xu and Jing Xu and Jinjing Xu and L. H. Xu and Qingtao Xu and Shuyao Xu and Suting Xu and Tiantian Xu and Tianxiang Xu and Weixin Xu and Xinran Xu and Yangchuan Xu and Ye Xu and Yueni Xu and Ziyao Xu and Haonan Xue and Junjie Yan and Yaoyao Yan and Fan Yang and Guangyao Yang and Hao Yang and Junwei Yang and Ruoyu Yang and Wenjie Yang and Xiaofei Yang and Xinyu Yang and Yi Yang and Yiling Yang and Ying Yang and Yuchen Yang and Zhen Yang and Zhilin Yang and Zian Yang and Zuhao Yang and Haotian Yao and Dan Ye and Haoran Ye and Wenjie Ye and Zhanbo Ye and Bohong Yin and Haoxiang Yin and Xietong Yin and Chengzhen Yu and Haozhen Yu and Longhui Yu and Shengnan Yu and Shuying Yu and Tianxiang Yu and Enming Yuan and Mengjie Yuan and Tongtian Yue and Wei Yue and Yang Yue and Dunyuan Zha and Haobing Zhan and B. H. Zhang and Dehao Zhang and Fei Zhang and Hao Zhang and Haoyuan Zhang and Huanyu Zhang and Jiapei Zhang and Jiaxuan Zhang and Jin Zhang and Kaiyi Zhang and Miaozhen Zhang and Puqi Zhang and Qinglei Zhang and Rong Zhang and Rui Zhang and Shaoshuai Zhang and Shiyi Zhang and Xiaobin Zhang and Xiaoyun Zhang and Y. Zhang and Yangkun Zhang and Ye Zhang and Yichi Zhang and Yikun Zhang and Yizhi Zhang and Yongting Zhang and Yu Zhang and Yutao Zhang and Yutong Zhang and Zheng Zhang and Zijing Zhang and Bin Zhao and Chenguang Zhao and Feifan Zhao and Jinglun Zhao and Jinxiang Zhao and Shuai Zhao and Wenshuo Zhao and Xiangyu Zhao and Xuanle Zhao and Yikai Zhao and Zijia Zhao and Haozhi Zheng and Huabin Zheng and Ruihan Zheng and Shaojie Zheng and Tengyang Zheng and Haofeng Zhong and Lei Zhong and Longguang Zhong and M. Zhou and Qiankang Zhou and Runjie Zhou and Ruozhang Zhou and Xinyu Zhou and Yiqiao Zhou and Zaida Zhou and Jinguo Zhu and Liya Zhu and Xinhao Zhu and Yangjunfeng Zhu and Yuxuan Zhu and Zhen Zhu and Chen Zhuang and Weiyu Zhuang and Xinxing Zu},
  year = {2026},
  abstract = {We introduce Kimi K3, a 2.8T parameter Mixture-of-Experts model with 104 billion activated parameters, native vision capabilities, and a 1-million-token context window. Kimi K3 is built on Kimi Delta Attention and Attention Residuals, which improve information flow across sequence length and model depth. Together with Stable LatentMoE, which effectively activates 16 of 896 routed experts per token, and refined training and data recipes, these advances yield an approximately 2.5x improvement in o},
  url = {https://arxiv.org/abs/2607.24653},
  keywords = {cs.CL, cs.LG, code available, huggingface daily},
  eprint = {2607.24653},
  archiveprefix = {arXiv},
}

Metadata

{}