Publication Not All Tokens Are What You Need for Pretraining Yeyun Gong, Xiao Liu, Yelong Shen, Ruochen Xu, Jian Jiao, Nan Duan, Weizhu Chen October 2024
Publication AutoVerus: Automated Proof Generation for Rust Code Chenyuan Yang, Xuheng Li, Md Rakib Hossain Misu, Jianan Yao, Weidong Cui, Yeyun Gong, Chris Hawblitzel, Shuvendu Lahiri, Jay Lorch, Shuai Lu, Fan Yang, Ziqiao Zhou, Shan Lu September 2024 Project
Publication Uncover Nested Data Parallelism and Data Reuse in DNN Computation with FractalTensor Ying Cao, Fan Yang, Mao Yang September 2024
Publication Compositional 3D-aware Video Generation with LLM Director Hanxin Zhu, Tianyu He, Anni Tang, Junliang Guo, Zhibo Chen, Jiang Bian NeurIPS 2024 | August 2024
Publication Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers Zhenting Qi, Mingyuan Ma, Jiahang Xu, Li Lyna Zhang, Fan Yang, Mao Yang Arxiv | August 2024
Publication Scaling Deep Learning Computation over the Inter-Core Connected Intelligence Processor with T10 Yiqi Liu, Yuqi Xue, Yu Cheng, Lingxiao Ma, Ziming Miao, Jilong Xue, Jian Huang SOSP 2024 | August 2024
Publication Uncovering Milestone Papers: A Network Diffusion and Game Theory Approach Wei Zhang, Juyang Cao, Manuel Sebastian Mariani, Zhen-Zhen Wang, Mingyang Zhou, Wei Chen, Hao Liao Journal of Informetrics | August 2024, Vol 18(3)
Publication LordNet: An efficient neural network for learning to solve parametric partial differential equations without simulated data Xinquan Huang, Wenlei Shi, Xiaotian Gao, Xinran wei, Jia Zhang, Jiang Bian, Mao Yang, Tie-Yan Liu Neural Networks | August 2024
Publication Q-Sparse: All Large Language Models can be Fully Sparsely-Activated Hongyu Wang, Shuming Ma, Ruiping Wang, Furu Wei July 2024
Publication Combinatorial Multivariant Multi-Armed Bandits with Applications to Episodic Reinforcement Learning and Beyond Xutong Liu, Siwei Wang, Jinhang Zuo, Han Zhong, Xuchuang Wang, Zhiyong Wang, Shuai Li, Mohammad Hajiesmaili, John C.S. Lui, Wei Chen Proceedings of the 41st International Conference on Machine Learning (ICML) | July 2024