1-bit AI Infra: Part 1.1, Fast and Lossless BitNet b1.58 Inference on CPUs
Jinheng Wang, Hansong Zhou, Ting Song, Shaoguang Mao, Shuming Ma, Hongyu Wang, Yan Xia, Furu Wei
October 2024
Publications
Publications par année
-
Differential Transformer
Tianzhu Ye, Li Dong, Yuqing Xia, Yutao Sun, Yi Zhu, Gao Huang, Furu Wei
MSR-TR-2024-42 | October 2024
Publié par Microsoft
Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
Hongyu Wang, Shuming Ma, Ruiping Wang, Furu Wei
July 2024
Autoregressive Speech Synthesis without Vector Quantization
Lingwei Meng, Long Zhou, Shujie Liu, Sanyuan Chen, Bing Han, Shujie Hu, Yanqing Liu, Jinyu Li, Sheng Zhao, Xixin Wu, Helen Meng, Furu Wei
July 2024
Direct Preference Knowledge Distillation for Large Language Models
Yixing Li, Yuxian Gu, Li Dong, Dequan Wang, Yu Cheng, Furu Wei
June 2024
Instruction Pre-Training: Language Models are Supervised Multitask Learners
Daixuan Cheng, Yuxian Gu, Shaohan Huang, Junyu Bi, Minlie Huang, Furu Wei
June 2024
VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers
Sanyuan Chen, Shujie Liu, Long Zhou, Yanqing Liu, Xu Tan, Jinyu Li, Sheng Zhao, Yao Qian, Furu Wei
June 2024
MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
Ting Jiang, Shaohan Huang, Shengyue Luo, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang, Deqing Wang, Fuzhen Zhuang
May 2024
You Only Cache Once: Decoder-Decoder Architectures for Language Models
Yutao Sun, Li Dong, Yi Zhu, Shaohan Huang, Wenhui Wang, Shuming Ma, Quanlu Zhang, Jianyong Wang, Furu Wei
NeurIPS 2024 | May 2024
Kosmos-G: Generating Images in Context with Multimodal Large Language Models
Xichen Pan, Li Dong, Shaohan Huang, Zhiliang Peng, Wenhu Chen, Furu Wei
ICLR 2024 | May 2024
Multi-Head Mixture-of-Experts
Xun Wu, Shaohan Huang, Wenhui Wang, Furu Wei
NeurIPS 2024 | April 2024
Mind’s Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models
Wenshan Wu, Shaoguang Mao, Yadong Zhang, Yan Xia, Li Dong, Lei Cui, Furu Wei
NeurIPS 2024 | April 2024
LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Models
Yadong Zhang, Shaoguang Mao, Tao Ge, Xun Wang, Adrian de Wynter, Yan Xia, Wenshan Wu, Ting Song, Man Lan, Furu Wei
March 2024
WavLLM: Towards Robust and Adaptive Speech Large Language Model
Shujie Hu, Long Zhou, Shujie Liu, Sanyuan Chen, Hongkun Hao, Jing Pan, Xunying Liu, Jinyu Li, Sunit Sivasankaran, Linquan Liu, Furu Wei
March 2024
MathScale: Scaling Instruction Tuning for Mathematical Reasoning
Zhengyang Tang, Xingxing Zhang, Benyou Wang, Furu Wei
ICML 2024 | March 2024
ResLoRA: Identity Residual Mapping in Low-Rank Adaption
Shuhua Shi, Shaohan Huang, Minghui Song, Zhoujun Li, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
February 2024
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
Shuming Ma, Hongyu Wang, Lingxiao Ma, Lei Wang, Wenhui Wang, Shaohan Huang, Lifeng Dong, Ruiping Wang, Jilong Xue, Furu Wei
February 2024
Work in progress
Towards Optimal Learning of Language Models
Yuxian Gu, Li Dong, Yaru Hao, Qingxiu Dong, Minlie Huang, Furu Wei
February 2024
Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Models
Tianyi Tang, Wenyang Luo, Haoyang Huang, Dongdong Zhang, Xiaolei Wang, Xin Zhao, Furu Wei, Ji-Rong Wen
ACL 2024 | February 2024
Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models
Haoran Li, Qingxiu Dong, Zhengyang Tang, Chaojun Wang, Xingxing Zhang, Haoyang Huang, Shaohan Huang, Xiaolong Huang, Zeqiang Huang, Dongdong Zhang, Yuxian Gu, Xin Cheng, Xun Wang, Si-Qing Chen, Li Dong, Wei Lu, Zhifang Sui, Benyou Wang, Wai Lam, Furu Wei
February 2024
Work in progress
Multilingual E5 Text Embeddings: A Technical Report
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
MSR-TR-2024-45 | February 2024
Publié par Microsoft
Improving Text Embeddings with Large Language Models
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
MSR-TR-2024-2 | January 2024
Publié par Microsoft
-
When an Image is Worth 1,024 x 1,024 Words: A Case Study in Computational Pathology
Wenhui Wang, Shuming Ma, Hanwen Xu, Naoto Usuyama, Jiayu Ding, Hoifung Poon, Furu Wei
December 2023
Large Search Model: Redefining Search Stack in the Era of LLMs
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
SIGIR Forum | December 2023, Vol 57(2)
TextDiffuser-2: Unleashing the Power of Language Models for Text Rendering
Jingye Chen, Yupan Huang, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei
November 2023
BitNet: Scaling 1-bit Transformers for Large Language Models
Hongyu Wang, Shuming Ma, Li Dong, Shaohan Huang, Huaijie Wang, Lingxiao Ma, Fan Yang, Ruiping Wang, Yi Wu, Furu Wei
October 2023
Fine-Tuning LLaMA for Multi-Stage Text Retrieval
Xueguang Ma, Liang Wang, Nan Yang, Furu Wei, Jimmy Lin
October 2023
PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training
Dawei Zhu, Nan Yang, Liang Wang, Yifan Song, Wenhao Wu, Furu Wei, Sujian Li
ICLR 2024 | October 2023
Kosmos-2.5: A Multimodal Literate Model
Tengchao Lv, Yupan Huang, Jingye Chen, Lei Cui, Shuming Ma, Yaoyao Chang, Shaohan Huang, Wenhui Wang, Li Dong, Weiyao Luo, Shaoxiang Wu, Guoxin Wang, Cha Zhang, Furu Wei
September 2023
Retentive Network: A Successor to Transformer for Large Language Models
Yutao Sun, Li Dong, Shaohan Huang, Shuming Ma, Yuqing Xia, Jilong Xue, Jianyong Wang, Furu Wei
August 2023
Generative Retrieval for Conversational Question Answering
Yongqi Li, Nan Yang, Liang Wang, Furu Wei, Wenjie Li
Information Processing and Management | August 2023, Vol 60(5)
Learning to Retrieve In-Context Examples for Large Language Models
Liang Wang, Nan Yang, Furu Wei
EACL 2024 | July 2023
Learning to Rank in Generative Retrieval
Yongqi Li, Nan Yang, Liang Wang, Furu Wei, Wenjie Li
AAAI 2024 | June 2023
Multiview Identifiers Enhanced Generative Retrieval
Yongqi Li, Nan Yang, Liang Wang, Furu Wei, Wenjie Li
ACL 2023 | May 2023
TextDiffuser: Diffusion Models as Text Painters
Jingye Chen, Yupan Huang, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei
NeurIPS 2023 | May 2023
Inference with Reference: Lossless Acceleration of Large Language Models
Nan Yang, Tao Ge, Liang Wang, Binxing Jiao, Daxin Jiang (姜大昕), Linjun Yang, Rangan Majumder, Furu Wei
MSR-TR-2023-17 | April 2023
Publié par Microsoft
Query2doc: Query Expansion with Large Language Models
Liang Wang, Nan Yang, Furu Wei
EMNLP 2023 | March 2023
TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models
Minghao Li, Tengchao Lv, Jingye Chen, Lei Cui, Yijuan Lu, Dinei Florencio, Cha Zhang, Zhoujun Li, Furu Wei
AAAI 2023 | February 2023
-
AdaPrompt: Adaptive Model Training for Prompt-based NLP
Yulong Chen, Yang Liu, Li Dong, Shuohang Wang, Chenguang Zhu, Michael Zeng, Yue Zhang
Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022
Text Embeddings by Weakly-Supervised Contrastive Pre-training
Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang (姜大昕), Rangan Majumder, Furu Wei
December 2022
XDoc: Unified Pre-training for Cross-Format Document Understanding
Jingye Chen, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei
EMNLP 2022 | December 2022
DiT: Self-supervised Pre-training for Document Image Transformer
Junlong Li, Yiheng Xu, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei
ACM Multimedia 2022 | October 2022
LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking
Yupang Huang, Tengchao Lv, Lei Cui, Yutong Lu, Furu Wei
ACM Multimedia 2022 | October 2022
Learning Diverse Document Representations with Deep Query Interactions for Dense Retrieval
Zehan Li, Nan Yang, Liang Wang, Furu Wei
August 2022
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Xiangzhan Yu, Furu Wei
IEEE Journal of Selected Topics in Signal Processing | July 2022, Vol 16(6): pp. 1505-1518
SimLM: Pre-training with Representation Bottleneck for Dense Passage Retrieval
Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang (姜大昕), Rangan Majumder, Furu Wei
ACL 2023 | July 2022
MarkupLM: Pre-training of Text and Markup Language for Visually-rich Document Understanding
Junlong Li, Yiheng Xu, Lei Cui, Furu Wei
ACL 2022 | May 2022
XFUND: A Benchmark Dataset for Multilingual Visually Rich Form Understanding
Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Furu Wei
ACL 2022 | May 2022
-
Document AI: Benchmarks, Models and Applications
Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei
November 2021
LayoutReader: Pre-training of Text and Layout for Reading Order Detection
Zilong Wang, Yiheng Xu, Lei Cui, Jingbo Shang, Furu Wei
EMNLP 2021 | November 2021
Document AI: Benchmarks, Models and Applications (Presentation@ICDAR 2021)
September 2021
September 2021
DIL workshop in ICDAR 2021
Ultra Fast Speech Separation Model with Teacher Student Learning
Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
Interspeech 2021 | August 2021
Document AI: Benchmarks, Models and Applications (In Chinese)
Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei
CCL 2021 | August 2021
Consistency Regularization for Cross-Lingual Fine-Tuning
Bo Zheng, Li Dong, Shaohan Huang, Wenhui Wang, Zewen Chi, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei
ACL-IJCNLP 2021 | June 2021
Continuous speech separation with Conformer
Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Jinyu Li, Takuya Yoshioka, Chengyi Wang, Shujie Liu, Ming Zhou
ICASSP | June 2021
Don’t shoot butterfly with rifles: multi-channel continuous speech separation with early exit transformer
Sanyuan Chen, Yu Wu, Zhuo Chen, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
ICASSP | June 2021
VT-SSum: A Benchmark Dataset for Video Transcript Segmentation and Summarization
Tengchao Lv, Lei Cui, Momcilo Vasilijevic, Furu Wei
June 2021
How Does Distilled Data Complexity Impact the Quality and Confidence of Non-Autoregressive Machine Translation?
Weijia Xu, Shuming Ma, Dongdong Zhang, Marine Carpuat
ACL-IJCNLP 2021 | May 2021
LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding
Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Furu Wei
April 2021
LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding
Yang Xu, Yiheng Xu, Tengchao Lv, Lei Cui, Furu Wei, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Wanxiang Che, Min Zhang, Lidong Zhou
ACL-IJCNLP 2021 | January 2021
-
DocBank: A Benchmark Dataset for Document Layout Analysis
Minghao Li, Yiheng Xu, Lei Cui, Shaohan Huang, Furu Wei, Zhoujun Li, Ming Zhou
COLING 2020 | December 2020
LayoutLM: Pre-training of Text and Layout for Document Image Understanding
Yiheng Xu, Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou
KDD 2020 | August 2020
Multimodal Matching Transformer for Live Commenting
Chaoqun Duan, Lei Cui, Shuming Ma, Furu Wei, Conghui Zhu, Tiejun Zhao
ECAI 2020 | July 2020
TableBank: Table Benchmark for Image-based Table Detection and Recognition
Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou, Zhoujun Li
LREC 2020 | May 2020
Self-Adversarial Learning with Comparative Discrimination for Text Generation
Wangchunshu Zhou, Tao Ge, Ke Xu, Furu Wei, Ming Zhou
Eighth International Conference on Learning Representations (ICLR) | April 2020
-
Neural Melody Composition from Lyrics
Hangbo Bao, Shaohan Huang, Furu Wei, Lei Cui, Yu Wu, Chuanqi Tan, Songhao Piao, Ming Zhou
NLPCC 2019 | September 2019
Order-Sensitive Keywords Based Response Generation in Open-Domain Conversational Systems
Qingfu Zhu, Weinan Zhang, Lei Cui, Ting Liu
ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) | August 2019
LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts
Shuming Ma, Lei Cui, Damai Dai, Furu Wei, Xu Sun
AAAI 2019 | July 2019
Retrieval-Enhanced Adversarial Training for Neural Response Generation
Qingfu Zhu, Lei Cui, Wei-Nan Zhang, Furu Wei, Ting Liu
ACL 2019 | July 2019
-
Fine-grained Coordinated Cross-lingual Text Stream Alignment for Endless Language Knowledge Acquisition
Tao Ge, Qing Dou, Heng Ji, Lei Cui, Baobao Chang, Zhifang Sui, Furu Wei, Ming Zhou
EMNLP 2018 | November 2018
SeRI: A Dataset for Sub-event Relation Inference from an Encyclopedia
Tao Ge, Lei Cui, Baobao Chang, Zhifang Sui, Furu Wei, Ming Zhou
NLPCC 2018 | August 2018
Neural Open Information Extraction
ACL 2018 | July 2018
Attention-Fused Deep Matching Network for Natural Language Inference
Chaoqun Duan, Lei Cui, Xinchi Chen, Furu Wei, Conghui Zhu, Tiejun Zhao
IJCAI 2018 | July 2018
EventWiki: A Knowledge Base of Major Events
Tao Ge, Lei Cui, Baobao Chang, Zhifang Sui, Furu Wei, Ming Zhou
LREC 2018 | May 2018
Hierarchical Recurrent Attention Network for Response Generation
Wei Wu, Chen Xing, Yu Wu, Ming Zhou, Yalou Huang, Wei-Ying Ma
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI’18) | February 2018
Knowledge Enhanced Hybrid Neural Network for Text Matching
Wei Wu, Yu Wu, Can Xu, Zhoujun Li
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI’18) | February 2018
Neural Response Generation with Dynamic Vocabularies
Wei Wu (wuwei), Yu Wu, Dejian Yang, Can Xu, Zhoujun Li
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI’18) | February 2018
-
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots
Yu Wu, Wei Wu, Chen Xing, Zhoujun Li, Ming Zhou
55th Annual Meeting of the Association for Computational Linguistics (ACL’17) | August 2017
SuperAgent: A Customer Service Chatbot for E-commerce Websites
Lei Cui, Furu Wei, Shaohan Huang, Chuanqi Tan, Chaoqun Duan, Ming Zhou
ACL 2017 | July 2017
R-NET: Machine Reading Comprehension with Self-matching Networks
Natural Language Computing Group
May 2017
Topic Aware Neural Response Generation
Chen Xing, Wei Wu, Yu Wu, Jie Liu, Yalou Huang, Ming Zhou, Wei-Ying Ma
Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence (AAAI’17) | February 2017
-
Detecting Context Dependent Messages in a Conversational Environment
Chaozhuo Li, Yu Wu, Wei Wu, Chen Xing, Zhoujun Li, Ming Zhou, Wei Wu
Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers | December 2016
Event Detection with Burst Information Networks
Tao Ge, Lei Cui, Baobao Chang, Zhifang Sui, Ming Zhou
COLING 2016 | December 2016
Discovering Concept-Level Event Associations from a Text Stream
Tao Ge, Lei Cui, Heng Ji, Baobao Chang, Zhifang Sui
NLPCC 2016 | December 2016
News Stream Summarization using Burst Information Networks
Tao Ge, Lei Cui, Baobao Chang, Sujian Li, Ming Zhou, Zhifang Sui
EMNLP 2016 | November 2016
Improving Recommendation of Tail Tags for Questions in Community Question Answering
Yu Wu, Wei Wu, Xiang Zhang, Zhoujun Li, Ming Zhou, Wei Wu, Ming Zhou
Thirtieth AAAI Conference on Artificial Intelligence (AAAI’16) | March 2016
Learning Distributed Representations of Data in Community Question Answering for Question Retrieval
Kai Zhang, Wei Wu, Fang Wang, Ming Zhou, Zhoujun Li, Wei Wu, Ming Zhou
Proceedings of the Ninth ACM International Conference on Web Search and Data Mining (WSDM’16) | February 2016
-
Mining Query Subtopics from Questions in Community Question Answering.
Yu Wu, Wei Wu, Zhoujun Li, Ming Zhou, Wei Wu, Ming Zhou
AAAI’15 | January 2015
-
Question retrieval with high quality answers in community question answering
Kai Zhang, Wei Wu, Haocheng Wu, Zhoujun Li, Ming Zhou, Wei Wu, Ming Zhou
Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management (CIKM’14) | November 2014
Machine Translation with Real-Time Web Search
Lei Cui, Ming Zhou, Qiming Chen, Dongdong Zhang, Mu Li
AAAI 2014 | July 2014
Improving search relevance for short queries in community question answering
Haocheng Wu, Wei Wu, Ming Zhou, Enhong Chen, Lei Duan, Heung-Yeung Shum, Wei Wu
Proceedings of the 7th ACM international conference on Web search and data mining (WSDM’14) | February 2014
Filtre par zone de recherche
-
1-bit AI Infra: Part 1.1, Fast and Lossless BitNet b1.58 Inference on CPUs
Jinheng Wang, Hansong Zhou, Ting Song, Shaoguang Mao, Shuming Ma, Hongyu Wang, Yan Xia, Furu Wei
October 2024
Differential Transformer
Tianzhu Ye, Li Dong, Yuqing Xia, Yutao Sun, Yi Zhu, Gao Huang, Furu Wei
MSR-TR-2024-42 | October 2024
Publié par Microsoft
Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
Hongyu Wang, Shuming Ma, Ruiping Wang, Furu Wei
July 2024
Autoregressive Speech Synthesis without Vector Quantization
Lingwei Meng, Long Zhou, Shujie Liu, Sanyuan Chen, Bing Han, Shujie Hu, Yanqing Liu, Jinyu Li, Sheng Zhao, Xixin Wu, Helen Meng, Furu Wei
July 2024
Direct Preference Knowledge Distillation for Large Language Models
Yixing Li, Yuxian Gu, Li Dong, Dequan Wang, Yu Cheng, Furu Wei
June 2024
Instruction Pre-Training: Language Models are Supervised Multitask Learners
Daixuan Cheng, Yuxian Gu, Shaohan Huang, Junyu Bi, Minlie Huang, Furu Wei
June 2024
VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers
Sanyuan Chen, Shujie Liu, Long Zhou, Yanqing Liu, Xu Tan, Jinyu Li, Sheng Zhao, Yao Qian, Furu Wei
June 2024
MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
Ting Jiang, Shaohan Huang, Shengyue Luo, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang, Deqing Wang, Fuzhen Zhuang
May 2024
You Only Cache Once: Decoder-Decoder Architectures for Language Models
Yutao Sun, Li Dong, Yi Zhu, Shaohan Huang, Wenhui Wang, Shuming Ma, Quanlu Zhang, Jianyong Wang, Furu Wei
NeurIPS 2024 | May 2024
Kosmos-G: Generating Images in Context with Multimodal Large Language Models
Xichen Pan, Li Dong, Shaohan Huang, Zhiliang Peng, Wenhu Chen, Furu Wei
ICLR 2024 | May 2024
Multi-Head Mixture-of-Experts
Xun Wu, Shaohan Huang, Wenhui Wang, Furu Wei
NeurIPS 2024 | April 2024
Mind’s Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models
Wenshan Wu, Shaoguang Mao, Yadong Zhang, Yan Xia, Li Dong, Lei Cui, Furu Wei
NeurIPS 2024 | April 2024
LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Models
Yadong Zhang, Shaoguang Mao, Tao Ge, Xun Wang, Adrian de Wynter, Yan Xia, Wenshan Wu, Ting Song, Man Lan, Furu Wei
March 2024
WavLLM: Towards Robust and Adaptive Speech Large Language Model
Shujie Hu, Long Zhou, Shujie Liu, Sanyuan Chen, Hongkun Hao, Jing Pan, Xunying Liu, Jinyu Li, Sunit Sivasankaran, Linquan Liu, Furu Wei
March 2024
MathScale: Scaling Instruction Tuning for Mathematical Reasoning
Zhengyang Tang, Xingxing Zhang, Benyou Wang, Furu Wei
ICML 2024 | March 2024
ResLoRA: Identity Residual Mapping in Low-Rank Adaption
Shuhua Shi, Shaohan Huang, Minghui Song, Zhoujun Li, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
February 2024
Towards Optimal Learning of Language Models
Yuxian Gu, Li Dong, Yaru Hao, Qingxiu Dong, Minlie Huang, Furu Wei
February 2024
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
Shuming Ma, Hongyu Wang, Lingxiao Ma, Lei Wang, Wenhui Wang, Shaohan Huang, Lifeng Dong, Ruiping Wang, Jilong Xue, Furu Wei
February 2024
Work in progress
Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Models
Tianyi Tang, Wenyang Luo, Haoyang Huang, Dongdong Zhang, Xiaolei Wang, Xin Zhao, Furu Wei, Ji-Rong Wen
ACL 2024 | February 2024
Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models
Haoran Li, Qingxiu Dong, Zhengyang Tang, Chaojun Wang, Xingxing Zhang, Haoyang Huang, Shaohan Huang, Xiaolong Huang, Zeqiang Huang, Dongdong Zhang, Yuxian Gu, Xin Cheng, Xun Wang, Si-Qing Chen, Li Dong, Wei Lu, Zhifang Sui, Benyou Wang, Wai Lam, Furu Wei
February 2024
Work in progress
Multilingual E5 Text Embeddings: A Technical Report
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
MSR-TR-2024-45 | February 2024
Publié par Microsoft
When an Image is Worth 1,024 x 1,024 Words: A Case Study in Computational Pathology
Wenhui Wang, Shuming Ma, Hanwen Xu, Naoto Usuyama, Jiayu Ding, Hoifung Poon, Furu Wei
December 2023
BitNet: Scaling 1-bit Transformers for Large Language Models
Hongyu Wang, Shuming Ma, Li Dong, Shaohan Huang, Huaijie Wang, Lingxiao Ma, Fan Yang, Ruiping Wang, Yi Wu, Furu Wei
October 2023
Kosmos-2.5: A Multimodal Literate Model
Tengchao Lv, Yupan Huang, Jingye Chen, Lei Cui, Shuming Ma, Yaoyao Chang, Shaohan Huang, Wenhui Wang, Li Dong, Weiyao Luo, Shaoxiang Wu, Guoxin Wang, Cha Zhang, Furu Wei
September 2023
Retentive Network: A Successor to Transformer for Large Language Models
Yutao Sun, Li Dong, Shaohan Huang, Shuming Ma, Yuqing Xia, Jilong Xue, Jianyong Wang, Furu Wei
August 2023
TextDiffuser: Diffusion Models as Text Painters
Jingye Chen, Yupan Huang, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei
NeurIPS 2023 | May 2023
TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models
Minghao Li, Tengchao Lv, Jingye Chen, Lei Cui, Yijuan Lu, Dinei Florencio, Cha Zhang, Zhoujun Li, Furu Wei
AAAI 2023 | February 2023
XDoc: Unified Pre-training for Cross-Format Document Understanding
Jingye Chen, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei
EMNLP 2022 | December 2022
LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking
Yupang Huang, Tengchao Lv, Lei Cui, Yutong Lu, Furu Wei
ACM Multimedia 2022 | October 2022
DiT: Self-supervised Pre-training for Document Image Transformer
Junlong Li, Yiheng Xu, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei
ACM Multimedia 2022 | October 2022
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Xiangzhan Yu, Furu Wei
IEEE Journal of Selected Topics in Signal Processing | July 2022, Vol 16(6): pp. 1505-1518
MarkupLM: Pre-training of Text and Markup Language for Visually-rich Document Understanding
Junlong Li, Yiheng Xu, Lei Cui, Furu Wei
ACL 2022 | May 2022
Document AI: Benchmarks, Models and Applications
Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei
November 2021
LayoutReader: Pre-training of Text and Layout for Reading Order Detection
Zilong Wang, Yiheng Xu, Lei Cui, Jingbo Shang, Furu Wei
EMNLP 2021 | November 2021
Document AI: Benchmarks, Models and Applications (Presentation@ICDAR 2021)
September 2021
September 2021
DIL workshop in ICDAR 2021
Document AI: Benchmarks, Models and Applications (In Chinese)
Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei
CCL 2021 | August 2021
Consistency Regularization for Cross-Lingual Fine-Tuning
Bo Zheng, Li Dong, Shaohan Huang, Wenhui Wang, Zewen Chi, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei
ACL-IJCNLP 2021 | June 2021
VT-SSum: A Benchmark Dataset for Video Transcript Segmentation and Summarization
Tengchao Lv, Lei Cui, Momcilo Vasilijevic, Furu Wei
June 2021
How Does Distilled Data Complexity Impact the Quality and Confidence of Non-Autoregressive Machine Translation?
Weijia Xu, Shuming Ma, Dongdong Zhang, Marine Carpuat
ACL-IJCNLP 2021 | May 2021
LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding
Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Furu Wei
April 2021
DocBank: A Benchmark Dataset for Document Layout Analysis
Minghao Li, Yiheng Xu, Lei Cui, Shaohan Huang, Furu Wei, Zhoujun Li, Ming Zhou
COLING 2020 | December 2020
LayoutLM: Pre-training of Text and Layout for Document Image Understanding
Yiheng Xu, Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou
KDD 2020 | August 2020
Multimodal Matching Transformer for Live Commenting
Chaoqun Duan, Lei Cui, Shuming Ma, Furu Wei, Conghui Zhu, Tiejun Zhao
ECAI 2020 | July 2020
TableBank: Table Benchmark for Image-based Table Detection and Recognition
Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou, Zhoujun Li
LREC 2020 | May 2020
Neural Melody Composition from Lyrics
Hangbo Bao, Shaohan Huang, Furu Wei, Lei Cui, Yu Wu, Chuanqi Tan, Songhao Piao, Ming Zhou
NLPCC 2019 | September 2019
Order-Sensitive Keywords Based Response Generation in Open-Domain Conversational Systems
Qingfu Zhu, Weinan Zhang, Lei Cui, Ting Liu
ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) | August 2019
LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts
Shuming Ma, Lei Cui, Damai Dai, Furu Wei, Xu Sun
AAAI 2019 | July 2019
Retrieval-Enhanced Adversarial Training for Neural Response Generation
Qingfu Zhu, Lei Cui, Wei-Nan Zhang, Furu Wei, Ting Liu
ACL 2019 | July 2019
SeRI: A Dataset for Sub-event Relation Inference from an Encyclopedia
Tao Ge, Lei Cui, Baobao Chang, Zhifang Sui, Furu Wei, Ming Zhou
NLPCC 2018 | August 2018
Hierarchical Recurrent Attention Network for Response Generation
Wei Wu, Chen Xing, Yu Wu, Ming Zhou, Yalou Huang, Wei-Ying Ma
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI’18) | February 2018
Knowledge Enhanced Hybrid Neural Network for Text Matching
Wei Wu, Yu Wu, Can Xu, Zhoujun Li
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI’18) | February 2018
Neural Response Generation with Dynamic Vocabularies
Wei Wu (wuwei), Yu Wu, Dejian Yang, Can Xu, Zhoujun Li
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI’18) | February 2018
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots
Yu Wu, Wei Wu, Chen Xing, Zhoujun Li, Ming Zhou
55th Annual Meeting of the Association for Computational Linguistics (ACL’17) | August 2017
SuperAgent: A Customer Service Chatbot for E-commerce Websites
Lei Cui, Furu Wei, Shaohan Huang, Chuanqi Tan, Chaoqun Duan, Ming Zhou
ACL 2017 | July 2017
R-NET: Machine Reading Comprehension with Self-matching Networks
Natural Language Computing Group
May 2017
Topic Aware Neural Response Generation
Chen Xing, Wei Wu, Yu Wu, Jie Liu, Yalou Huang, Ming Zhou, Wei-Ying Ma
Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence (AAAI’17) | February 2017
Detecting Context Dependent Messages in a Conversational Environment
Chaozhuo Li, Yu Wu, Wei Wu, Chen Xing, Zhoujun Li, Ming Zhou, Wei Wu
Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers | December 2016
Improving Recommendation of Tail Tags for Questions in Community Question Answering
Yu Wu, Wei Wu, Xiang Zhang, Zhoujun Li, Ming Zhou, Wei Wu, Ming Zhou
Thirtieth AAAI Conference on Artificial Intelligence (AAAI’16) | March 2016
Mining Query Subtopics from Questions in Community Question Answering.
Yu Wu, Wei Wu, Zhoujun Li, Ming Zhou, Wei Wu, Ming Zhou
AAAI’15 | January 2015
-
When an Image is Worth 1,024 x 1,024 Words: A Case Study in Computational Pathology
Wenhui Wang, Shuming Ma, Hanwen Xu, Naoto Usuyama, Jiayu Ding, Hoifung Poon, Furu Wei
December 2023
-
Autoregressive Speech Synthesis without Vector Quantization
Lingwei Meng, Long Zhou, Shujie Liu, Sanyuan Chen, Bing Han, Shujie Hu, Yanqing Liu, Jinyu Li, Sheng Zhao, Xixin Wu, Helen Meng, Furu Wei
July 2024
VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers
Sanyuan Chen, Shujie Liu, Long Zhou, Yanqing Liu, Xu Tan, Jinyu Li, Sheng Zhao, Yao Qian, Furu Wei
June 2024
WavLLM: Towards Robust and Adaptive Speech Large Language Model
Shujie Hu, Long Zhou, Shujie Liu, Sanyuan Chen, Hongkun Hao, Jing Pan, Xunying Liu, Jinyu Li, Sunit Sivasankaran, Linquan Liu, Furu Wei
March 2024
-
MathScale: Scaling Instruction Tuning for Mathematical Reasoning
Zhengyang Tang, Xingxing Zhang, Benyou Wang, Furu Wei
ICML 2024 | March 2024
-
Improving Text Embeddings with Large Language Models
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
MSR-TR-2024-2 | January 2024
Publié par Microsoft
Large Search Model: Redefining Search Stack in the Era of LLMs
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
SIGIR Forum | December 2023, Vol 57(2)
TextDiffuser-2: Unleashing the Power of Language Models for Text Rendering
Jingye Chen, Yupan Huang, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei
November 2023
Fine-Tuning LLaMA for Multi-Stage Text Retrieval
Xueguang Ma, Liang Wang, Nan Yang, Furu Wei, Jimmy Lin
October 2023
PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training
Dawei Zhu, Nan Yang, Liang Wang, Yifan Song, Wenhao Wu, Furu Wei, Sujian Li
ICLR 2024 | October 2023
Kosmos-2.5: A Multimodal Literate Model
Tengchao Lv, Yupan Huang, Jingye Chen, Lei Cui, Shuming Ma, Yaoyao Chang, Shaohan Huang, Wenhui Wang, Li Dong, Weiyao Luo, Shaoxiang Wu, Guoxin Wang, Cha Zhang, Furu Wei
September 2023
Generative Retrieval for Conversational Question Answering
Yongqi Li, Nan Yang, Liang Wang, Furu Wei, Wenjie Li
Information Processing and Management | August 2023, Vol 60(5)
Learning to Retrieve In-Context Examples for Large Language Models
Liang Wang, Nan Yang, Furu Wei
EACL 2024 | July 2023
Learning to Rank in Generative Retrieval
Yongqi Li, Nan Yang, Liang Wang, Furu Wei, Wenjie Li
AAAI 2024 | June 2023
TextDiffuser: Diffusion Models as Text Painters
Jingye Chen, Yupan Huang, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei
NeurIPS 2023 | May 2023
Multiview Identifiers Enhanced Generative Retrieval
Yongqi Li, Nan Yang, Liang Wang, Furu Wei, Wenjie Li
ACL 2023 | May 2023
Inference with Reference: Lossless Acceleration of Large Language Models
Nan Yang, Tao Ge, Liang Wang, Binxing Jiao, Daxin Jiang (姜大昕), Linjun Yang, Rangan Majumder, Furu Wei
MSR-TR-2023-17 | April 2023
Publié par Microsoft
Query2doc: Query Expansion with Large Language Models
Liang Wang, Nan Yang, Furu Wei
EMNLP 2023 | March 2023
TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models
Minghao Li, Tengchao Lv, Jingye Chen, Lei Cui, Yijuan Lu, Dinei Florencio, Cha Zhang, Zhoujun Li, Furu Wei
AAAI 2023 | February 2023
Text Embeddings by Weakly-Supervised Contrastive Pre-training
Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang (姜大昕), Rangan Majumder, Furu Wei
December 2022
XDoc: Unified Pre-training for Cross-Format Document Understanding
Jingye Chen, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei
EMNLP 2022 | December 2022
AdaPrompt: Adaptive Model Training for Prompt-based NLP
Yulong Chen, Yang Liu, Li Dong, Shuohang Wang, Chenguang Zhu, Michael Zeng, Yue Zhang
Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022
LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking
Yupang Huang, Tengchao Lv, Lei Cui, Yutong Lu, Furu Wei
ACM Multimedia 2022 | October 2022
Learning Diverse Document Representations with Deep Query Interactions for Dense Retrieval
Zehan Li, Nan Yang, Liang Wang, Furu Wei
August 2022
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Xiangzhan Yu, Furu Wei
IEEE Journal of Selected Topics in Signal Processing | July 2022, Vol 16(6): pp. 1505-1518
SimLM: Pre-training with Representation Bottleneck for Dense Passage Retrieval
Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang (姜大昕), Rangan Majumder, Furu Wei
ACL 2023 | July 2022
XFUND: A Benchmark Dataset for Multilingual Visually Rich Form Understanding
Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Furu Wei
ACL 2022 | May 2022
MarkupLM: Pre-training of Text and Markup Language for Visually-rich Document Understanding
Junlong Li, Yiheng Xu, Lei Cui, Furu Wei
ACL 2022 | May 2022
Document AI: Benchmarks, Models and Applications
Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei
November 2021
LayoutReader: Pre-training of Text and Layout for Reading Order Detection
Zilong Wang, Yiheng Xu, Lei Cui, Jingbo Shang, Furu Wei
EMNLP 2021 | November 2021
Document AI: Benchmarks, Models and Applications (Presentation@ICDAR 2021)
September 2021
September 2021
DIL workshop in ICDAR 2021
Ultra Fast Speech Separation Model with Teacher Student Learning
Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
Interspeech 2021 | August 2021
Document AI: Benchmarks, Models and Applications (In Chinese)
Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei
CCL 2021 | August 2021
VT-SSum: A Benchmark Dataset for Video Transcript Segmentation and Summarization
Tengchao Lv, Lei Cui, Momcilo Vasilijevic, Furu Wei
June 2021
Continuous speech separation with Conformer
Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Jinyu Li, Takuya Yoshioka, Chengyi Wang, Shujie Liu, Ming Zhou
ICASSP | June 2021
Don’t shoot butterfly with rifles: multi-channel continuous speech separation with early exit transformer
Sanyuan Chen, Yu Wu, Zhuo Chen, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
ICASSP | June 2021
How Does Distilled Data Complexity Impact the Quality and Confidence of Non-Autoregressive Machine Translation?
Weijia Xu, Shuming Ma, Dongdong Zhang, Marine Carpuat
ACL-IJCNLP 2021 | May 2021
LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding
Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Furu Wei
April 2021
LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding
Yang Xu, Yiheng Xu, Tengchao Lv, Lei Cui, Furu Wei, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Wanxiang Che, Min Zhang, Lidong Zhou
ACL-IJCNLP 2021 | January 2021
DocBank: A Benchmark Dataset for Document Layout Analysis
Minghao Li, Yiheng Xu, Lei Cui, Shaohan Huang, Furu Wei, Zhoujun Li, Ming Zhou
COLING 2020 | December 2020
LayoutLM: Pre-training of Text and Layout for Document Image Understanding
Yiheng Xu, Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou
KDD 2020 | August 2020
Multimodal Matching Transformer for Live Commenting
Chaoqun Duan, Lei Cui, Shuming Ma, Furu Wei, Conghui Zhu, Tiejun Zhao
ECAI 2020 | July 2020
TableBank: Table Benchmark for Image-based Table Detection and Recognition
Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou, Zhoujun Li
LREC 2020 | May 2020
Self-Adversarial Learning with Comparative Discrimination for Text Generation
Wangchunshu Zhou, Tao Ge, Ke Xu, Furu Wei, Ming Zhou
Eighth International Conference on Learning Representations (ICLR) | April 2020
Neural Melody Composition from Lyrics
Hangbo Bao, Shaohan Huang, Furu Wei, Lei Cui, Yu Wu, Chuanqi Tan, Songhao Piao, Ming Zhou
NLPCC 2019 | September 2019
Order-Sensitive Keywords Based Response Generation in Open-Domain Conversational Systems
Qingfu Zhu, Weinan Zhang, Lei Cui, Ting Liu
ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) | August 2019
LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts
Shuming Ma, Lei Cui, Damai Dai, Furu Wei, Xu Sun
AAAI 2019 | July 2019
Retrieval-Enhanced Adversarial Training for Neural Response Generation
Qingfu Zhu, Lei Cui, Wei-Nan Zhang, Furu Wei, Ting Liu
ACL 2019 | July 2019
Fine-grained Coordinated Cross-lingual Text Stream Alignment for Endless Language Knowledge Acquisition
Tao Ge, Qing Dou, Heng Ji, Lei Cui, Baobao Chang, Zhifang Sui, Furu Wei, Ming Zhou
EMNLP 2018 | November 2018
SeRI: A Dataset for Sub-event Relation Inference from an Encyclopedia
Tao Ge, Lei Cui, Baobao Chang, Zhifang Sui, Furu Wei, Ming Zhou
NLPCC 2018 | August 2018
Neural Open Information Extraction
ACL 2018 | July 2018
Attention-Fused Deep Matching Network for Natural Language Inference
Chaoqun Duan, Lei Cui, Xinchi Chen, Furu Wei, Conghui Zhu, Tiejun Zhao
IJCAI 2018 | July 2018
EventWiki: A Knowledge Base of Major Events
Tao Ge, Lei Cui, Baobao Chang, Zhifang Sui, Furu Wei, Ming Zhou
LREC 2018 | May 2018
SuperAgent: A Customer Service Chatbot for E-commerce Websites
Lei Cui, Furu Wei, Shaohan Huang, Chuanqi Tan, Chaoqun Duan, Ming Zhou
ACL 2017 | July 2017
Event Detection with Burst Information Networks
Tao Ge, Lei Cui, Baobao Chang, Zhifang Sui, Ming Zhou
COLING 2016 | December 2016
Discovering Concept-Level Event Associations from a Text Stream
Tao Ge, Lei Cui, Heng Ji, Baobao Chang, Zhifang Sui
NLPCC 2016 | December 2016
News Stream Summarization using Burst Information Networks
Tao Ge, Lei Cui, Baobao Chang, Sujian Li, Ming Zhou, Zhifang Sui
EMNLP 2016 | November 2016
Learning Distributed Representations of Data in Community Question Answering for Question Retrieval
Kai Zhang, Wei Wu, Fang Wang, Ming Zhou, Zhoujun Li, Wei Wu, Ming Zhou
Proceedings of the Ninth ACM International Conference on Web Search and Data Mining (WSDM’16) | February 2016
Question retrieval with high quality answers in community question answering
Kai Zhang, Wei Wu, Haocheng Wu, Zhoujun Li, Ming Zhou, Wei Wu, Ming Zhou
Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management (CIKM’14) | November 2014
Machine Translation with Real-Time Web Search
Lei Cui, Ming Zhou, Qiming Chen, Dongdong Zhang, Mu Li
AAAI 2014 | July 2014
Improving search relevance for short queries in community question answering
Haocheng Wu, Wei Wu, Ming Zhou, Enhong Chen, Lei Duan, Heung-Yeung Shum, Wei Wu
Proceedings of the 7th ACM international conference on Web search and data mining (WSDM’14) | February 2014
-
Improving Text Embeddings with Large Language Models
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
MSR-TR-2024-2 | January 2024
Publié par Microsoft
Large Search Model: Redefining Search Stack in the Era of LLMs
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
SIGIR Forum | December 2023, Vol 57(2)
Fine-Tuning LLaMA for Multi-Stage Text Retrieval
Xueguang Ma, Liang Wang, Nan Yang, Furu Wei, Jimmy Lin
October 2023
Text Embeddings by Weakly-Supervised Contrastive Pre-training
Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang (姜大昕), Rangan Majumder, Furu Wei
December 2022
SuperAgent: A Customer Service Chatbot for E-commerce Websites
Lei Cui, Furu Wei, Shaohan Huang, Chuanqi Tan, Chaoqun Duan, Ming Zhou
ACL 2017 | July 2017
Learning Distributed Representations of Data in Community Question Answering for Question Retrieval
Kai Zhang, Wei Wu, Fang Wang, Ming Zhou, Zhoujun Li, Wei Wu, Ming Zhou
Proceedings of the Ninth ACM International Conference on Web Search and Data Mining (WSDM’16) | February 2016
Question retrieval with high quality answers in community question answering
Kai Zhang, Wei Wu, Haocheng Wu, Zhoujun Li, Ming Zhou, Wei Wu, Ming Zhou
Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management (CIKM’14) | November 2014
Improving search relevance for short queries in community question answering
Haocheng Wu, Wei Wu, Ming Zhou, Enhong Chen, Lei Duan, Heung-Yeung Shum, Wei Wu
Proceedings of the 7th ACM international conference on Web search and data mining (WSDM’14) | February 2014
-
TextDiffuser-2: Unleashing the Power of Language Models for Text Rendering
Jingye Chen, Yupan Huang, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei
November 2023
Kosmos-2.5: A Multimodal Literate Model
Tengchao Lv, Yupan Huang, Jingye Chen, Lei Cui, Shuming Ma, Yaoyao Chang, Shaohan Huang, Wenhui Wang, Li Dong, Weiyao Luo, Shaoxiang Wu, Guoxin Wang, Cha Zhang, Furu Wei
September 2023
TextDiffuser: Diffusion Models as Text Painters
Jingye Chen, Yupan Huang, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei
NeurIPS 2023 | May 2023
TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models
Minghao Li, Tengchao Lv, Jingye Chen, Lei Cui, Yijuan Lu, Dinei Florencio, Cha Zhang, Zhoujun Li, Furu Wei
AAAI 2023 | February 2023
LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking
Yupang Huang, Tengchao Lv, Lei Cui, Yutong Lu, Furu Wei
ACM Multimedia 2022 | October 2022
DiT: Self-supervised Pre-training for Document Image Transformer
Junlong Li, Yiheng Xu, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei
ACM Multimedia 2022 | October 2022
Document AI: Benchmarks, Models and Applications
Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei
November 2021
TableBank: Table Benchmark for Image-based Table Detection and Recognition
Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou, Zhoujun Li
LREC 2020 | May 2020
Publication Type
-
1-bit AI Infra: Part 1.1, Fast and Lossless BitNet b1.58 Inference on CPUs
Jinheng Wang, Hansong Zhou, Ting Song, Shaoguang Mao, Shuming Ma, Hongyu Wang, Yan Xia, Furu Wei
October 2024
Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
Hongyu Wang, Shuming Ma, Ruiping Wang, Furu Wei
July 2024
Autoregressive Speech Synthesis without Vector Quantization
Lingwei Meng, Long Zhou, Shujie Liu, Sanyuan Chen, Bing Han, Shujie Hu, Yanqing Liu, Jinyu Li, Sheng Zhao, Xixin Wu, Helen Meng, Furu Wei
July 2024
Direct Preference Knowledge Distillation for Large Language Models
Yixing Li, Yuxian Gu, Li Dong, Dequan Wang, Yu Cheng, Furu Wei
June 2024
Instruction Pre-Training: Language Models are Supervised Multitask Learners
Daixuan Cheng, Yuxian Gu, Shaohan Huang, Junyu Bi, Minlie Huang, Furu Wei
June 2024
VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers
Sanyuan Chen, Shujie Liu, Long Zhou, Yanqing Liu, Xu Tan, Jinyu Li, Sheng Zhao, Yao Qian, Furu Wei
June 2024
MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
Ting Jiang, Shaohan Huang, Shengyue Luo, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang, Deqing Wang, Fuzhen Zhuang
May 2024
LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Models
Yadong Zhang, Shaoguang Mao, Tao Ge, Xun Wang, Adrian de Wynter, Yan Xia, Wenshan Wu, Ting Song, Man Lan, Furu Wei
March 2024
WavLLM: Towards Robust and Adaptive Speech Large Language Model
Shujie Hu, Long Zhou, Shujie Liu, Sanyuan Chen, Hongkun Hao, Jing Pan, Xunying Liu, Jinyu Li, Sunit Sivasankaran, Linquan Liu, Furu Wei
March 2024
ResLoRA: Identity Residual Mapping in Low-Rank Adaption
Shuhua Shi, Shaohan Huang, Minghui Song, Zhoujun Li, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
February 2024
Towards Optimal Learning of Language Models
Yuxian Gu, Li Dong, Yaru Hao, Qingxiu Dong, Minlie Huang, Furu Wei
February 2024
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
Shuming Ma, Hongyu Wang, Lingxiao Ma, Lei Wang, Wenhui Wang, Shaohan Huang, Lifeng Dong, Ruiping Wang, Jilong Xue, Furu Wei
February 2024
Work in progress
Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models
Haoran Li, Qingxiu Dong, Zhengyang Tang, Chaojun Wang, Xingxing Zhang, Haoyang Huang, Shaohan Huang, Xiaolong Huang, Zeqiang Huang, Dongdong Zhang, Yuxian Gu, Xin Cheng, Xun Wang, Si-Qing Chen, Li Dong, Wei Lu, Zhifang Sui, Benyou Wang, Wai Lam, Furu Wei
February 2024
Work in progress
When an Image is Worth 1,024 x 1,024 Words: A Case Study in Computational Pathology
Wenhui Wang, Shuming Ma, Hanwen Xu, Naoto Usuyama, Jiayu Ding, Hoifung Poon, Furu Wei
December 2023
BitNet: Scaling 1-bit Transformers for Large Language Models
Hongyu Wang, Shuming Ma, Li Dong, Shaohan Huang, Huaijie Wang, Lingxiao Ma, Fan Yang, Ruiping Wang, Yi Wu, Furu Wei
October 2023
Retentive Network: A Successor to Transformer for Large Language Models
Yutao Sun, Li Dong, Shaohan Huang, Shuming Ma, Yuqing Xia, Jilong Xue, Jianyong Wang, Furu Wei
August 2023
Learning Diverse Document Representations with Deep Query Interactions for Dense Retrieval
Zehan Li, Nan Yang, Liang Wang, Furu Wei
August 2022
-
You Only Cache Once: Decoder-Decoder Architectures for Language Models
Yutao Sun, Li Dong, Yi Zhu, Shaohan Huang, Wenhui Wang, Shuming Ma, Quanlu Zhang, Jianyong Wang, Furu Wei
NeurIPS 2024 | May 2024
Kosmos-G: Generating Images in Context with Multimodal Large Language Models
Xichen Pan, Li Dong, Shaohan Huang, Zhiliang Peng, Wenhu Chen, Furu Wei
ICLR 2024 | May 2024
Multi-Head Mixture-of-Experts
Xun Wu, Shaohan Huang, Wenhui Wang, Furu Wei
NeurIPS 2024 | April 2024
Mind’s Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models
Wenshan Wu, Shaoguang Mao, Yadong Zhang, Yan Xia, Li Dong, Lei Cui, Furu Wei
NeurIPS 2024 | April 2024
MathScale: Scaling Instruction Tuning for Mathematical Reasoning
Zhengyang Tang, Xingxing Zhang, Benyou Wang, Furu Wei
ICML 2024 | March 2024
Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Models
Tianyi Tang, Wenyang Luo, Haoyang Huang, Dongdong Zhang, Xiaolei Wang, Xin Zhao, Furu Wei, Ji-Rong Wen
ACL 2024 | February 2024
Fine-Tuning LLaMA for Multi-Stage Text Retrieval
Xueguang Ma, Liang Wang, Nan Yang, Furu Wei, Jimmy Lin
October 2023
PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training
Dawei Zhu, Nan Yang, Liang Wang, Yifan Song, Wenhao Wu, Furu Wei, Sujian Li
ICLR 2024 | October 2023
Learning to Retrieve In-Context Examples for Large Language Models
Liang Wang, Nan Yang, Furu Wei
EACL 2024 | July 2023
Learning to Rank in Generative Retrieval
Yongqi Li, Nan Yang, Liang Wang, Furu Wei, Wenjie Li
AAAI 2024 | June 2023
TextDiffuser: Diffusion Models as Text Painters
Jingye Chen, Yupan Huang, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei
NeurIPS 2023 | May 2023
Multiview Identifiers Enhanced Generative Retrieval
Yongqi Li, Nan Yang, Liang Wang, Furu Wei, Wenjie Li
ACL 2023 | May 2023
Query2doc: Query Expansion with Large Language Models
Liang Wang, Nan Yang, Furu Wei
EMNLP 2023 | March 2023
TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models
Minghao Li, Tengchao Lv, Jingye Chen, Lei Cui, Yijuan Lu, Dinei Florencio, Cha Zhang, Zhoujun Li, Furu Wei
AAAI 2023 | February 2023
Text Embeddings by Weakly-Supervised Contrastive Pre-training
Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang (姜大昕), Rangan Majumder, Furu Wei
December 2022
XDoc: Unified Pre-training for Cross-Format Document Understanding
Jingye Chen, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei
EMNLP 2022 | December 2022
AdaPrompt: Adaptive Model Training for Prompt-based NLP
Yulong Chen, Yang Liu, Li Dong, Shuohang Wang, Chenguang Zhu, Michael Zeng, Yue Zhang
Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022
LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking
Yupang Huang, Tengchao Lv, Lei Cui, Yutong Lu, Furu Wei
ACM Multimedia 2022 | October 2022
DiT: Self-supervised Pre-training for Document Image Transformer
Junlong Li, Yiheng Xu, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei
ACM Multimedia 2022 | October 2022
SimLM: Pre-training with Representation Bottleneck for Dense Passage Retrieval
Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang (姜大昕), Rangan Majumder, Furu Wei
ACL 2023 | July 2022
XFUND: A Benchmark Dataset for Multilingual Visually Rich Form Understanding
Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Furu Wei
ACL 2022 | May 2022
MarkupLM: Pre-training of Text and Markup Language for Visually-rich Document Understanding
Junlong Li, Yiheng Xu, Lei Cui, Furu Wei
ACL 2022 | May 2022
LayoutReader: Pre-training of Text and Layout for Reading Order Detection
Zilong Wang, Yiheng Xu, Lei Cui, Jingbo Shang, Furu Wei
EMNLP 2021 | November 2021
Ultra Fast Speech Separation Model with Teacher Student Learning
Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
Interspeech 2021 | August 2021
Document AI: Benchmarks, Models and Applications (In Chinese)
Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei
CCL 2021 | August 2021
Consistency Regularization for Cross-Lingual Fine-Tuning
Bo Zheng, Li Dong, Shaohan Huang, Wenhui Wang, Zewen Chi, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei
ACL-IJCNLP 2021 | June 2021
Continuous speech separation with Conformer
Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Jinyu Li, Takuya Yoshioka, Chengyi Wang, Shujie Liu, Ming Zhou
ICASSP | June 2021
Don’t shoot butterfly with rifles: multi-channel continuous speech separation with early exit transformer
Sanyuan Chen, Yu Wu, Zhuo Chen, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
ICASSP | June 2021
How Does Distilled Data Complexity Impact the Quality and Confidence of Non-Autoregressive Machine Translation?
Weijia Xu, Shuming Ma, Dongdong Zhang, Marine Carpuat
ACL-IJCNLP 2021 | May 2021
LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding
Yang Xu, Yiheng Xu, Tengchao Lv, Lei Cui, Furu Wei, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Wanxiang Che, Min Zhang, Lidong Zhou
ACL-IJCNLP 2021 | January 2021
DocBank: A Benchmark Dataset for Document Layout Analysis
Minghao Li, Yiheng Xu, Lei Cui, Shaohan Huang, Furu Wei, Zhoujun Li, Ming Zhou
COLING 2020 | December 2020
LayoutLM: Pre-training of Text and Layout for Document Image Understanding
Yiheng Xu, Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou
KDD 2020 | August 2020
Multimodal Matching Transformer for Live Commenting
Chaoqun Duan, Lei Cui, Shuming Ma, Furu Wei, Conghui Zhu, Tiejun Zhao
ECAI 2020 | July 2020
TableBank: Table Benchmark for Image-based Table Detection and Recognition
Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou, Zhoujun Li
LREC 2020 | May 2020
Self-Adversarial Learning with Comparative Discrimination for Text Generation
Wangchunshu Zhou, Tao Ge, Ke Xu, Furu Wei, Ming Zhou
Eighth International Conference on Learning Representations (ICLR) | April 2020
Neural Melody Composition from Lyrics
Hangbo Bao, Shaohan Huang, Furu Wei, Lei Cui, Yu Wu, Chuanqi Tan, Songhao Piao, Ming Zhou
NLPCC 2019 | September 2019
LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts
Shuming Ma, Lei Cui, Damai Dai, Furu Wei, Xu Sun
AAAI 2019 | July 2019
Retrieval-Enhanced Adversarial Training for Neural Response Generation
Qingfu Zhu, Lei Cui, Wei-Nan Zhang, Furu Wei, Ting Liu
ACL 2019 | July 2019
Fine-grained Coordinated Cross-lingual Text Stream Alignment for Endless Language Knowledge Acquisition
Tao Ge, Qing Dou, Heng Ji, Lei Cui, Baobao Chang, Zhifang Sui, Furu Wei, Ming Zhou
EMNLP 2018 | November 2018
SeRI: A Dataset for Sub-event Relation Inference from an Encyclopedia
Tao Ge, Lei Cui, Baobao Chang, Zhifang Sui, Furu Wei, Ming Zhou
NLPCC 2018 | August 2018
Neural Open Information Extraction
ACL 2018 | July 2018
Attention-Fused Deep Matching Network for Natural Language Inference
Chaoqun Duan, Lei Cui, Xinchi Chen, Furu Wei, Conghui Zhu, Tiejun Zhao
IJCAI 2018 | July 2018
EventWiki: A Knowledge Base of Major Events
Tao Ge, Lei Cui, Baobao Chang, Zhifang Sui, Furu Wei, Ming Zhou
LREC 2018 | May 2018
Hierarchical Recurrent Attention Network for Response Generation
Wei Wu, Chen Xing, Yu Wu, Ming Zhou, Yalou Huang, Wei-Ying Ma
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI’18) | February 2018
Knowledge Enhanced Hybrid Neural Network for Text Matching
Wei Wu, Yu Wu, Can Xu, Zhoujun Li
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI’18) | February 2018
Neural Response Generation with Dynamic Vocabularies
Wei Wu (wuwei), Yu Wu, Dejian Yang, Can Xu, Zhoujun Li
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI’18) | February 2018
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots
Yu Wu, Wei Wu, Chen Xing, Zhoujun Li, Ming Zhou
55th Annual Meeting of the Association for Computational Linguistics (ACL’17) | August 2017
SuperAgent: A Customer Service Chatbot for E-commerce Websites
Lei Cui, Furu Wei, Shaohan Huang, Chuanqi Tan, Chaoqun Duan, Ming Zhou
ACL 2017 | July 2017
R-NET: Machine Reading Comprehension with Self-matching Networks
Natural Language Computing Group
May 2017
Topic Aware Neural Response Generation
Chen Xing, Wei Wu, Yu Wu, Jie Liu, Yalou Huang, Ming Zhou, Wei-Ying Ma
Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence (AAAI’17) | February 2017
Detecting Context Dependent Messages in a Conversational Environment
Chaozhuo Li, Yu Wu, Wei Wu, Chen Xing, Zhoujun Li, Ming Zhou, Wei Wu
Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers | December 2016
Event Detection with Burst Information Networks
Tao Ge, Lei Cui, Baobao Chang, Zhifang Sui, Ming Zhou
COLING 2016 | December 2016
Discovering Concept-Level Event Associations from a Text Stream
Tao Ge, Lei Cui, Heng Ji, Baobao Chang, Zhifang Sui
NLPCC 2016 | December 2016
News Stream Summarization using Burst Information Networks
Tao Ge, Lei Cui, Baobao Chang, Sujian Li, Ming Zhou, Zhifang Sui
EMNLP 2016 | November 2016
Improving Recommendation of Tail Tags for Questions in Community Question Answering
Yu Wu, Wei Wu, Xiang Zhang, Zhoujun Li, Ming Zhou, Wei Wu, Ming Zhou
Thirtieth AAAI Conference on Artificial Intelligence (AAAI’16) | March 2016
Learning Distributed Representations of Data in Community Question Answering for Question Retrieval
Kai Zhang, Wei Wu, Fang Wang, Ming Zhou, Zhoujun Li, Wei Wu, Ming Zhou
Proceedings of the Ninth ACM International Conference on Web Search and Data Mining (WSDM’16) | February 2016
Mining Query Subtopics from Questions in Community Question Answering.
Yu Wu, Wei Wu, Zhoujun Li, Ming Zhou, Wei Wu, Ming Zhou
AAAI’15 | January 2015
Question retrieval with high quality answers in community question answering
Kai Zhang, Wei Wu, Haocheng Wu, Zhoujun Li, Ming Zhou, Wei Wu, Ming Zhou
Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management (CIKM’14) | November 2014
Machine Translation with Real-Time Web Search
Lei Cui, Ming Zhou, Qiming Chen, Dongdong Zhang, Mu Li
AAAI 2014 | July 2014
Improving search relevance for short queries in community question answering
Haocheng Wu, Wei Wu, Ming Zhou, Enhong Chen, Lei Duan, Heung-Yeung Shum, Wei Wu
Proceedings of the 7th ACM international conference on Web search and data mining (WSDM’14) | February 2014
-
Differential Transformer
Tianzhu Ye, Li Dong, Yuqing Xia, Yutao Sun, Yi Zhu, Gao Huang, Furu Wei
MSR-TR-2024-42 | October 2024
Publié par Microsoft
Multilingual E5 Text Embeddings: A Technical Report
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
MSR-TR-2024-45 | February 2024
Publié par Microsoft
Improving Text Embeddings with Large Language Models
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
MSR-TR-2024-2 | January 2024
Publié par Microsoft
Inference with Reference: Lossless Acceleration of Large Language Models
Nan Yang, Tao Ge, Liang Wang, Binxing Jiao, Daxin Jiang (姜大昕), Linjun Yang, Rangan Majumder, Furu Wei
MSR-TR-2023-17 | April 2023
Publié par Microsoft
-
Large Search Model: Redefining Search Stack in the Era of LLMs
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
SIGIR Forum | December 2023, Vol 57(2)
Generative Retrieval for Conversational Question Answering
Yongqi Li, Nan Yang, Liang Wang, Furu Wei, Wenjie Li
Information Processing and Management | August 2023, Vol 60(5)
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Xiangzhan Yu, Furu Wei
IEEE Journal of Selected Topics in Signal Processing | July 2022, Vol 16(6): pp. 1505-1518
Order-Sensitive Keywords Based Response Generation in Open-Domain Conversational Systems
Qingfu Zhu, Weinan Zhang, Lei Cui, Ting Liu
ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) | August 2019
-
TextDiffuser-2: Unleashing the Power of Language Models for Text Rendering
Jingye Chen, Yupan Huang, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei
November 2023
Kosmos-2.5: A Multimodal Literate Model
Tengchao Lv, Yupan Huang, Jingye Chen, Lei Cui, Shuming Ma, Yaoyao Chang, Shaohan Huang, Wenhui Wang, Li Dong, Weiyao Luo, Shaoxiang Wu, Guoxin Wang, Cha Zhang, Furu Wei
September 2023
Document AI: Benchmarks, Models and Applications
Lei Cui, Yiheng Xu, Tengchao Lv, Furu Wei
November 2021
VT-SSum: A Benchmark Dataset for Video Transcript Segmentation and Summarization
Tengchao Lv, Lei Cui, Momcilo Vasilijevic, Furu Wei
June 2021
LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding
Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Furu Wei
April 2021
-
Document AI: Benchmarks, Models and Applications (Presentation@ICDAR 2021)
September 2021
September 2021
DIL workshop in ICDAR 2021