Fast-ELECTRA for Efficient Pre-training
Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu
ICLR 2024 | October 2023
Hao Cheng
Principal Researcher
Publications
Publications by Year
-
MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts
Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chun-yue Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, Jianfeng Gao
ICLR 2024 | October 2023
Augmenting Language Models with Long-Term Memory
Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei
NeurIPS 2023 | October 2023
Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models
Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, Jianfeng Gao
NeurIPS 2023 | October 2023
Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
ACL 2023 | July 2023
Self-Verification Improves Few-Shot Clinical Information Extraction
Zelalem Gero, Chandan Singh, Hao Cheng, Tristan Naumann, Michel Galley, Jianfeng Gao, Hoifung Poon
May 2023
Check your facts and try again: Improving large language models with external knowledge and automated feedback
Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
MSR-TR-2023-46 | March 2023
Published by Microsoft
-
Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
IJCAI 2022 | July 2022
human parity result on CommonsenseQA
Knowledge-Rich Self-Supervision for Biomedical Entity Linking
Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
EMNLP 2022 | May 2022
Open Domain Question Answering with A Unified Knowledge Interface
Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao
ACL 2022 | May 2022
-
CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
NeurIPS 2021 | December 2021
Dialogue State Tracking with a Language Model using Schema-Driven Prompting
Chia-Hsuan Lee, Hao Cheng, Mari Ostendorf
2021 Empirical Methods in Natural Language Processing | September 2021
Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
KDD 2021 | August 2021
-
UnitedQA: A Hybrid Approach for Open Domain Question Answering
Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao
ACL-IJCNLP 2021 | December 2020
Posterior Differential Regularization with f-divergence for Improving Model Robustness
Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao
October 2020
Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
Yu Gu, Robert Tinn, Hao Cheng, Michael Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
August 2020
Probabilistic Assumptions Matter: Improved Models for Distantly-Supervised Document-Level Question Answering.
Hao Cheng, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
Meeting of the Association for Computational Linguistics | June 2020
The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding
Xiaodong Liu, Yu Wang, Jianshu Ji, Hao Cheng, Xueyun Zhu, Emmanuel Awa, Pengcheng He, Weizhu Chen, Hoifung Poon, Guihong Cao, Jianfeng Gao
Meeting of the Association for Computational Linguistics | February 2020
DOI PDF PDF Publication Publication Publication Publication Publication
Publications by Research Area
-
Fast-ELECTRA for Efficient Pre-training
Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu
ICLR 2024 | October 2023
MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts
Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chun-yue Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, Jianfeng Gao
ICLR 2024 | October 2023
Augmenting Language Models with Long-Term Memory
Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei
NeurIPS 2023 | October 2023
Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models
Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, Jianfeng Gao
NeurIPS 2023 | October 2023
Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
ACL 2023 | July 2023
Self-Verification Improves Few-Shot Clinical Information Extraction
Zelalem Gero, Chandan Singh, Hao Cheng, Tristan Naumann, Michel Galley, Jianfeng Gao, Hoifung Poon
May 2023
Check your facts and try again: Improving large language models with external knowledge and automated feedback
Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
MSR-TR-2023-46 | March 2023
Published by Microsoft
Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
IJCAI 2022 | July 2022
human parity result on CommonsenseQA
Knowledge-Rich Self-Supervision for Biomedical Entity Linking
Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
EMNLP 2022 | May 2022
CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
NeurIPS 2021 | December 2021
Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
KDD 2021 | August 2021
UnitedQA: A Hybrid Approach for Open Domain Question Answering
Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao
ACL-IJCNLP 2021 | December 2020
Posterior Differential Regularization with f-divergence for Improving Model Robustness
Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao
October 2020
Probabilistic Assumptions Matter: Improved Models for Distantly-Supervised Document-Level Question Answering.
Hao Cheng, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
Meeting of the Association for Computational Linguistics | June 2020
The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding
Xiaodong Liu, Yu Wang, Jianshu Ji, Hao Cheng, Xueyun Zhu, Emmanuel Awa, Pengcheng He, Weizhu Chen, Hoifung Poon, Guihong Cao, Jianfeng Gao
Meeting of the Association for Computational Linguistics | February 2020
DOI PDF PDF Publication Publication Publication Publication Publication
-
Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
ACL 2023 | July 2023
Check your facts and try again: Improving large language models with external knowledge and automated feedback
Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
MSR-TR-2023-46 | March 2023
Published by Microsoft
Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
IJCAI 2022 | July 2022
human parity result on CommonsenseQA
Knowledge-Rich Self-Supervision for Biomedical Entity Linking
Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
EMNLP 2022 | May 2022
Open Domain Question Answering with A Unified Knowledge Interface
Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao
ACL 2022 | May 2022
CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
NeurIPS 2021 | December 2021
Dialogue State Tracking with a Language Model using Schema-Driven Prompting
Chia-Hsuan Lee, Hao Cheng, Mari Ostendorf
2021 Empirical Methods in Natural Language Processing | September 2021
Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
KDD 2021 | August 2021
Probabilistic Assumptions Matter: Improved Models for Distantly-Supervised Document-Level Question Answering.
Hao Cheng, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
Meeting of the Association for Computational Linguistics | June 2020
The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding
Xiaodong Liu, Yu Wang, Jianshu Ji, Hao Cheng, Xueyun Zhu, Emmanuel Awa, Pengcheng He, Weizhu Chen, Hoifung Poon, Guihong Cao, Jianfeng Gao
Meeting of the Association for Computational Linguistics | February 2020
DOI PDF PDF Publication Publication Publication Publication Publication
-
Check your facts and try again: Improving large language models with external knowledge and automated feedback
Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
MSR-TR-2023-46 | March 2023
Published by Microsoft
-
Self-Verification Improves Few-Shot Clinical Information Extraction
Zelalem Gero, Chandan Singh, Hao Cheng, Tristan Naumann, Michel Galley, Jianfeng Gao, Hoifung Poon
May 2023
Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
KDD 2021 | August 2021
Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
Yu Gu, Robert Tinn, Hao Cheng, Michael Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
August 2020
-
Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
KDD 2021 | August 2021
-
Posterior Differential Regularization with f-divergence for Improving Model Robustness
Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao
October 2020
Publications by Type
-
Fast-ELECTRA for Efficient Pre-training
Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu
ICLR 2024 | October 2023
MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts
Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chun-yue Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, Jianfeng Gao
ICLR 2024 | October 2023
Augmenting Language Models with Long-Term Memory
Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei
NeurIPS 2023 | October 2023
Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models
Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, Jianfeng Gao
NeurIPS 2023 | October 2023
Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
ACL 2023 | July 2023
Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
IJCAI 2022 | July 2022
human parity result on CommonsenseQA
Knowledge-Rich Self-Supervision for Biomedical Entity Linking
Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
EMNLP 2022 | May 2022
Open Domain Question Answering with A Unified Knowledge Interface
Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao
ACL 2022 | May 2022
CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
NeurIPS 2021 | December 2021
Dialogue State Tracking with a Language Model using Schema-Driven Prompting
Chia-Hsuan Lee, Hao Cheng, Mari Ostendorf
2021 Empirical Methods in Natural Language Processing | September 2021
Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
KDD 2021 | August 2021
UnitedQA: A Hybrid Approach for Open Domain Question Answering
Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao
ACL-IJCNLP 2021 | December 2020
Probabilistic Assumptions Matter: Improved Models for Distantly-Supervised Document-Level Question Answering.
Hao Cheng, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
Meeting of the Association for Computational Linguistics | June 2020
The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding
Xiaodong Liu, Yu Wang, Jianshu Ji, Hao Cheng, Xueyun Zhu, Emmanuel Awa, Pengcheng He, Weizhu Chen, Hoifung Poon, Guihong Cao, Jianfeng Gao
Meeting of the Association for Computational Linguistics | February 2020
DOI PDF PDF Publication Publication Publication Publication Publication
-
Check your facts and try again: Improving large language models with external knowledge and automated feedback
Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
MSR-TR-2023-46 | March 2023
Published by Microsoft
-
Self-Verification Improves Few-Shot Clinical Information Extraction
Zelalem Gero, Chandan Singh, Hao Cheng, Tristan Naumann, Michel Galley, Jianfeng Gao, Hoifung Poon
May 2023
Posterior Differential Regularization with f-divergence for Improving Model Robustness
Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao
October 2020
Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
Yu Gu, Robert Tinn, Hao Cheng, Michael Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
August 2020