Changho Hwang

Pre-gated MoE: An Algorithm-System Co-Design for Fast and Scalable Mixture-of-Expert Inference

Ranggi Hwang, Jianyu Wei, Shijie Cao, Changho Hwang, Xiaohu Tang, Ting Cao, Mao Yang

ISCA 2024 | July 2024

Microsoft Research Focus https://www.microsoft.com/en-us/research/blog/research-focus-week-of-july-15-2024/

Publication

ARK: GPU-driven Code Execution for Distributed Deep Learning

Changho Hwang, Ran Shu, Peng Cheng, Yongqiang Xiong, KyoungSoo Park

NSDI | April 2023

Publication

Tutel: Adaptive Mixture-of-Experts at Scale

Changho Hwang, Wei Cui, Yifan Xiong, Ziyue Yang, Ze Liu, Han Hu, Zilong Wang, Rafael Salas, Jithin Jose, Prabhat Ram, Joe Chau, Peng Cheng, Fan Yang, Mao Yang, Yongqiang Xiong

July 2022

Publication

Accelerating GNN training with locality-aware partial execution

Taehyun Kim, Changho Hwang, KyoungSoo Park, Zhiqi Lin, Peng Cheng, Youshan Miao, Lingxiao Ma, Yongqiang Xiong

August 2021

Publication

Pre-gated MoE: An Algorithm-System Co-Design for Fast and Scalable Mixture-of-Expert Inference

Ranggi Hwang, Jianyu Wei, Shijie Cao, Changho Hwang, Xiaohu Tang, Ting Cao, Mao Yang

ISCA 2024 | July 2024

Microsoft Research Focus https://www.microsoft.com/en-us/research/blog/research-focus-week-of-july-15-2024/

Publication

ARK: GPU-driven Code Execution for Distributed Deep Learning

Changho Hwang, Ran Shu, Peng Cheng, Yongqiang Xiong, KyoungSoo Park

NSDI | April 2023

Publication

Tutel: Adaptive Mixture-of-Experts at Scale

Changho Hwang, Wei Cui, Yifan Xiong, Ziyue Yang, Ze Liu, Han Hu, Zilong Wang, Rafael Salas, Jithin Jose, Prabhat Ram, Joe Chau, Peng Cheng, Fan Yang, Mao Yang, Yongqiang Xiong

July 2022

Publication

Accelerating GNN training with locality-aware partial execution

Taehyun Kim, Changho Hwang, KyoungSoo Park, Zhiqi Lin, Peng Cheng, Youshan Miao, Lingxiao Ma, Yongqiang Xiong

August 2021

Publication

ARK: GPU-driven Code Execution for Distributed Deep Learning

Changho Hwang, Ran Shu, Peng Cheng, Yongqiang Xiong, KyoungSoo Park

NSDI | April 2023

Publication

Pre-gated MoE: An Algorithm-System Co-Design for Fast and Scalable Mixture-of-Expert Inference

Ranggi Hwang, Jianyu Wei, Shijie Cao, Changho Hwang, Xiaohu Tang, Ting Cao, Mao Yang

ISCA 2024 | July 2024

Microsoft Research Focus https://www.microsoft.com/en-us/research/blog/research-focus-week-of-july-15-2024/

Publication

ARK: GPU-driven Code Execution for Distributed Deep Learning

Changho Hwang, Ran Shu, Peng Cheng, Yongqiang Xiong, KyoungSoo Park

NSDI | April 2023

Publication

Tutel: Adaptive Mixture-of-Experts at Scale

Changho Hwang, Wei Cui, Yifan Xiong, Ziyue Yang, Ze Liu, Han Hu, Zilong Wang, Rafael Salas, Jithin Jose, Prabhat Ram, Joe Chau, Peng Cheng, Fan Yang, Mao Yang, Yongqiang Xiong

July 2022

Publication

Accelerating GNN training with locality-aware partial execution

Taehyun Kim, Changho Hwang, KyoungSoo Park, Zhiqi Lin, Peng Cheng, Youshan Miao, Lingxiao Ma, Yongqiang Xiong

August 2021

Publication