VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models
Yifei Liu, Jicheng Wen, Yang Wang, Shengyu Ye, Li Lyna Zhang, Ting Cao, Cheng Li, Mao Yang
November 2024
Yang Wang
Researcher
Publications
Publications by Year
-
PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization
Cong Li, Zhe Zhou, Yang Wang, Fan Yang, Ting Cao, Mao Yang, Yun Liang, Guangyu Sun
29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'24) | April 2024
-
LUT-NN: Empower Efficient Neural Network Inference with Centroid Learning and Table Lookup
Xiaohu Tang, Yang Wang, Ting Cao, Li Lyna Zhang, Qi Chen, Deng Cai, Yunxin Liu, Mao Yang
The 29th Annual International Conference On Mobile Computing And Networking (MobiCom'23) | October 2023
Microsoft Research Focus https://www.microsoft.com/en-us/research/blog/research-focus-week-of-november-8-2023/
-
Towards Efficient Vision Transformer Inference: A First Study of Transformers on Mobile Devices
Xudong Wang, Li Lyna Zhang, Yang Wang, Mao Yang
HotMobile'22 | March 2022
Publications by Research Area
-
VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models
Yifei Liu, Jicheng Wen, Yang Wang, Shengyu Ye, Li Lyna Zhang, Ting Cao, Cheng Li, Mao Yang
November 2024
Towards Efficient Vision Transformer Inference: A First Study of Transformers on Mobile Devices
Xudong Wang, Li Lyna Zhang, Yang Wang, Mao Yang
HotMobile'22 | March 2022
-
VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models
Yifei Liu, Jicheng Wen, Yang Wang, Shengyu Ye, Li Lyna Zhang, Ting Cao, Cheng Li, Mao Yang
November 2024
PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization
Cong Li, Zhe Zhou, Yang Wang, Fan Yang, Ting Cao, Mao Yang, Yun Liang, Guangyu Sun
29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'24) | April 2024
LUT-NN: Empower Efficient Neural Network Inference with Centroid Learning and Table Lookup
Xiaohu Tang, Yang Wang, Ting Cao, Li Lyna Zhang, Qi Chen, Deng Cai, Yunxin Liu, Mao Yang
The 29th Annual International Conference On Mobile Computing And Networking (MobiCom'23) | October 2023
Microsoft Research Focus https://www.microsoft.com/en-us/research/blog/research-focus-week-of-november-8-2023/
Towards Efficient Vision Transformer Inference: A First Study of Transformers on Mobile Devices
Xudong Wang, Li Lyna Zhang, Yang Wang, Mao Yang
HotMobile'22 | March 2022
Publications by Type
-
VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models
Yifei Liu, Jicheng Wen, Yang Wang, Shengyu Ye, Li Lyna Zhang, Ting Cao, Cheng Li, Mao Yang
November 2024
PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization
Cong Li, Zhe Zhou, Yang Wang, Fan Yang, Ting Cao, Mao Yang, Yun Liang, Guangyu Sun
29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS'24) | April 2024
LUT-NN: Empower Efficient Neural Network Inference with Centroid Learning and Table Lookup
Xiaohu Tang, Yang Wang, Ting Cao, Li Lyna Zhang, Qi Chen, Deng Cai, Yunxin Liu, Mao Yang
The 29th Annual International Conference On Mobile Computing And Networking (MobiCom'23) | October 2023
Microsoft Research Focus https://www.microsoft.com/en-us/research/blog/research-focus-week-of-november-8-2023/
Towards Efficient Vision Transformer Inference: A First Study of Transformers on Mobile Devices
Xudong Wang, Li Lyna Zhang, Yang Wang, Mao Yang
HotMobile'22 | March 2022