Ankur Mallick

Senior Researcher

Publications

View by:

Intelligent Router for LLM Workloads: Improving Performance Through Workload-Aware Scheduling

A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Kunal Jain, Anoop Kulkarni, Steve Kofsky

August 2024

Preprint

Hybrid LLM: Cost-Efficient and Quality-Aware Query Routing

Dujian Ding, Ankur Mallick, Chi Wang, Robert Sim, Subhabrata Mukherjee, Victor Ruehle, Laks V. S. Lakshmanan, Ahmed Awadallah

ICLR 2024 | February 2024

Publication
Matchmaker: Data Drift Mitigation in Machine Learning for Large-Scale Systems

Ankur Mallick, Kevin Hsieh, Behnaz Arzani, Gauri Joshi

MLSys | January 2022

Publication

Intelligent Router for LLM Workloads: Improving Performance Through Workload-Aware Scheduling

A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Kunal Jain, Anoop Kulkarni, Steve Kofsky

August 2024

Preprint

Hybrid LLM: Cost-Efficient and Quality-Aware Query Routing

Dujian Ding, Ankur Mallick, Chi Wang, Robert Sim, Subhabrata Mukherjee, Victor Ruehle, Laks V. S. Lakshmanan, Ahmed Awadallah

ICLR 2024 | February 2024

Publication
Intelligent Router for LLM Workloads: Improving Performance Through Workload-Aware Scheduling

A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Kunal Jain, Anoop Kulkarni, Steve Kofsky

August 2024

Preprint

Matchmaker: Data Drift Mitigation in Machine Learning for Large-Scale Systems

Ankur Mallick, Kevin Hsieh, Behnaz Arzani, Gauri Joshi

MLSys | January 2022

Publication

Intelligent Router for LLM Workloads: Improving Performance Through Workload-Aware Scheduling

A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Kunal Jain, Anoop Kulkarni, Steve Kofsky

August 2024

Preprint
Hybrid LLM: Cost-Efficient and Quality-Aware Query Routing

Dujian Ding, Ankur Mallick, Chi Wang, Robert Sim, Subhabrata Mukherjee, Victor Ruehle, Laks V. S. Lakshmanan, Ahmed Awadallah

ICLR 2024 | February 2024

Publication

Matchmaker: Data Drift Mitigation in Machine Learning for Large-Scale Systems

Ankur Mallick, Kevin Hsieh, Behnaz Arzani, Gauri Joshi

MLSys | January 2022

Publication