DynamoLLM: Designing LLM Inference Clusters for Performance and Energy Efficiency
Jovan Stojkovic, Chaojie Zhang, Íñigo Goiri, Josep Torrellas, Esha Choukse
HPCA | March 2025
Publications
Publications par année
-
-
Computational Design of Dense Servers for Immersion Cooling
Milin Kodnongbua, Fiodar Kazhamiaka, Daniel S. Berger, Vikram Iyer, Alvin Lebeck, Rodrigo Fonseca, Ricardo Bianchini, Adriana Schulz
ACM Transactions on Graphics | December 2024, Vol 42(6)
Input-Dependent Power Usage in GPUs
Theo Gregersen, Pratyush Patel, Esha Choukse
Sustainable Supercomputing at SC24 | November 2024
Mosaic: Harnessing Micro-architectural Resources of Servers in Serverless Environments
Jovan Stojkovic, Esha Choukse, Enrique Saurez, Íñigo Goiri, Josep Torrellas
MICRO | November 2024
Optimizing GPU Data Center Power
Tawfik Rahal-Arabi, Paul Van der Arend, Ashish Jain, Mehdi Saidi, Rashad Oreifej, Sriram Sundaram, Srilatha Manne, Indrani Paul, Rajit Seahra, Frank Helms, Esha Choukse, Nithish Mahalingam, Brijesh Warrier, Ricardo Bianchini
APCCAS | November 2024
Mnemosyne: Parallelization Strategies for Efficiently Serving Multi-Million Context Length LLM Inference Requests Without Approximations
Amey Agrawal, Junda Chen, Íñigo Goiri, Ramachandran Ramjee, Chaojie Zhang, Alexey Tumanov, Esha Choukse
September 2024
Datacenter power and energy management: past, present, and future
Ricardo Bianchini, Christian Belady, Anand Sivasubramaniam
IEEE Micro | September 2024, Vol 44(5): pp. 30-36
Intelligent Router for LLM Workloads: Improving Performance Through Workload-Aware Scheduling
A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Kunal Jain, Anoop Kulkarni, Steve Kofsky
August 2024
LLexus: an AI agent system for incident management
Pedro Las-Casas, Alok Kumbhare, Rodrigo Fonseca, Sharad Agarwal
ACM SIGOPS Operating Systems Review | August 2024
FairyWREN: A Sustainable Cache for Emerging Write-Read-Erase Flash Interfaces
Sara McAllister, Sherry Wang, Benjamin Berg, Daniel S. Berger, George Amvrosiadis, Nathan Beckmann, G. R. Ganger
USENIX OSDI 2024 | July 2024
Managing Memory Tiers with CXL in Virtualized Environments
Yuhong Zhong, Daniel S. Berger, Carl Waldspurger, Ishwar Agarwal, Rajat Agarwal, Frank Hady, Karthik Kumar, Mark D. Hill, Mosharaf Chowdhury, Asaf Cidon
USENIX OSDI | July 2024
Designing Cloud Servers for Lower Carbon
Jaylen Wang, Daniel S. Berger, Fiodar Kazhamiaka, Celine Irvene, Chaojie Zhang, Esha Choukse, Kali Frost, Rodrigo Fonseca, Brijesh Warrier, Chetan Bansal, Jonathan Stern, Ricardo Bianchini, Akshitha Sriraman
ISCA | June 2024
DyLeCT: Achieving Huge-page-like Translation Performance For Hardware-compressed Memory
Gagan Panwar, Muhammad Laghari, Esha Choukse, Xun Jian
ISCA | June 2024
SmartOClock: Workload- and Risk-Aware Overclocking in the Cloud
Jovan Stojkovic, Pulkit Misra, Íñigo Goiri, Sam Whitlock, Esha Choukse, Mayukh Das, Chetan Bansal, Jason Lee, Zoey Sun, Haoran Qiu, Reed Zimmermann, Savyasachi Samal, Brijesh Warrier, Ashish Raniwala, Ricardo Bianchini
ISCA | June 2024
Splitwise: Efficient generative LLM inference using phase splitting
Pratyush Patel, Esha Choukse, Chaojie Zhang, Aashaka Shah, Íñigo Goiri, Saeed Maleki, Ricardo Bianchini
ISCA | June 2024
Towards Cloud Efficiency with Large-scale Workload Characterization
A. Parayil, Jue Zhang, Xiaoting Qin, Íñigo Goiri, Chetan Bansal
Published by Arxiv | May 2024, Vol abs/2405.07250
Characterizing Power Management Opportunities for LLMs in the Cloud
Pratyush Patel, Esha Choukse, Chaojie Zhang, Íñigo Goiri, Brijesh Warrier, Nithish Mahalingam, Ricardo Bianchini
ASPLOS | April 2024
Intelligent Overclocking for Improved Cloud Efficiency
Aditya Soni, Mayukh Das, Pulkit Misra, Chetan Bansal
AIOps ’24 workshop @ ASPLOS [5th International Workshop on Cloud Intelligence / AIOps] | April 2024
Making Kernel Bypass Practical for the Cloud with Junction
Joshua Fried, Gohar Irfan Chaudhry, Enrique Saurez, Esha Choukse, Íñigo Goiri, Sameh Elnikety, Rodrigo Fonseca, Adam Belay
NSDI | April 2024
Towards Greener LLMs: Bringing Energy-Efficiency to the Forefront of LLM Inference
Jovan Stojkovic, Esha Choukse, Chaojie Zhang, Íñigo Goiri, Josep Torrellas
EMC2 at ASPLOS | April 2024
Baleen: ML Admission & Prefetching for Flash Caches
Daniel Lin-Kit Wong, Hao Wu, Carson Molder, S. Gunasekar, Jimmy Lu, Snehal Khandkar, Abhinav Sharma, Daniel S. Berger, Nathan Beckmann, G. R. Ganger
USENIX FAST | February 2024
-
POLCA: Power Oversubscription in LLM Cloud Providers
Pratyush Patel, Esha Choukse, Chaojie Zhang, Íñigo Goiri, Brijesh Warrier, Nithish Mahalingam, Ricardo Bianchini
ArXiv | August 2023, Vol abs/2308.12908
Enso: A Streaming Interface for NIC-Application Communication
Hugo Sadok, Nirav Atre, Zhipeng Zhao, Daniel S. Berger, James C. Hoe, Aurojit Panda, Justine Sherry, Ren Wang
Proceedings of the 17th Symposium on Operating Systems Design and Implementation (OSDI) | July 2023
OSDI Best Paper Award
Hyrax: Fail-in-Place Server Operation in Cloud Platforms
Jialun Lyu, Marisa You, Celine Irvene, Mark Jung, Tyler Narmore, Jacob Shapiro, Luke Marshall, Savyasachi Samal, Ioannis Manousakis, Lisa Hsu, Preetha Subbarayalu, Ashish Raniwala, Brijesh Warrier, Ricardo Bianchini, Bianca Shroeder, Daniel S. Berger
Proceedings of the 17th Symposium on Operating Systems Design and Implementation (OSDI) | July 2023
Myths and Misconceptions Around Reducing Carbon Embedded in Cloud Platforms
Jialun Lyu, Jaylen Wang, Kali Frost, Chaojie Zhang, Celine Irvene, Esha Choukse, Rodrigo Fonseca, Ricardo Bianchini, Fiodar Kazhamiaka, Daniel S. Berger
2nd Workshop on Sustainable Computer Systems (HotCarbon’23) | July 2023
Towards Improved Power Management in Cloud GPUs
Pratyush Patel, Zibo Gong, S. Rizvi, Esha Choukse, Pulkit A. Misra, T. Anderson, Akshitha Sriraman, Esha Choukse, Pulkit Misra
IEEE Computer Architecture Letters | June 2023, Vol 22: pp. 141-144
How Different are the Cloud Workloads? Characterizing Large-Scale Private and Public Cloud Workloads
Xiaoting Qin, Minghua Ma, Yueng Zhao, Jue Zhang, Chao Du, Yudong Liu, A. Parayil, Chetan Bansal, Saravan Rajmohan, Íñigo Goiri, Eli Cortez, Si Qin, Qingwei Lin 林庆维, Dongmei Zhang
DSN | June 2023
An Introduction to the Compute Express Link (CXL) Interconnect
Debendra Das Sharma, R. Blankenship, Daniel S. Berger
June 2023
Palette Load Balancing: Locality Hints for Serverless Functions
Mania Abdi, Sam Ginzburg, Charles Lin, Jose M Faleiro, Íñigo Goiri, Gohar Irfan Chaudhry, Ricardo Bianchini, Daniel S. Berger, Rodrigo Fonseca
EuroSys | May 2023
With Great Freedom Comes Great Opportunity: Rethinking Resource Allocation for Serverless Functions
Muhammad Bilal, Marco Canini, Rodrigo Fonseca, Rodrigo Rodrigues
EuroSys | May 2023
Unlocking unallocated cloud capacity for long, uninterruptible workloads
Anup Agarwal, Shadi Noghabi, Íñigo Goiri, Srinivasan Seshan, Anirudh Badam
NSDI | April 2023
SelfTune: Tuning Cluster Managers
Ajaykrishna Karthikeyan, Nagarajan Natarajan, Gagan Somashekar, Lei Zhao, Ranjita Bhagwan, Rodrigo Fonseca, Tatiana Racheva, Yogesh Bansal
2023 Networked Systems Design and Implementation | April 2023
Snape: Reliable and Low-Cost Computing with Mixture of Spot and On-Demand VMs
Fangkai Yang, Lu Wang, Zhenyu Xu, Jue Zhang, Liqun Li, Bo Qiao, Camille Couturier, Chetan Bansal, Soumya Ram, Si Qin, Zhen Ma, Íñigo Goiri, Eli Cortez, Terry Yang, Victor Ruehle, Saravan Rajmohan, Qingwei Lin 林庆维, Dongmei Zhang
Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2023
Pond: CXL-Based Memory Pooling Systems for Cloud Platforms
Huaicheng Li, Daniel S. Berger, Stanko Novakovic, Lisa Hsu, Dan Ernst, Pantea Zardoshti, Monish Shah, Samir Rajadnya, Scott Lee, Ishwar Agarwal, Mark D. Hill, Marcus Fontoura, Ricardo Bianchini
Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2023
Distinguished Paper Award
Research Avenues Towards Net-Zero Cloud Platforms
Daniel S. Berger, Fiodar Kazhamiaka, Esha Choukse, Íñigo Goiri, Celine Irvene, Pulkit Misra, Alok Kumbhare, Rodrigo Fonseca, Ricardo Bianchini
NetZero 2023: 1st Workshop on NetZero Carbon Computing | February 2023
Design Tradeoffs in CXL-Based Memory Pools for Public Cloud Platforms
Daniel S. Berger, Huaicheng Li, Pantea Zardoshti, Monish Shah, Samir Rajadnya, Scott Lee, Lisa Hsu, Ishwar Agarwal, Mark D. Hill, Ricardo Bianchini
IEEE Micro | February 2023, Vol 43(2): pp. 30-38
-
TIPSY: Predicting Where Traffic Will Ingress a WAN
Michael Markovitch, Sharad Agarwal, Rodrigo Fonseca, Ryan Beckett, Chuanji Zhang, Irena Atov, Somesh Chaturmohta
ACM SIGCOMM | August 2022
Overclocking in Immersion-Cooled Datacenters
Pulkit Misra, Ioannis Manousakis, Esha Choukse, Majid Jalili, Íñigo Goiri, Ashish Raniwala, Brijesh Warrier, Husam Alissa, Bharath Ramakrishnan, Phillip Tuma, Christian Belady, Marcus Fontoura, Ricardo Bianchini
IEEE Micro Top Picks from the 2021 Computer Architecture Conferences | July 2022
C2DN: How to Harness Erasure Codes at the Edge for Efficient Content Delivery
Juncheng Yang, Anirudh Sabnis, Daniel S. Berger, K. V. Rashmi, Ramesh K. Sitaraman
Networked Systems Design and Implementation (NSDI) | April 2022
Memory-Harvesting VMs in Cloud Platforms
Alex Fuerst, Stanko Novakovic, Íñigo Goiri, Gohar Irfan Chaudhry, Prateek Sharma, Kapil Arya, Kevin Broas, Eugene Bak, Mehmet Iyigun, Ricardo Bianchini
Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2022
SOL: Safe On-Node Learning in Cloud Platforms
Yawen Wang, Dan Crankshaw, Neeraja J. Yadwadkar, Daniel S. Berger, Christos Kozyrakis, Ricardo Bianchini
Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2022
-
Faa$T: A Transparent Auto-Scaling Cache for Serverless Applications
Francisco Romero, Gohar Irfan Chaudhry, Íñigo Goiri, Pragna Gopa, Paul Batum, Neeraja J. Yadwadkar, Rodrigo Fonseca, Christos Kozyrakis, Ricardo Bianchini
Proceedings of the Symposium on Cloud Computing (SoCC) | November 2021
Provisioning Differentiated Last-Level Cache Allocations to VMs in Public Clouds
Mohammad Shahrad, Sameh Elnikety, Ricardo Bianchini
Proceedings of the Symposium on Cloud Computing (SoCC) | November 2021
Faster and Cheaper Serverless Computing on Harvested Resources
Yanqi Zhang, Íñigo Goiri, Gohar Irfan Chaudhry, Rodrigo Fonseca, Sameh Elnikety, Christina Delimitrou, Ricardo Bianchini
Proceedings of the International Symposium on Operating Systems Principles (SOSP) | October 2021
Prediction-Based Power Oversubscription in Cloud Platforms
Alok Kumbhare, Reza Azimi, Ioannis Manousakis, Anand Bonde, Felipe Vieira Frujeri, Nithish Mahalingam, Pulkit Misra, Seyyed Ahmad Javadi, Bianca Schroeder, Marcus Fontoura, Ricardo Bianchini
Proceedings of the USENIX Annual Technical Conference (ATC) | July 2021
Earlier version published as arXiv:2010.15388, October 2020
Cost-Efficient Overclocking in Immersion-Cooled Datacenters
Majid Jalili, Ioannis Manousakis, Íñigo Goiri, Pulkit Misra, Ashish Raniwala, Husam Alissa, Bharath Ramakrishnan, Phillip Tuma, Christian Belady, Marcus Fontoura, Ricardo Bianchini
Proceedings of the International Symposium on Computer Architecture (ISCA) | June 2021
Flex: High-Availability Datacenters With Zero Reserved Power
Chaojie Zhang, Alok Kumbhare, Ioannis Manousakis, Deli Zhang, Pulkit Misra, Rod Assis, Kyle Woolcock, Nithish Mahalingam, Brijesh Warrier, David Gauthier, Lalu Kunnath, Steve Solomon, Osvaldo Morales, Marcus Fontoura, Ricardo Bianchini
Proceedings of the International Symposium on Computer Architecture (ISCA) | June 2021
SmartHarvest: Harvesting Idle CPUs Safely and Efficiently in the Cloud
Yawen Wang, Kapil Arya, Marios Kogias, Manohar Vanga, Aditya Bhandari, Neeraja J. Yadwadkar, Siddhartha Sen, Sameh Elnikety, Christos Kozyrakis, Ricardo Bianchini
Proceedings of the 16th European Conference on Computer Systems (EuroSys) | April 2021
-
Providing SLOs for Resource-Harvesting VMs in Cloud Platforms
Pradeep Ambati, Íñigo Goiri, Felipe Vieira Frujeri, Alper Gun, Ke Wang, Brian Dolan, Brian Corell, Sekhar Pasupuleti, Thomas Moscibroda, Sameh Elnikety, Marcus Fontoura, Ricardo Bianchini
Proceedings of the Symposium on Operating Systems Design and Implementation (OSDI) | November 2020
Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud Provider
Mohammad Shahrad, Rodrigo Fonseca, Íñigo Goiri, Gohar Irfan Chaudhry, Paul Batum, Jason Cooke, Eduardo Laureano, Colby Tresness, Mark Russinovich, Ricardo Bianchini
Proceedings of the USENIX Annual Technical Conference (ATC) | July 2020
Community Award
Buddy compression: enabling larger memory for deep learning and HPC workloads on GPUs
Esha Choukse, Michael B. Sullivan, Mike O’Connor, Mattan Erez, Jeff Pool, David Nellans, Stephen W. Keckler
2020 International Symposium on Computer Architecture | May 2020
LeapIO: Efficient and Portable Virtual NVMe Storage on ARM SoCs
Huaicheng Li, Mingzhe Hao, Stanko Novakovic (stnovako), Vaibhav Gogte, Sriram Govindan, Dan R. K. Ports, Irene Zhang, Ricardo Bianchini, Haryadi S. Gunawi, Anirudh Badam
Proceedings on the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2020
Toward ML-Centric Cloud Platforms: Opportunities, Designs, and Experience with Microsoft Azure
Ricardo Bianchini, Marcus Fontoura, Eli Cortez, Anand Bonde, Alexandre Muzio, Ana-Maria Constantin, Thomas Moscibroda, Gabriel Magalhaes, Girish Bablani, Mark Russinovich
Communications of the ACM | February 2020, Vol 63(2)
-
PruneTrain: fast neural network training by dynamic sparse model reconfiguration
Sangkug Lym, Esha Choukse, Siavash Zangeneh, Wei Wen, Sujay Sanghavi, Mattan Erez
2019 IEEE International Conference on High Performance Computing, Data, and Analytics | November 2019
Fast General Distributed Transactions with Opacity
Alex Shamis, Matthew Renzelmann, Stanko Novakovic, Georgios Chatzopoulos, Aleksandar Dragojevic, Dushyanth Narayanan, Miguel Castro
International Conference on Management of Data (SIGMOD ’19) | June 2019
Best Paper Honorable Mention
Storm: a fast transactional dataplane for remote data structures
Stanko Novakovic, Yizhou Shan, Aasheesh Kolli, Michael Cui, Yiying Zhang, Haggai Eran, Boris Pismenny, Liran Liss, Michael Wei, Dan Tsafrir, Marcos Aguilera
12th ACM International Systems and Storage Conference (SYSTOR) | June 2019
Best Paper Award
Managing Tail Latency in Datacenter-Scale File Systems Under Production Constraints
Pulkit Misra, María F. Borge, Íñigo Goiri, Alvin R. Lebeck, Willy Zwaenepoel, Ricardo Bianchini
Proceedings of the 14th European Conference on Computer Systems (EuroSys) | March 2019
-
Uncertainty Propagation in Data Processing Systems
Ioannis Manousakis, Íñigo Goiri, Ricardo Bianchini, Sandro Rigo, Thu D. Nguyen
Proceedings of the Symposium on Cloud Computing (SoCC) | November 2018
-
Resource Central: Understanding and Predicting Workloads for Improved Resource Management in Large Cloud Platforms
Eli Cortez, Anand Bonde, Alexandre Muzio, Mark Russinovich, Marcus Fontoura, Ricardo Bianchini
Proceedings of the International Symposium on Operating Systems Principles (SOSP) | October 2017
Exploiting Heterogeneity for Tail Latency and Energy Efficiency
Md E. Haque, Yuxiong He, Sameh Elnikety, Thu D. Nguyen, Ricardo Bianchini, Kathryn McKinley
Proceedings of the International Symposium on Microarchitecture (MICRO) | October 2017
Scaling Distributed File Systems in Resource-Harvesting Datacenters
Pulkit Misra, Íñigo Goiri, Jason Kace, Ricardo Bianchini
Proceedings of USENIX Annual Technical Conference (ATC) | July 2017
-
History-Based Harvesting Spare Cycles and Storage in Large-Scale Datacenters
Yunqi Zhang, George Prekas, Giovanni Matteo Fumarola, Marcus Fontoura, Íñigo Goiri, Ricardo Bianchini
Proceedings of the International Symposium on Operating Systems Design and Implementation (OSDI) | November 2016
Environmental Conditions and Disk Reliability in Free-Cooled Datacenters
Ioannis Manousakis, Sriram Sankar, Gregg McKnight, Thu D. Nguyen, Ricardo Bianchini
Proceedings of the USENIX Conference on File and Storage Technologies (FAST) | February 2016
Best paper award
-
CoolProvision: Underprovisioning Datacenter Cooling
Ioannis Manousakis, Íñigo Goiri, Sriram Sankar, Thu D. Nguyen, Ricardo Bianchini
Proceedings of the International Symposium on Cloud Computing (SoCC) | August 2015
ApproxHadoop: Bringing Approximations to MapReduce Frameworks
Íñigo Goiri, Ricardo Bianchini, Santosh Nagarakatte, Thu D. Nguyen
Proceedings of the ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2015
CoolAir: Temperature- and Variation-Aware Management for Free-Cooled Datacenters
Íñigo Goiri, Thu D. Nguyen, Ricardo Bianchini
Proceedings of the ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2015
Few-to-Many: Incremental Parallelism for Reducing Tail Latency in Interactive Services
E. Haque, Yong hun Eom, Yuxiong He, Sameh Elnikety, Ricardo Bianchini, Kathryn S McKinley
Proceedings of the ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2015
Filtre par zone de recherche
-
Computational Design of Dense Servers for Immersion Cooling
Milin Kodnongbua, Fiodar Kazhamiaka, Daniel S. Berger, Vikram Iyer, Alvin Lebeck, Rodrigo Fonseca, Ricardo Bianchini, Adriana Schulz
ACM Transactions on Graphics | December 2024, Vol 42(6)
PruneTrain: fast neural network training by dynamic sparse model reconfiguration
Sangkug Lym, Esha Choukse, Siavash Zangeneh, Wei Wen, Sujay Sanghavi, Mattan Erez
2019 IEEE International Conference on High Performance Computing, Data, and Analytics | November 2019
-
Computational Design of Dense Servers for Immersion Cooling
Milin Kodnongbua, Fiodar Kazhamiaka, Daniel S. Berger, Vikram Iyer, Alvin Lebeck, Rodrigo Fonseca, Ricardo Bianchini, Adriana Schulz
ACM Transactions on Graphics | December 2024, Vol 42(6)
-
Computational Design of Dense Servers for Immersion Cooling
Milin Kodnongbua, Fiodar Kazhamiaka, Daniel S. Berger, Vikram Iyer, Alvin Lebeck, Rodrigo Fonseca, Ricardo Bianchini, Adriana Schulz
ACM Transactions on Graphics | December 2024, Vol 42(6)
DyLeCT: Achieving Huge-page-like Translation Performance For Hardware-compressed Memory
Gagan Panwar, Muhammad Laghari, Esha Choukse, Xun Jian
ISCA | June 2024
Towards Improved Power Management in Cloud GPUs
Pratyush Patel, Zibo Gong, S. Rizvi, Esha Choukse, Pulkit A. Misra, T. Anderson, Akshitha Sriraman, Esha Choukse, Pulkit Misra
IEEE Computer Architecture Letters | June 2023, Vol 22: pp. 141-144
Buddy compression: enabling larger memory for deep learning and HPC workloads on GPUs
Esha Choukse, Michael B. Sullivan, Mike O’Connor, Mattan Erez, Jeff Pool, David Nellans, Stephen W. Keckler
2020 International Symposium on Computer Architecture | May 2020
PruneTrain: fast neural network training by dynamic sparse model reconfiguration
Sangkug Lym, Esha Choukse, Siavash Zangeneh, Wei Wen, Sujay Sanghavi, Mattan Erez
2019 IEEE International Conference on High Performance Computing, Data, and Analytics | November 2019
Environmental Conditions and Disk Reliability in Free-Cooled Datacenters
Ioannis Manousakis, Sriram Sankar, Gregg McKnight, Thu D. Nguyen, Ricardo Bianchini
Proceedings of the USENIX Conference on File and Storage Technologies (FAST) | February 2016
Best paper award
Few-to-Many: Incremental Parallelism for Reducing Tail Latency in Interactive Services
E. Haque, Yong hun Eom, Yuxiong He, Sameh Elnikety, Ricardo Bianchini, Kathryn S McKinley
Proceedings of the ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2015
-
DynamoLLM: Designing LLM Inference Clusters for Performance and Energy Efficiency
Jovan Stojkovic, Chaojie Zhang, Íñigo Goiri, Josep Torrellas, Esha Choukse
HPCA | March 2025
Input-Dependent Power Usage in GPUs
Theo Gregersen, Pratyush Patel, Esha Choukse
Sustainable Supercomputing at SC24 | November 2024
Optimizing GPU Data Center Power
Tawfik Rahal-Arabi, Paul Van der Arend, Ashish Jain, Mehdi Saidi, Rashad Oreifej, Sriram Sundaram, Srilatha Manne, Indrani Paul, Rajit Seahra, Frank Helms, Esha Choukse, Nithish Mahalingam, Brijesh Warrier, Ricardo Bianchini
APCCAS | November 2024
Mosaic: Harnessing Micro-architectural Resources of Servers in Serverless Environments
Jovan Stojkovic, Esha Choukse, Enrique Saurez, Íñigo Goiri, Josep Torrellas
MICRO | November 2024
Datacenter power and energy management: past, present, and future
Ricardo Bianchini, Christian Belady, Anand Sivasubramaniam
IEEE Micro | September 2024, Vol 44(5): pp. 30-36
Intelligent Router for LLM Workloads: Improving Performance Through Workload-Aware Scheduling
A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Kunal Jain, Anoop Kulkarni, Steve Kofsky
August 2024
LLexus: an AI agent system for incident management
Pedro Las-Casas, Alok Kumbhare, Rodrigo Fonseca, Sharad Agarwal
ACM SIGOPS Operating Systems Review | August 2024
FairyWREN: A Sustainable Cache for Emerging Write-Read-Erase Flash Interfaces
Sara McAllister, Sherry Wang, Benjamin Berg, Daniel S. Berger, George Amvrosiadis, Nathan Beckmann, G. R. Ganger
USENIX OSDI 2024 | July 2024
Managing Memory Tiers with CXL in Virtualized Environments
Yuhong Zhong, Daniel S. Berger, Carl Waldspurger, Ishwar Agarwal, Rajat Agarwal, Frank Hady, Karthik Kumar, Mark D. Hill, Mosharaf Chowdhury, Asaf Cidon
USENIX OSDI | July 2024
Designing Cloud Servers for Lower Carbon
Jaylen Wang, Daniel S. Berger, Fiodar Kazhamiaka, Celine Irvene, Chaojie Zhang, Esha Choukse, Kali Frost, Rodrigo Fonseca, Brijesh Warrier, Chetan Bansal, Jonathan Stern, Ricardo Bianchini, Akshitha Sriraman
ISCA | June 2024
SmartOClock: Workload- and Risk-Aware Overclocking in the Cloud
Jovan Stojkovic, Pulkit Misra, Íñigo Goiri, Sam Whitlock, Esha Choukse, Mayukh Das, Chetan Bansal, Jason Lee, Zoey Sun, Haoran Qiu, Reed Zimmermann, Savyasachi Samal, Brijesh Warrier, Ashish Raniwala, Ricardo Bianchini
ISCA | June 2024
Splitwise: Efficient generative LLM inference using phase splitting
Pratyush Patel, Esha Choukse, Chaojie Zhang, Aashaka Shah, Íñigo Goiri, Saeed Maleki, Ricardo Bianchini
ISCA | June 2024
Towards Cloud Efficiency with Large-scale Workload Characterization
A. Parayil, Jue Zhang, Xiaoting Qin, Íñigo Goiri, Chetan Bansal
Published by Arxiv | May 2024, Vol abs/2405.07250
Intelligent Overclocking for Improved Cloud Efficiency
Aditya Soni, Mayukh Das, Pulkit Misra, Chetan Bansal
AIOps ’24 workshop @ ASPLOS [5th International Workshop on Cloud Intelligence / AIOps] | April 2024
Characterizing Power Management Opportunities for LLMs in the Cloud
Pratyush Patel, Esha Choukse, Chaojie Zhang, Íñigo Goiri, Brijesh Warrier, Nithish Mahalingam, Ricardo Bianchini
ASPLOS | April 2024
Towards Greener LLMs: Bringing Energy-Efficiency to the Forefront of LLM Inference
Jovan Stojkovic, Esha Choukse, Chaojie Zhang, Íñigo Goiri, Josep Torrellas
EMC2 at ASPLOS | April 2024
Making Kernel Bypass Practical for the Cloud with Junction
Joshua Fried, Gohar Irfan Chaudhry, Enrique Saurez, Esha Choukse, Íñigo Goiri, Sameh Elnikety, Rodrigo Fonseca, Adam Belay
NSDI | April 2024
Baleen: ML Admission & Prefetching for Flash Caches
Daniel Lin-Kit Wong, Hao Wu, Carson Molder, S. Gunasekar, Jimmy Lu, Snehal Khandkar, Abhinav Sharma, Daniel S. Berger, Nathan Beckmann, G. R. Ganger
USENIX FAST | February 2024
POLCA: Power Oversubscription in LLM Cloud Providers
Pratyush Patel, Esha Choukse, Chaojie Zhang, Íñigo Goiri, Brijesh Warrier, Nithish Mahalingam, Ricardo Bianchini
ArXiv | August 2023, Vol abs/2308.12908
Enso: A Streaming Interface for NIC-Application Communication
Hugo Sadok, Nirav Atre, Zhipeng Zhao, Daniel S. Berger, James C. Hoe, Aurojit Panda, Justine Sherry, Ren Wang
Proceedings of the 17th Symposium on Operating Systems Design and Implementation (OSDI) | July 2023
OSDI Best Paper Award
Hyrax: Fail-in-Place Server Operation in Cloud Platforms
Jialun Lyu, Marisa You, Celine Irvene, Mark Jung, Tyler Narmore, Jacob Shapiro, Luke Marshall, Savyasachi Samal, Ioannis Manousakis, Lisa Hsu, Preetha Subbarayalu, Ashish Raniwala, Brijesh Warrier, Ricardo Bianchini, Bianca Shroeder, Daniel S. Berger
Proceedings of the 17th Symposium on Operating Systems Design and Implementation (OSDI) | July 2023
Myths and Misconceptions Around Reducing Carbon Embedded in Cloud Platforms
Jialun Lyu, Jaylen Wang, Kali Frost, Chaojie Zhang, Celine Irvene, Esha Choukse, Rodrigo Fonseca, Ricardo Bianchini, Fiodar Kazhamiaka, Daniel S. Berger
2nd Workshop on Sustainable Computer Systems (HotCarbon’23) | July 2023
How Different are the Cloud Workloads? Characterizing Large-Scale Private and Public Cloud Workloads
Xiaoting Qin, Minghua Ma, Yueng Zhao, Jue Zhang, Chao Du, Yudong Liu, A. Parayil, Chetan Bansal, Saravan Rajmohan, Íñigo Goiri, Eli Cortez, Si Qin, Qingwei Lin 林庆维, Dongmei Zhang
DSN | June 2023
An Introduction to the Compute Express Link (CXL) Interconnect
Debendra Das Sharma, R. Blankenship, Daniel S. Berger
June 2023
With Great Freedom Comes Great Opportunity: Rethinking Resource Allocation for Serverless Functions
Muhammad Bilal, Marco Canini, Rodrigo Fonseca, Rodrigo Rodrigues
EuroSys | May 2023
Palette Load Balancing: Locality Hints for Serverless Functions
Mania Abdi, Sam Ginzburg, Charles Lin, Jose M Faleiro, Íñigo Goiri, Gohar Irfan Chaudhry, Ricardo Bianchini, Daniel S. Berger, Rodrigo Fonseca
EuroSys | May 2023
Unlocking unallocated cloud capacity for long, uninterruptible workloads
Anup Agarwal, Shadi Noghabi, Íñigo Goiri, Srinivasan Seshan, Anirudh Badam
NSDI | April 2023
SelfTune: Tuning Cluster Managers
Ajaykrishna Karthikeyan, Nagarajan Natarajan, Gagan Somashekar, Lei Zhao, Ranjita Bhagwan, Rodrigo Fonseca, Tatiana Racheva, Yogesh Bansal
2023 Networked Systems Design and Implementation | April 2023
Snape: Reliable and Low-Cost Computing with Mixture of Spot and On-Demand VMs
Fangkai Yang, Lu Wang, Zhenyu Xu, Jue Zhang, Liqun Li, Bo Qiao, Camille Couturier, Chetan Bansal, Soumya Ram, Si Qin, Zhen Ma, Íñigo Goiri, Eli Cortez, Terry Yang, Victor Ruehle, Saravan Rajmohan, Qingwei Lin 林庆维, Dongmei Zhang
Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2023
Pond: CXL-Based Memory Pooling Systems for Cloud Platforms
Huaicheng Li, Daniel S. Berger, Stanko Novakovic, Lisa Hsu, Dan Ernst, Pantea Zardoshti, Monish Shah, Samir Rajadnya, Scott Lee, Ishwar Agarwal, Mark D. Hill, Marcus Fontoura, Ricardo Bianchini
Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2023
Distinguished Paper Award
Research Avenues Towards Net-Zero Cloud Platforms
Daniel S. Berger, Fiodar Kazhamiaka, Esha Choukse, Íñigo Goiri, Celine Irvene, Pulkit Misra, Alok Kumbhare, Rodrigo Fonseca, Ricardo Bianchini
NetZero 2023: 1st Workshop on NetZero Carbon Computing | February 2023
Design Tradeoffs in CXL-Based Memory Pools for Public Cloud Platforms
Daniel S. Berger, Huaicheng Li, Pantea Zardoshti, Monish Shah, Samir Rajadnya, Scott Lee, Lisa Hsu, Ishwar Agarwal, Mark D. Hill, Ricardo Bianchini
IEEE Micro | February 2023, Vol 43(2): pp. 30-38
TIPSY: Predicting Where Traffic Will Ingress a WAN
Michael Markovitch, Sharad Agarwal, Rodrigo Fonseca, Ryan Beckett, Chuanji Zhang, Irena Atov, Somesh Chaturmohta
ACM SIGCOMM | August 2022
Overclocking in Immersion-Cooled Datacenters
Pulkit Misra, Ioannis Manousakis, Esha Choukse, Majid Jalili, Íñigo Goiri, Ashish Raniwala, Brijesh Warrier, Husam Alissa, Bharath Ramakrishnan, Phillip Tuma, Christian Belady, Marcus Fontoura, Ricardo Bianchini
IEEE Micro Top Picks from the 2021 Computer Architecture Conferences | July 2022
C2DN: How to Harness Erasure Codes at the Edge for Efficient Content Delivery
Juncheng Yang, Anirudh Sabnis, Daniel S. Berger, K. V. Rashmi, Ramesh K. Sitaraman
Networked Systems Design and Implementation (NSDI) | April 2022
Memory-Harvesting VMs in Cloud Platforms
Alex Fuerst, Stanko Novakovic, Íñigo Goiri, Gohar Irfan Chaudhry, Prateek Sharma, Kapil Arya, Kevin Broas, Eugene Bak, Mehmet Iyigun, Ricardo Bianchini
Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2022
SOL: Safe On-Node Learning in Cloud Platforms
Yawen Wang, Dan Crankshaw, Neeraja J. Yadwadkar, Daniel S. Berger, Christos Kozyrakis, Ricardo Bianchini
Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2022
Provisioning Differentiated Last-Level Cache Allocations to VMs in Public Clouds
Mohammad Shahrad, Sameh Elnikety, Ricardo Bianchini
Proceedings of the Symposium on Cloud Computing (SoCC) | November 2021
Faa$T: A Transparent Auto-Scaling Cache for Serverless Applications
Francisco Romero, Gohar Irfan Chaudhry, Íñigo Goiri, Pragna Gopa, Paul Batum, Neeraja J. Yadwadkar, Rodrigo Fonseca, Christos Kozyrakis, Ricardo Bianchini
Proceedings of the Symposium on Cloud Computing (SoCC) | November 2021
Faster and Cheaper Serverless Computing on Harvested Resources
Yanqi Zhang, Íñigo Goiri, Gohar Irfan Chaudhry, Rodrigo Fonseca, Sameh Elnikety, Christina Delimitrou, Ricardo Bianchini
Proceedings of the International Symposium on Operating Systems Principles (SOSP) | October 2021
Prediction-Based Power Oversubscription in Cloud Platforms
Alok Kumbhare, Reza Azimi, Ioannis Manousakis, Anand Bonde, Felipe Vieira Frujeri, Nithish Mahalingam, Pulkit Misra, Seyyed Ahmad Javadi, Bianca Schroeder, Marcus Fontoura, Ricardo Bianchini
Proceedings of the USENIX Annual Technical Conference (ATC) | July 2021
Earlier version published as arXiv:2010.15388, October 2020
Cost-Efficient Overclocking in Immersion-Cooled Datacenters
Majid Jalili, Ioannis Manousakis, Íñigo Goiri, Pulkit Misra, Ashish Raniwala, Husam Alissa, Bharath Ramakrishnan, Phillip Tuma, Christian Belady, Marcus Fontoura, Ricardo Bianchini
Proceedings of the International Symposium on Computer Architecture (ISCA) | June 2021
Flex: High-Availability Datacenters With Zero Reserved Power
Chaojie Zhang, Alok Kumbhare, Ioannis Manousakis, Deli Zhang, Pulkit Misra, Rod Assis, Kyle Woolcock, Nithish Mahalingam, Brijesh Warrier, David Gauthier, Lalu Kunnath, Steve Solomon, Osvaldo Morales, Marcus Fontoura, Ricardo Bianchini
Proceedings of the International Symposium on Computer Architecture (ISCA) | June 2021
SmartHarvest: Harvesting Idle CPUs Safely and Efficiently in the Cloud
Yawen Wang, Kapil Arya, Marios Kogias, Manohar Vanga, Aditya Bhandari, Neeraja J. Yadwadkar, Siddhartha Sen, Sameh Elnikety, Christos Kozyrakis, Ricardo Bianchini
Proceedings of the 16th European Conference on Computer Systems (EuroSys) | April 2021
Providing SLOs for Resource-Harvesting VMs in Cloud Platforms
Pradeep Ambati, Íñigo Goiri, Felipe Vieira Frujeri, Alper Gun, Ke Wang, Brian Dolan, Brian Corell, Sekhar Pasupuleti, Thomas Moscibroda, Sameh Elnikety, Marcus Fontoura, Ricardo Bianchini
Proceedings of the Symposium on Operating Systems Design and Implementation (OSDI) | November 2020
Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud Provider
Mohammad Shahrad, Rodrigo Fonseca, Íñigo Goiri, Gohar Irfan Chaudhry, Paul Batum, Jason Cooke, Eduardo Laureano, Colby Tresness, Mark Russinovich, Ricardo Bianchini
Proceedings of the USENIX Annual Technical Conference (ATC) | July 2020
Community Award
Buddy compression: enabling larger memory for deep learning and HPC workloads on GPUs
Esha Choukse, Michael B. Sullivan, Mike O’Connor, Mattan Erez, Jeff Pool, David Nellans, Stephen W. Keckler
2020 International Symposium on Computer Architecture | May 2020
LeapIO: Efficient and Portable Virtual NVMe Storage on ARM SoCs
Huaicheng Li, Mingzhe Hao, Stanko Novakovic (stnovako), Vaibhav Gogte, Sriram Govindan, Dan R. K. Ports, Irene Zhang, Ricardo Bianchini, Haryadi S. Gunawi, Anirudh Badam
Proceedings on the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2020
Toward ML-Centric Cloud Platforms: Opportunities, Designs, and Experience with Microsoft Azure
Ricardo Bianchini, Marcus Fontoura, Eli Cortez, Anand Bonde, Alexandre Muzio, Ana-Maria Constantin, Thomas Moscibroda, Gabriel Magalhaes, Girish Bablani, Mark Russinovich
Communications of the ACM | February 2020, Vol 63(2)
PruneTrain: fast neural network training by dynamic sparse model reconfiguration
Sangkug Lym, Esha Choukse, Siavash Zangeneh, Wei Wen, Sujay Sanghavi, Mattan Erez
2019 IEEE International Conference on High Performance Computing, Data, and Analytics | November 2019
Fast General Distributed Transactions with Opacity
Alex Shamis, Matthew Renzelmann, Stanko Novakovic, Georgios Chatzopoulos, Aleksandar Dragojevic, Dushyanth Narayanan, Miguel Castro
International Conference on Management of Data (SIGMOD ’19) | June 2019
Best Paper Honorable Mention
Storm: a fast transactional dataplane for remote data structures
Stanko Novakovic, Yizhou Shan, Aasheesh Kolli, Michael Cui, Yiying Zhang, Haggai Eran, Boris Pismenny, Liran Liss, Michael Wei, Dan Tsafrir, Marcos Aguilera
12th ACM International Systems and Storage Conference (SYSTOR) | June 2019
Best Paper Award
Managing Tail Latency in Datacenter-Scale File Systems Under Production Constraints
Pulkit Misra, María F. Borge, Íñigo Goiri, Alvin R. Lebeck, Willy Zwaenepoel, Ricardo Bianchini
Proceedings of the 14th European Conference on Computer Systems (EuroSys) | March 2019
Uncertainty Propagation in Data Processing Systems
Ioannis Manousakis, Íñigo Goiri, Ricardo Bianchini, Sandro Rigo, Thu D. Nguyen
Proceedings of the Symposium on Cloud Computing (SoCC) | November 2018
Resource Central: Understanding and Predicting Workloads for Improved Resource Management in Large Cloud Platforms
Eli Cortez, Anand Bonde, Alexandre Muzio, Mark Russinovich, Marcus Fontoura, Ricardo Bianchini
Proceedings of the International Symposium on Operating Systems Principles (SOSP) | October 2017
Exploiting Heterogeneity for Tail Latency and Energy Efficiency
Md E. Haque, Yuxiong He, Sameh Elnikety, Thu D. Nguyen, Ricardo Bianchini, Kathryn McKinley
Proceedings of the International Symposium on Microarchitecture (MICRO) | October 2017
Scaling Distributed File Systems in Resource-Harvesting Datacenters
Pulkit Misra, Íñigo Goiri, Jason Kace, Ricardo Bianchini
Proceedings of USENIX Annual Technical Conference (ATC) | July 2017
History-Based Harvesting Spare Cycles and Storage in Large-Scale Datacenters
Yunqi Zhang, George Prekas, Giovanni Matteo Fumarola, Marcus Fontoura, Íñigo Goiri, Ricardo Bianchini
Proceedings of the International Symposium on Operating Systems Design and Implementation (OSDI) | November 2016
CoolProvision: Underprovisioning Datacenter Cooling
Ioannis Manousakis, Íñigo Goiri, Sriram Sankar, Thu D. Nguyen, Ricardo Bianchini
Proceedings of the International Symposium on Cloud Computing (SoCC) | August 2015
ApproxHadoop: Bringing Approximations to MapReduce Frameworks
Íñigo Goiri, Ricardo Bianchini, Santosh Nagarakatte, Thu D. Nguyen
Proceedings of the ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2015
CoolAir: Temperature- and Variation-Aware Management for Free-Cooled Datacenters
Íñigo Goiri, Thu D. Nguyen, Ricardo Bianchini
Proceedings of the ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2015
Few-to-Many: Incremental Parallelism for Reducing Tail Latency in Interactive Services
E. Haque, Yong hun Eom, Yuxiong He, Sameh Elnikety, Ricardo Bianchini, Kathryn S McKinley
Proceedings of the ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2015
-
Mnemosyne: Parallelization Strategies for Efficiently Serving Multi-Million Context Length LLM Inference Requests Without Approximations
Amey Agrawal, Junda Chen, Íñigo Goiri, Ramachandran Ramjee, Chaojie Zhang, Alexey Tumanov, Esha Choukse
September 2024
Intelligent Router for LLM Workloads: Improving Performance Through Workload-Aware Scheduling
A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Kunal Jain, Anoop Kulkarni, Steve Kofsky
August 2024
LLexus: an AI agent system for incident management
Pedro Las-Casas, Alok Kumbhare, Rodrigo Fonseca, Sharad Agarwal
ACM SIGOPS Operating Systems Review | August 2024
Towards Cloud Efficiency with Large-scale Workload Characterization
A. Parayil, Jue Zhang, Xiaoting Qin, Íñigo Goiri, Chetan Bansal
Published by Arxiv | May 2024, Vol abs/2405.07250
Intelligent Overclocking for Improved Cloud Efficiency
Aditya Soni, Mayukh Das, Pulkit Misra, Chetan Bansal
AIOps ’24 workshop @ ASPLOS [5th International Workshop on Cloud Intelligence / AIOps] | April 2024
PruneTrain: fast neural network training by dynamic sparse model reconfiguration
Sangkug Lym, Esha Choukse, Siavash Zangeneh, Wei Wen, Sujay Sanghavi, Mattan Erez
2019 IEEE International Conference on High Performance Computing, Data, and Analytics | November 2019
-
Few-to-Many: Incremental Parallelism for Reducing Tail Latency in Interactive Services
E. Haque, Yong hun Eom, Yuxiong He, Sameh Elnikety, Ricardo Bianchini, Kathryn S McKinley
Proceedings of the ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2015
-
Few-to-Many: Incremental Parallelism for Reducing Tail Latency in Interactive Services
E. Haque, Yong hun Eom, Yuxiong He, Sameh Elnikety, Ricardo Bianchini, Kathryn S McKinley
Proceedings of the ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2015
Publication Type
-
Computational Design of Dense Servers for Immersion Cooling
Milin Kodnongbua, Fiodar Kazhamiaka, Daniel S. Berger, Vikram Iyer, Alvin Lebeck, Rodrigo Fonseca, Ricardo Bianchini, Adriana Schulz
ACM Transactions on Graphics | December 2024, Vol 42(6)
Datacenter power and energy management: past, present, and future
Ricardo Bianchini, Christian Belady, Anand Sivasubramaniam
IEEE Micro | September 2024, Vol 44(5): pp. 30-36
LLexus: an AI agent system for incident management
Pedro Las-Casas, Alok Kumbhare, Rodrigo Fonseca, Sharad Agarwal
ACM SIGOPS Operating Systems Review | August 2024
POLCA: Power Oversubscription in LLM Cloud Providers
Pratyush Patel, Esha Choukse, Chaojie Zhang, Íñigo Goiri, Brijesh Warrier, Nithish Mahalingam, Ricardo Bianchini
ArXiv | August 2023, Vol abs/2308.12908
Towards Improved Power Management in Cloud GPUs
Pratyush Patel, Zibo Gong, S. Rizvi, Esha Choukse, Pulkit A. Misra, T. Anderson, Akshitha Sriraman, Esha Choukse, Pulkit Misra
IEEE Computer Architecture Letters | June 2023, Vol 22: pp. 141-144
Design Tradeoffs in CXL-Based Memory Pools for Public Cloud Platforms
Daniel S. Berger, Huaicheng Li, Pantea Zardoshti, Monish Shah, Samir Rajadnya, Scott Lee, Lisa Hsu, Ishwar Agarwal, Mark D. Hill, Ricardo Bianchini
IEEE Micro | February 2023, Vol 43(2): pp. 30-38
Overclocking in Immersion-Cooled Datacenters
Pulkit Misra, Ioannis Manousakis, Esha Choukse, Majid Jalili, Íñigo Goiri, Ashish Raniwala, Brijesh Warrier, Husam Alissa, Bharath Ramakrishnan, Phillip Tuma, Christian Belady, Marcus Fontoura, Ricardo Bianchini
IEEE Micro Top Picks from the 2021 Computer Architecture Conferences | July 2022
Toward ML-Centric Cloud Platforms: Opportunities, Designs, and Experience with Microsoft Azure
Ricardo Bianchini, Marcus Fontoura, Eli Cortez, Anand Bonde, Alexandre Muzio, Ana-Maria Constantin, Thomas Moscibroda, Gabriel Magalhaes, Girish Bablani, Mark Russinovich
Communications of the ACM | February 2020, Vol 63(2)
-
Mnemosyne: Parallelization Strategies for Efficiently Serving Multi-Million Context Length LLM Inference Requests Without Approximations
Amey Agrawal, Junda Chen, Íñigo Goiri, Ramachandran Ramjee, Chaojie Zhang, Alexey Tumanov, Esha Choukse
September 2024
An Introduction to the Compute Express Link (CXL) Interconnect
Debendra Das Sharma, R. Blankenship, Daniel S. Berger
June 2023
-
DynamoLLM: Designing LLM Inference Clusters for Performance and Energy Efficiency
Jovan Stojkovic, Chaojie Zhang, Íñigo Goiri, Josep Torrellas, Esha Choukse
HPCA | March 2025
Input-Dependent Power Usage in GPUs
Theo Gregersen, Pratyush Patel, Esha Choukse
Sustainable Supercomputing at SC24 | November 2024
Optimizing GPU Data Center Power
Tawfik Rahal-Arabi, Paul Van der Arend, Ashish Jain, Mehdi Saidi, Rashad Oreifej, Sriram Sundaram, Srilatha Manne, Indrani Paul, Rajit Seahra, Frank Helms, Esha Choukse, Nithish Mahalingam, Brijesh Warrier, Ricardo Bianchini
APCCAS | November 2024
Mosaic: Harnessing Micro-architectural Resources of Servers in Serverless Environments
Jovan Stojkovic, Esha Choukse, Enrique Saurez, Íñigo Goiri, Josep Torrellas
MICRO | November 2024
FairyWREN: A Sustainable Cache for Emerging Write-Read-Erase Flash Interfaces
Sara McAllister, Sherry Wang, Benjamin Berg, Daniel S. Berger, George Amvrosiadis, Nathan Beckmann, G. R. Ganger
USENIX OSDI 2024 | July 2024
Managing Memory Tiers with CXL in Virtualized Environments
Yuhong Zhong, Daniel S. Berger, Carl Waldspurger, Ishwar Agarwal, Rajat Agarwal, Frank Hady, Karthik Kumar, Mark D. Hill, Mosharaf Chowdhury, Asaf Cidon
USENIX OSDI | July 2024
DyLeCT: Achieving Huge-page-like Translation Performance For Hardware-compressed Memory
Gagan Panwar, Muhammad Laghari, Esha Choukse, Xun Jian
ISCA | June 2024
Designing Cloud Servers for Lower Carbon
Jaylen Wang, Daniel S. Berger, Fiodar Kazhamiaka, Celine Irvene, Chaojie Zhang, Esha Choukse, Kali Frost, Rodrigo Fonseca, Brijesh Warrier, Chetan Bansal, Jonathan Stern, Ricardo Bianchini, Akshitha Sriraman
ISCA | June 2024
SmartOClock: Workload- and Risk-Aware Overclocking in the Cloud
Jovan Stojkovic, Pulkit Misra, Íñigo Goiri, Sam Whitlock, Esha Choukse, Mayukh Das, Chetan Bansal, Jason Lee, Zoey Sun, Haoran Qiu, Reed Zimmermann, Savyasachi Samal, Brijesh Warrier, Ashish Raniwala, Ricardo Bianchini
ISCA | June 2024
Splitwise: Efficient generative LLM inference using phase splitting
Pratyush Patel, Esha Choukse, Chaojie Zhang, Aashaka Shah, Íñigo Goiri, Saeed Maleki, Ricardo Bianchini
ISCA | June 2024
Intelligent Overclocking for Improved Cloud Efficiency
Aditya Soni, Mayukh Das, Pulkit Misra, Chetan Bansal
AIOps ’24 workshop @ ASPLOS [5th International Workshop on Cloud Intelligence / AIOps] | April 2024
Characterizing Power Management Opportunities for LLMs in the Cloud
Pratyush Patel, Esha Choukse, Chaojie Zhang, Íñigo Goiri, Brijesh Warrier, Nithish Mahalingam, Ricardo Bianchini
ASPLOS | April 2024
Towards Greener LLMs: Bringing Energy-Efficiency to the Forefront of LLM Inference
Jovan Stojkovic, Esha Choukse, Chaojie Zhang, Íñigo Goiri, Josep Torrellas
EMC2 at ASPLOS | April 2024
Making Kernel Bypass Practical for the Cloud with Junction
Joshua Fried, Gohar Irfan Chaudhry, Enrique Saurez, Esha Choukse, Íñigo Goiri, Sameh Elnikety, Rodrigo Fonseca, Adam Belay
NSDI | April 2024
Baleen: ML Admission & Prefetching for Flash Caches
Daniel Lin-Kit Wong, Hao Wu, Carson Molder, S. Gunasekar, Jimmy Lu, Snehal Khandkar, Abhinav Sharma, Daniel S. Berger, Nathan Beckmann, G. R. Ganger
USENIX FAST | February 2024
Enso: A Streaming Interface for NIC-Application Communication
Hugo Sadok, Nirav Atre, Zhipeng Zhao, Daniel S. Berger, James C. Hoe, Aurojit Panda, Justine Sherry, Ren Wang
Proceedings of the 17th Symposium on Operating Systems Design and Implementation (OSDI) | July 2023
OSDI Best Paper Award
Hyrax: Fail-in-Place Server Operation in Cloud Platforms
Jialun Lyu, Marisa You, Celine Irvene, Mark Jung, Tyler Narmore, Jacob Shapiro, Luke Marshall, Savyasachi Samal, Ioannis Manousakis, Lisa Hsu, Preetha Subbarayalu, Ashish Raniwala, Brijesh Warrier, Ricardo Bianchini, Bianca Shroeder, Daniel S. Berger
Proceedings of the 17th Symposium on Operating Systems Design and Implementation (OSDI) | July 2023
Myths and Misconceptions Around Reducing Carbon Embedded in Cloud Platforms
Jialun Lyu, Jaylen Wang, Kali Frost, Chaojie Zhang, Celine Irvene, Esha Choukse, Rodrigo Fonseca, Ricardo Bianchini, Fiodar Kazhamiaka, Daniel S. Berger
2nd Workshop on Sustainable Computer Systems (HotCarbon’23) | July 2023
How Different are the Cloud Workloads? Characterizing Large-Scale Private and Public Cloud Workloads
Xiaoting Qin, Minghua Ma, Yueng Zhao, Jue Zhang, Chao Du, Yudong Liu, A. Parayil, Chetan Bansal, Saravan Rajmohan, Íñigo Goiri, Eli Cortez, Si Qin, Qingwei Lin 林庆维, Dongmei Zhang
DSN | June 2023
With Great Freedom Comes Great Opportunity: Rethinking Resource Allocation for Serverless Functions
Muhammad Bilal, Marco Canini, Rodrigo Fonseca, Rodrigo Rodrigues
EuroSys | May 2023
Palette Load Balancing: Locality Hints for Serverless Functions
Mania Abdi, Sam Ginzburg, Charles Lin, Jose M Faleiro, Íñigo Goiri, Gohar Irfan Chaudhry, Ricardo Bianchini, Daniel S. Berger, Rodrigo Fonseca
EuroSys | May 2023
Unlocking unallocated cloud capacity for long, uninterruptible workloads
Anup Agarwal, Shadi Noghabi, Íñigo Goiri, Srinivasan Seshan, Anirudh Badam
NSDI | April 2023
SelfTune: Tuning Cluster Managers
Ajaykrishna Karthikeyan, Nagarajan Natarajan, Gagan Somashekar, Lei Zhao, Ranjita Bhagwan, Rodrigo Fonseca, Tatiana Racheva, Yogesh Bansal
2023 Networked Systems Design and Implementation | April 2023
Snape: Reliable and Low-Cost Computing with Mixture of Spot and On-Demand VMs
Fangkai Yang, Lu Wang, Zhenyu Xu, Jue Zhang, Liqun Li, Bo Qiao, Camille Couturier, Chetan Bansal, Soumya Ram, Si Qin, Zhen Ma, Íñigo Goiri, Eli Cortez, Terry Yang, Victor Ruehle, Saravan Rajmohan, Qingwei Lin 林庆维, Dongmei Zhang
Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2023
Pond: CXL-Based Memory Pooling Systems for Cloud Platforms
Huaicheng Li, Daniel S. Berger, Stanko Novakovic, Lisa Hsu, Dan Ernst, Pantea Zardoshti, Monish Shah, Samir Rajadnya, Scott Lee, Ishwar Agarwal, Mark D. Hill, Marcus Fontoura, Ricardo Bianchini
Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2023
Distinguished Paper Award
Research Avenues Towards Net-Zero Cloud Platforms
Daniel S. Berger, Fiodar Kazhamiaka, Esha Choukse, Íñigo Goiri, Celine Irvene, Pulkit Misra, Alok Kumbhare, Rodrigo Fonseca, Ricardo Bianchini
NetZero 2023: 1st Workshop on NetZero Carbon Computing | February 2023
TIPSY: Predicting Where Traffic Will Ingress a WAN
Michael Markovitch, Sharad Agarwal, Rodrigo Fonseca, Ryan Beckett, Chuanji Zhang, Irena Atov, Somesh Chaturmohta
ACM SIGCOMM | August 2022
C2DN: How to Harness Erasure Codes at the Edge for Efficient Content Delivery
Juncheng Yang, Anirudh Sabnis, Daniel S. Berger, K. V. Rashmi, Ramesh K. Sitaraman
Networked Systems Design and Implementation (NSDI) | April 2022
Memory-Harvesting VMs in Cloud Platforms
Alex Fuerst, Stanko Novakovic, Íñigo Goiri, Gohar Irfan Chaudhry, Prateek Sharma, Kapil Arya, Kevin Broas, Eugene Bak, Mehmet Iyigun, Ricardo Bianchini
Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2022
SOL: Safe On-Node Learning in Cloud Platforms
Yawen Wang, Dan Crankshaw, Neeraja J. Yadwadkar, Daniel S. Berger, Christos Kozyrakis, Ricardo Bianchini
Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2022
Provisioning Differentiated Last-Level Cache Allocations to VMs in Public Clouds
Mohammad Shahrad, Sameh Elnikety, Ricardo Bianchini
Proceedings of the Symposium on Cloud Computing (SoCC) | November 2021
Faa$T: A Transparent Auto-Scaling Cache for Serverless Applications
Francisco Romero, Gohar Irfan Chaudhry, Íñigo Goiri, Pragna Gopa, Paul Batum, Neeraja J. Yadwadkar, Rodrigo Fonseca, Christos Kozyrakis, Ricardo Bianchini
Proceedings of the Symposium on Cloud Computing (SoCC) | November 2021
Faster and Cheaper Serverless Computing on Harvested Resources
Yanqi Zhang, Íñigo Goiri, Gohar Irfan Chaudhry, Rodrigo Fonseca, Sameh Elnikety, Christina Delimitrou, Ricardo Bianchini
Proceedings of the International Symposium on Operating Systems Principles (SOSP) | October 2021
Prediction-Based Power Oversubscription in Cloud Platforms
Alok Kumbhare, Reza Azimi, Ioannis Manousakis, Anand Bonde, Felipe Vieira Frujeri, Nithish Mahalingam, Pulkit Misra, Seyyed Ahmad Javadi, Bianca Schroeder, Marcus Fontoura, Ricardo Bianchini
Proceedings of the USENIX Annual Technical Conference (ATC) | July 2021
Earlier version published as arXiv:2010.15388, October 2020
Cost-Efficient Overclocking in Immersion-Cooled Datacenters
Majid Jalili, Ioannis Manousakis, Íñigo Goiri, Pulkit Misra, Ashish Raniwala, Husam Alissa, Bharath Ramakrishnan, Phillip Tuma, Christian Belady, Marcus Fontoura, Ricardo Bianchini
Proceedings of the International Symposium on Computer Architecture (ISCA) | June 2021
Flex: High-Availability Datacenters With Zero Reserved Power
Chaojie Zhang, Alok Kumbhare, Ioannis Manousakis, Deli Zhang, Pulkit Misra, Rod Assis, Kyle Woolcock, Nithish Mahalingam, Brijesh Warrier, David Gauthier, Lalu Kunnath, Steve Solomon, Osvaldo Morales, Marcus Fontoura, Ricardo Bianchini
Proceedings of the International Symposium on Computer Architecture (ISCA) | June 2021
SmartHarvest: Harvesting Idle CPUs Safely and Efficiently in the Cloud
Yawen Wang, Kapil Arya, Marios Kogias, Manohar Vanga, Aditya Bhandari, Neeraja J. Yadwadkar, Siddhartha Sen, Sameh Elnikety, Christos Kozyrakis, Ricardo Bianchini
Proceedings of the 16th European Conference on Computer Systems (EuroSys) | April 2021
Providing SLOs for Resource-Harvesting VMs in Cloud Platforms
Pradeep Ambati, Íñigo Goiri, Felipe Vieira Frujeri, Alper Gun, Ke Wang, Brian Dolan, Brian Corell, Sekhar Pasupuleti, Thomas Moscibroda, Sameh Elnikety, Marcus Fontoura, Ricardo Bianchini
Proceedings of the Symposium on Operating Systems Design and Implementation (OSDI) | November 2020
Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud Provider
Mohammad Shahrad, Rodrigo Fonseca, Íñigo Goiri, Gohar Irfan Chaudhry, Paul Batum, Jason Cooke, Eduardo Laureano, Colby Tresness, Mark Russinovich, Ricardo Bianchini
Proceedings of the USENIX Annual Technical Conference (ATC) | July 2020
Community Award
Buddy compression: enabling larger memory for deep learning and HPC workloads on GPUs
Esha Choukse, Michael B. Sullivan, Mike O’Connor, Mattan Erez, Jeff Pool, David Nellans, Stephen W. Keckler
2020 International Symposium on Computer Architecture | May 2020
LeapIO: Efficient and Portable Virtual NVMe Storage on ARM SoCs
Huaicheng Li, Mingzhe Hao, Stanko Novakovic (stnovako), Vaibhav Gogte, Sriram Govindan, Dan R. K. Ports, Irene Zhang, Ricardo Bianchini, Haryadi S. Gunawi, Anirudh Badam
Proceedings on the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2020
PruneTrain: fast neural network training by dynamic sparse model reconfiguration
Sangkug Lym, Esha Choukse, Siavash Zangeneh, Wei Wen, Sujay Sanghavi, Mattan Erez
2019 IEEE International Conference on High Performance Computing, Data, and Analytics | November 2019
Fast General Distributed Transactions with Opacity
Alex Shamis, Matthew Renzelmann, Stanko Novakovic, Georgios Chatzopoulos, Aleksandar Dragojevic, Dushyanth Narayanan, Miguel Castro
International Conference on Management of Data (SIGMOD ’19) | June 2019
Best Paper Honorable Mention
Storm: a fast transactional dataplane for remote data structures
Stanko Novakovic, Yizhou Shan, Aasheesh Kolli, Michael Cui, Yiying Zhang, Haggai Eran, Boris Pismenny, Liran Liss, Michael Wei, Dan Tsafrir, Marcos Aguilera
12th ACM International Systems and Storage Conference (SYSTOR) | June 2019
Best Paper Award
Managing Tail Latency in Datacenter-Scale File Systems Under Production Constraints
Pulkit Misra, María F. Borge, Íñigo Goiri, Alvin R. Lebeck, Willy Zwaenepoel, Ricardo Bianchini
Proceedings of the 14th European Conference on Computer Systems (EuroSys) | March 2019
Uncertainty Propagation in Data Processing Systems
Ioannis Manousakis, Íñigo Goiri, Ricardo Bianchini, Sandro Rigo, Thu D. Nguyen
Proceedings of the Symposium on Cloud Computing (SoCC) | November 2018
Resource Central: Understanding and Predicting Workloads for Improved Resource Management in Large Cloud Platforms
Eli Cortez, Anand Bonde, Alexandre Muzio, Mark Russinovich, Marcus Fontoura, Ricardo Bianchini
Proceedings of the International Symposium on Operating Systems Principles (SOSP) | October 2017
Exploiting Heterogeneity for Tail Latency and Energy Efficiency
Md E. Haque, Yuxiong He, Sameh Elnikety, Thu D. Nguyen, Ricardo Bianchini, Kathryn McKinley
Proceedings of the International Symposium on Microarchitecture (MICRO) | October 2017
Scaling Distributed File Systems in Resource-Harvesting Datacenters
Pulkit Misra, Íñigo Goiri, Jason Kace, Ricardo Bianchini
Proceedings of USENIX Annual Technical Conference (ATC) | July 2017
History-Based Harvesting Spare Cycles and Storage in Large-Scale Datacenters
Yunqi Zhang, George Prekas, Giovanni Matteo Fumarola, Marcus Fontoura, Íñigo Goiri, Ricardo Bianchini
Proceedings of the International Symposium on Operating Systems Design and Implementation (OSDI) | November 2016
Environmental Conditions and Disk Reliability in Free-Cooled Datacenters
Ioannis Manousakis, Sriram Sankar, Gregg McKnight, Thu D. Nguyen, Ricardo Bianchini
Proceedings of the USENIX Conference on File and Storage Technologies (FAST) | February 2016
Best paper award
CoolProvision: Underprovisioning Datacenter Cooling
Ioannis Manousakis, Íñigo Goiri, Sriram Sankar, Thu D. Nguyen, Ricardo Bianchini
Proceedings of the International Symposium on Cloud Computing (SoCC) | August 2015
ApproxHadoop: Bringing Approximations to MapReduce Frameworks
Íñigo Goiri, Ricardo Bianchini, Santosh Nagarakatte, Thu D. Nguyen
Proceedings of the ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2015
CoolAir: Temperature- and Variation-Aware Management for Free-Cooled Datacenters
Íñigo Goiri, Thu D. Nguyen, Ricardo Bianchini
Proceedings of the ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2015
Few-to-Many: Incremental Parallelism for Reducing Tail Latency in Interactive Services
E. Haque, Yong hun Eom, Yuxiong He, Sameh Elnikety, Ricardo Bianchini, Kathryn S McKinley
Proceedings of the ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) | March 2015
-
Intelligent Router for LLM Workloads: Improving Performance Through Workload-Aware Scheduling
A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Kunal Jain, Anoop Kulkarni, Steve Kofsky
August 2024
Towards Cloud Efficiency with Large-scale Workload Characterization
A. Parayil, Jue Zhang, Xiaoting Qin, Íñigo Goiri, Chetan Bansal
Published by Arxiv | May 2024, Vol abs/2405.07250