ACL 2023 Multilingual Models Tutorial
Eastern Daylight Time (UTC -4)
Lieu: Toronto, Canada
Everything you need to know about Multilingual LLMs: Towards fair, performant and reliable models for the languages of the world
Date/time: July 9, 2023 | 9:00 AM – 12:30 PM
Location: Metropolitan West, Westin Harbour Castle, Toronto, Canada
This tutorial workshop is co-located with ACL 2023 (opens in new tab).
The technology landscape is being rapidly transformed by Large Language Models (LLMs), allowing users to address real-world applications in various domains. However, a digital divide exists that may exclude large populations from benefiting and contributing to this technological revolution due to factors such as language, income, digital awareness, and access to information. At Microsoft, we are dedicated to making Large Language Models inclusive to everyone on the planet.
This tutorial will describe various aspects of scaling up language technologies to many of the world’s languages by presenting the latest research in Massively Multilingual Language Models (MMLMs). We will cover topics such as data collection, training and fine-tuning of models, Responsible AI issues such as fairness, bias and toxicity, linguistic diversity and evaluation in the context of MMLMs, specifically focusing on issues in non-English and low-resource languages. Further, we will also talk about some of the real-world challenges in deploying these models in language communities in the field.
Tutorial topics
- Linguistic Diversity in MMLMs
- Data collection and training of MMLMs
- Prompting strategies for MMLMs
- Evaluation, analysis and interpretability of MMLMs
- Responsible AI issues in MMLMs
- Working with Language Communities