Project LITMUS

LITMUS Predictor: An AI Assistant for Building Reliable, High-Performing and Fair Multilingual NLP Systems

Anirudh Srinivasan, Gauri Kholkar, Rahul Kejriwal, Tanuja Ganu, Sandipan Dandapat, Sunayana Sitaram, Balakrishnan Santhanam, Somak Aditya, Kalika Bali, Monojit Choudhury

Thirty-sixth AAAI Conference on Artificial Intelligence | February 2022

System Demonstration

Publication

A Case Study of Efficacy and Challenges in Practical Human-in-Loop Evaluation of NLP Systems Using Checklist

Shaily Bhatt, Rahul Jain, Sandipan Dandapat, Sunayana Sitaram

Workshop on Human Evaluation of NLP Systems | April 2021

Publication

TaxiNLI: Taking a Ride up the NLU Hill

Pratik Joshi, Somak Aditya, Aalok Sathe, Monojit Choudhury

Conference on Computational Natural Language Learning (CoNLL) | September 2020

DOI PDF Publication Github

LITMUS Predictor: An AI Assistant for Building Reliable, High-Performing and Fair Multilingual NLP Systems

Anirudh Srinivasan, Gauri Kholkar, Rahul Kejriwal, Tanuja Ganu, Sandipan Dandapat, Sunayana Sitaram, Balakrishnan Santhanam, Somak Aditya, Kalika Bali, Monojit Choudhury

Thirty-sixth AAAI Conference on Artificial Intelligence | February 2022

System Demonstration

Publication

TaxiNLI: Taking a Ride up the NLU Hill

Pratik Joshi, Somak Aditya, Aalok Sathe, Monojit Choudhury

Conference on Computational Natural Language Learning (CoNLL) | September 2020

DOI PDF Publication Github

LITMUS Predictor: An AI Assistant for Building Reliable, High-Performing and Fair Multilingual NLP Systems

Anirudh Srinivasan, Gauri Kholkar, Rahul Kejriwal, Tanuja Ganu, Sandipan Dandapat, Sunayana Sitaram, Balakrishnan Santhanam, Somak Aditya, Kalika Bali, Monojit Choudhury

Thirty-sixth AAAI Conference on Artificial Intelligence | February 2022

System Demonstration

Publication

A Case Study of Efficacy and Challenges in Practical Human-in-Loop Evaluation of NLP Systems Using Checklist

Shaily Bhatt, Rahul Jain, Sandipan Dandapat, Sunayana Sitaram

Workshop on Human Evaluation of NLP Systems | April 2021

Publication

TaxiNLI: Taking a Ride up the NLU Hill

Pratik Joshi, Somak Aditya, Aalok Sathe, Monojit Choudhury

Conference on Computational Natural Language Learning (CoNLL) | September 2020

DOI PDF Publication Github

LITMUS Predictor: An AI Assistant for Building Reliable, High-Performing and Fair Multilingual NLP Systems

Anirudh Srinivasan, Gauri Kholkar, Rahul Kejriwal, Tanuja Ganu, Sandipan Dandapat, Sunayana Sitaram, Balakrishnan Santhanam, Somak Aditya, Kalika Bali, Monojit Choudhury

Thirty-sixth AAAI Conference on Artificial Intelligence | February 2022

System Demonstration

Publication

A Case Study of Efficacy and Challenges in Practical Human-in-Loop Evaluation of NLP Systems Using Checklist

Shaily Bhatt, Rahul Jain, Sandipan Dandapat, Sunayana Sitaram

Workshop on Human Evaluation of NLP Systems | April 2021

Publication

TaxiNLI: Taking a Ride up the NLU Hill

Pratik Joshi, Somak Aditya, Aalok Sathe, Monojit Choudhury

Conference on Computational Natural Language Learning (CoNLL) | September 2020

DOI PDF Publication Github