MedFuzz: Exploring the Robustness of Large Language Models in Medical Question Answering
Robert Osazuwa Ness, Hayden Helm, Katie Matton, Sheng Zhang, Junaid Bajwa, Carey E. Priebe, Eric Horvitz
June 2024
Robert Osazuwa Ness
Senior Research Scientist
Publications
Publications by Year
-
-
Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicine
Harsha Nori, Yin Tat Lee, Sheng Zhang, Dean Carignan, Richard Edgar, Nicolo Fusi, Nicholas King, Jonathan Larson, Yuanzhi Li, Weishung Liu, Renqian Luo, Scott Mayer McKinney, Robert Osazuwa Ness, Hoifung Poon, Tao Qin, Naoto Usuyama, Chris White, Eric Horvitz
November 2023
Evaluating Cognitive Maps and Planning in Large Language Models with CogEval
Ida Momennejad, Hosein Hasanbeig, Felipe Vieira Frujeri, Hiteshi Sharma, Robert Osazuwa Ness, Nebojsa Jojic, Hamid Palangi, Jonathan Larson
NeurIPS 2023 | October 2023
Causal Reasoning and Large Language Models: Opening a New Frontier for Causality
Emre Kiciman, Robert Osazuwa Ness, Amit Sharma, Chenhao Tan
April 2023
-
A Causal AI Suite for Decision-Making
Emre Kiciman, Eleanor Dillon, Darren Edge, Adam Foster, Agrin Hilmkil, Joel Jennings, Chao Ma, Robert Osazuwa Ness, Nick Pawlowski, Amit Sharma, Cheng Zhang
NeurIPS 2022 Workshop on Causality for Real-world Impact | December 2022
Publications by Research Area
-
MedFuzz: Exploring the Robustness of Large Language Models in Medical Question Answering
Robert Osazuwa Ness, Hayden Helm, Katie Matton, Sheng Zhang, Junaid Bajwa, Carey E. Priebe, Eric Horvitz
June 2024
Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicine
Harsha Nori, Yin Tat Lee, Sheng Zhang, Dean Carignan, Richard Edgar, Nicolo Fusi, Nicholas King, Jonathan Larson, Yuanzhi Li, Weishung Liu, Renqian Luo, Scott Mayer McKinney, Robert Osazuwa Ness, Hoifung Poon, Tao Qin, Naoto Usuyama, Chris White, Eric Horvitz
November 2023
Evaluating Cognitive Maps and Planning in Large Language Models with CogEval
Ida Momennejad, Hosein Hasanbeig, Felipe Vieira Frujeri, Hiteshi Sharma, Robert Osazuwa Ness, Nebojsa Jojic, Hamid Palangi, Jonathan Larson
NeurIPS 2023 | October 2023
Causal Reasoning and Large Language Models: Opening a New Frontier for Causality
Emre Kiciman, Robert Osazuwa Ness, Amit Sharma, Chenhao Tan
April 2023
A Causal AI Suite for Decision-Making
Emre Kiciman, Eleanor Dillon, Darren Edge, Adam Foster, Agrin Hilmkil, Joel Jennings, Chao Ma, Robert Osazuwa Ness, Nick Pawlowski, Amit Sharma, Cheng Zhang
NeurIPS 2022 Workshop on Causality for Real-world Impact | December 2022
-
Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicine
Harsha Nori, Yin Tat Lee, Sheng Zhang, Dean Carignan, Richard Edgar, Nicolo Fusi, Nicholas King, Jonathan Larson, Yuanzhi Li, Weishung Liu, Renqian Luo, Scott Mayer McKinney, Robert Osazuwa Ness, Hoifung Poon, Tao Qin, Naoto Usuyama, Chris White, Eric Horvitz
November 2023
-
Evaluating Cognitive Maps and Planning in Large Language Models with CogEval
Ida Momennejad, Hosein Hasanbeig, Felipe Vieira Frujeri, Hiteshi Sharma, Robert Osazuwa Ness, Nebojsa Jojic, Hamid Palangi, Jonathan Larson
NeurIPS 2023 | October 2023
Publications by Type
-
MedFuzz: Exploring the Robustness of Large Language Models in Medical Question Answering
Robert Osazuwa Ness, Hayden Helm, Katie Matton, Sheng Zhang, Junaid Bajwa, Carey E. Priebe, Eric Horvitz
June 2024
Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicine
Harsha Nori, Yin Tat Lee, Sheng Zhang, Dean Carignan, Richard Edgar, Nicolo Fusi, Nicholas King, Jonathan Larson, Yuanzhi Li, Weishung Liu, Renqian Luo, Scott Mayer McKinney, Robert Osazuwa Ness, Hoifung Poon, Tao Qin, Naoto Usuyama, Chris White, Eric Horvitz
November 2023
-
Evaluating Cognitive Maps and Planning in Large Language Models with CogEval
Ida Momennejad, Hosein Hasanbeig, Felipe Vieira Frujeri, Hiteshi Sharma, Robert Osazuwa Ness, Nebojsa Jojic, Hamid Palangi, Jonathan Larson
NeurIPS 2023 | October 2023
A Causal AI Suite for Decision-Making
Emre Kiciman, Eleanor Dillon, Darren Edge, Adam Foster, Agrin Hilmkil, Joel Jennings, Chao Ma, Robert Osazuwa Ness, Nick Pawlowski, Amit Sharma, Cheng Zhang
NeurIPS 2022 Workshop on Causality for Real-world Impact | December 2022
-