Compositional Generalization Across Distributional Shifts with Sparse Tree Operations
Paul Smolensky, Jianfeng Gao, Roland Fernandez
October 2024
Roland Fernandez
Principal Researcher
Publications
Publications by Year
-
-
Implicit Chain of Thought Reasoning via Knowledge Distillation
Yuntian Deng, Kiran Prasad, Roland Fernandez, Paul Smolensky, Vishrav Chaudhary, Stuart Shieber
ArXiv | November 2023, Vol abs/2311.01460
Differentiable Tree Operations Promote Compositional Generalization
Paul Soulos, Edward Hu, Kate McCurdy, Yunmo Chen, Roland Fernandez, Paul Smolensky, Jianfeng Gao
ICML 2023 | June 2023
-
Structural Biases for Improving Transformers on Translation into Morphologically Rich Languages
Paul Soulos, Sudha Rao, Caitlin Smith, Eric Rosen, Asli Celikyilmaz, Tom McCoy, Yichen Jiang, Coleman Haley, Roland Fernandez, Hamid Palangi, Jianfeng Gao, Paul Smolensky
ArXiv | August 2022, Vol abs/2208.06061
Neurocompositional computing in human and machine intelligence: A tutorial
Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew Goldrick, Jianfeng Gao
MSR-TR-2022-5 | May 2022
Published by Microsoft
52 pages main text, 78 pages total, 11 figures, 2 Appendices, 239 references. For a short presentation of some of this material, see https://arxiv.org/abs/2205.01128 (to appear in AI Magazine).
Neurocompositional computing: From the Central Paradox of Cognition to a new generation of AI systems
Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew A. Goldrick, Jianfeng Gao
AI Mag. | May 2022, Vol 43: pp. 308-322
-
Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization
Yichen Jiang, Asli Celikyilmaz, Paul Smolensky, Paul Soulos, Sudha Rao, Hamid Palangi, Roland Fernandez, Caitlin Smith, Mohit Bansal, Jianfeng Gao
North American Chapter of the Association for Computational Linguistics: Human Language Technologies | June 2021
Compositional Processing Emerges in Neural Networks Solving Math Problems
Jacob Russin, Roland Fernandez, Hamid Palangi, Eric Rosen, N. Jojic, Paul Smolensky, Jianfeng Gao
CogSci ... Annual Conference of the Cognitive Science Society. Cognitive Science Society (U.S.). Conference | May 2021, Vol 2021: pp. 1767-1773
-
Neuro-Symbolic Representations for Video Captioning: A Case for Leveraging Inductive Biases for Vision and Language
Hassan Akbari, Hamid Palangi, Jianwei Yang, Sudha Rao, Asli Celikyilmaz, Roland Fernandez, Paul Smolensky, Jianfeng Gao, Shih-Fu Chang
ArXiv | November 2020, Vol abs/2011.09530
Working Memory Graphs
Ricky Loynd, Roland Fernandez, Asli Celikyilmaz, Adith Swaminathan, Matthew Hausknecht
2020 International Conference on Machine Learning | July 2020
-
Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving
Imanol Schlag, Paul Smolensky, Roland Fernandez, Nebojsa Jojic, Jürgen Schmidhuber, Jianfeng Gao
Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019 | December 2019
A system for real-time interactive analysis of deep learning training
Shital Shah, Roland Fernandez, Steven Drucker
EICS | June 2019
-
Atom: A Grammar for Unit Visualizations
Deokgun Park, Steven Drucker, Roland Fernandez, Niklas Elmqvist
IEEE Transactions on Visualization and Computer Graphics | December 2018, Vol 24(12): pp. 3032-3043
Learning and analyzing vector encoding of symbolic representations
Roland Fernandez, Asli Celikyilmaz, Rishabh Singh, Paul Smolensky
ICLR 2018 | March 2018
-
Cross-Species Translation of the Morris Maze For Alzheimer’s Disease
Roland Fernandez, Katherine L. Possin, Pascal E. Sanchez, Clifford Anderson-Bergman, Roland Fernandez, Geoffrey A. Kerchner, Erica T. Johnson, Allyson Davis, Iris Lo, Nicholas T. Bott, Thomas Kiely, Michelle C. Fenesy, Bruce L. Miller, Joel H. Kramer, Steven Finkbeiner
The Journal of Clinical Investigation | January 2016
-
Networkcube: Bringing Dynamic Network Visualizations to Domain Scientists
Benjamin Bach, Nathalie Henry Riche, Roland Fernandez, Emmanoulis Giannisakis, Bongshin Lee, Jean-Daniel Fekete
October 2015
Posters Compendium of InfoVis 2015
A Unifying Framework for Animated and Interactive Unit Visualizations
Steven Drucker, Roland Fernandez
MSR-TR-2015-65 | August 2015
Refinery: Visual Exploration of Large, Heterogeneous Networks through Associative Browsing
Sanjay Kairam, Nathalie Henry Riche, Steven Drucker, Roland Fernandez, Jeffrey Heer
In Proceedings of Eurographics Conference on Visualization (EuroVis) | January 2015
-
Vis-Ã -vis: A Visual Language for Spreadsheet Visualizations
Danyel Fisher, Steven Drucker, Roland Fernandez, Xiaoji Chen
MSR-TR-2011-142 | June 2011
-
Visualizations Everywhere: A Multiplatform Infrastructure for Linked Visualizations
Danyel Fisher, Steven Drucker, Roland Fernandez, Scott Ruble
Transactions on Visualization and Computer Graphics | November 2010
-
What Designers Want: Needs of Interactive Application Designers
Roland Fernandez, Kori Inkpen, George Robertson
Symposium on Visual Languages and Human-Centric Computing (VLHCC 2009) | September 2009
Symposium on Visual Languages and Human-Centric Computing (VLHCC 2009)
WIPDash: Work Item and People Dashboard for Software Development Teams
Mikkel R. Jakobsen, Roland Fernandez, Mary Czerwinski, Kori Inkpen, Olga Kulyk, George Robertson
12th IFIP TC13 Conference in Human-Computer Interaction (INTERACT 2009) | August 2009
12th IFIP TC13 Conference in Human-Computer Interaction (INTERACT 2009)
-
GroupBanter: Supporting Serendipitous Group Conversations with IM
Kori Inkpen, Steven Whittaker, Mary Czerwinski, James Wallace, Roland Fernandez
The 4th International Conference on Collaborative Computing: Networking, Applications and Worksharing (CollaborateCom 2008) | November 2008
The 4th International Conference on Collaborative Computing: Networking, Applications and Worksharing (CollaborateCom 2008)
Effectiveness of Animation in Trend Visualization
George Robertson, Danyel Fisher, Bongshin Lee, John Stasko, Roland Fernandez
IEEE TVCG (InfoVis 2008) | January 2008
TapGlance: Designing a Unified Smartphone Interface
Daniel Robbins, Bongshin Lee, Roland Fernandez
Designing Interactive Systems 2008 | January 2008
Publications by Research Area
-
Compositional Generalization Across Distributional Shifts with Sparse Tree Operations
Paul Smolensky, Jianfeng Gao, Roland Fernandez
October 2024
Implicit Chain of Thought Reasoning via Knowledge Distillation
Yuntian Deng, Kiran Prasad, Roland Fernandez, Paul Smolensky, Vishrav Chaudhary, Stuart Shieber
ArXiv | November 2023, Vol abs/2311.01460
Differentiable Tree Operations Promote Compositional Generalization
Paul Soulos, Edward Hu, Kate McCurdy, Yunmo Chen, Roland Fernandez, Paul Smolensky, Jianfeng Gao
ICML 2023 | June 2023
Structural Biases for Improving Transformers on Translation into Morphologically Rich Languages
Paul Soulos, Sudha Rao, Caitlin Smith, Eric Rosen, Asli Celikyilmaz, Tom McCoy, Yichen Jiang, Coleman Haley, Roland Fernandez, Hamid Palangi, Jianfeng Gao, Paul Smolensky
ArXiv | August 2022, Vol abs/2208.06061
Neurocompositional computing in human and machine intelligence: A tutorial
Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew Goldrick, Jianfeng Gao
MSR-TR-2022-5 | May 2022
Published by Microsoft
52 pages main text, 78 pages total, 11 figures, 2 Appendices, 239 references. For a short presentation of some of this material, see https://arxiv.org/abs/2205.01128 (to appear in AI Magazine).
Neurocompositional computing: From the Central Paradox of Cognition to a new generation of AI systems
Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew A. Goldrick, Jianfeng Gao
AI Mag. | May 2022, Vol 43: pp. 308-322
Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization
Yichen Jiang, Asli Celikyilmaz, Paul Smolensky, Paul Soulos, Sudha Rao, Hamid Palangi, Roland Fernandez, Caitlin Smith, Mohit Bansal, Jianfeng Gao
North American Chapter of the Association for Computational Linguistics: Human Language Technologies | June 2021
Compositional Processing Emerges in Neural Networks Solving Math Problems
Jacob Russin, Roland Fernandez, Hamid Palangi, Eric Rosen, N. Jojic, Paul Smolensky, Jianfeng Gao
CogSci ... Annual Conference of the Cognitive Science Society. Cognitive Science Society (U.S.). Conference | May 2021, Vol 2021: pp. 1767-1773
Neuro-Symbolic Representations for Video Captioning: A Case for Leveraging Inductive Biases for Vision and Language
Hassan Akbari, Hamid Palangi, Jianwei Yang, Sudha Rao, Asli Celikyilmaz, Roland Fernandez, Paul Smolensky, Jianfeng Gao, Shih-Fu Chang
ArXiv | November 2020, Vol abs/2011.09530
Working Memory Graphs
Ricky Loynd, Roland Fernandez, Asli Celikyilmaz, Adith Swaminathan, Matthew Hausknecht
2020 International Conference on Machine Learning | July 2020
Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving
Imanol Schlag, Paul Smolensky, Roland Fernandez, Nebojsa Jojic, Jürgen Schmidhuber, Jianfeng Gao
Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019 | December 2019
A system for real-time interactive analysis of deep learning training
Shital Shah, Roland Fernandez, Steven Drucker
EICS | June 2019
Learning and analyzing vector encoding of symbolic representations
Roland Fernandez, Asli Celikyilmaz, Rishabh Singh, Paul Smolensky
ICLR 2018 | March 2018
-
Differentiable Tree Operations Promote Compositional Generalization
Paul Soulos, Edward Hu, Kate McCurdy, Yunmo Chen, Roland Fernandez, Paul Smolensky, Jianfeng Gao
ICML 2023 | June 2023
Neurocompositional computing in human and machine intelligence: A tutorial
Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew Goldrick, Jianfeng Gao
MSR-TR-2022-5 | May 2022
Published by Microsoft
52 pages main text, 78 pages total, 11 figures, 2 Appendices, 239 references. For a short presentation of some of this material, see https://arxiv.org/abs/2205.01128 (to appear in AI Magazine).
-
Atom: A Grammar for Unit Visualizations
Deokgun Park, Steven Drucker, Roland Fernandez, Niklas Elmqvist
IEEE Transactions on Visualization and Computer Graphics | December 2018, Vol 24(12): pp. 3032-3043
Networkcube: Bringing Dynamic Network Visualizations to Domain Scientists
Benjamin Bach, Nathalie Henry Riche, Roland Fernandez, Emmanoulis Giannisakis, Bongshin Lee, Jean-Daniel Fekete
October 2015
Posters Compendium of InfoVis 2015
Visualizations Everywhere: A Multiplatform Infrastructure for Linked Visualizations
Danyel Fisher, Steven Drucker, Roland Fernandez, Scott Ruble
Transactions on Visualization and Computer Graphics | November 2010
-
Atom: A Grammar for Unit Visualizations
Deokgun Park, Steven Drucker, Roland Fernandez, Niklas Elmqvist
IEEE Transactions on Visualization and Computer Graphics | December 2018, Vol 24(12): pp. 3032-3043
A Unifying Framework for Animated and Interactive Unit Visualizations
Steven Drucker, Roland Fernandez
MSR-TR-2015-65 | August 2015
Vis-Ã -vis: A Visual Language for Spreadsheet Visualizations
Danyel Fisher, Steven Drucker, Roland Fernandez, Xiaoji Chen
MSR-TR-2011-142 | June 2011
What Designers Want: Needs of Interactive Application Designers
Roland Fernandez, Kori Inkpen, George Robertson
Symposium on Visual Languages and Human-Centric Computing (VLHCC 2009) | September 2009
Symposium on Visual Languages and Human-Centric Computing (VLHCC 2009)
WIPDash: Work Item and People Dashboard for Software Development Teams
Mikkel R. Jakobsen, Roland Fernandez, Mary Czerwinski, Kori Inkpen, Olga Kulyk, George Robertson
12th IFIP TC13 Conference in Human-Computer Interaction (INTERACT 2009) | August 2009
12th IFIP TC13 Conference in Human-Computer Interaction (INTERACT 2009)
GroupBanter: Supporting Serendipitous Group Conversations with IM
Kori Inkpen, Steven Whittaker, Mary Czerwinski, James Wallace, Roland Fernandez
The 4th International Conference on Collaborative Computing: Networking, Applications and Worksharing (CollaborateCom 2008) | November 2008
The 4th International Conference on Collaborative Computing: Networking, Applications and Worksharing (CollaborateCom 2008)
-
Cross-Species Translation of the Morris Maze For Alzheimer’s Disease
Roland Fernandez, Katherine L. Possin, Pascal E. Sanchez, Clifford Anderson-Bergman, Roland Fernandez, Geoffrey A. Kerchner, Erica T. Johnson, Allyson Davis, Iris Lo, Nicholas T. Bott, Thomas Kiely, Michelle C. Fenesy, Bruce L. Miller, Joel H. Kramer, Steven Finkbeiner
The Journal of Clinical Investigation | January 2016
-
Refinery: Visual Exploration of Large, Heterogeneous Networks through Associative Browsing
Sanjay Kairam, Nathalie Henry Riche, Steven Drucker, Roland Fernandez, Jeffrey Heer
In Proceedings of Eurographics Conference on Visualization (EuroVis) | January 2015
-
A Unifying Framework for Animated and Interactive Unit Visualizations
Steven Drucker, Roland Fernandez
MSR-TR-2015-65 | August 2015
Vis-Ã -vis: A Visual Language for Spreadsheet Visualizations
Danyel Fisher, Steven Drucker, Roland Fernandez, Xiaoji Chen
MSR-TR-2011-142 | June 2011
Effectiveness of Animation in Trend Visualization
George Robertson, Danyel Fisher, Bongshin Lee, John Stasko, Roland Fernandez
IEEE TVCG (InfoVis 2008) | January 2008
-
Vis-Ã -vis: A Visual Language for Spreadsheet Visualizations
Danyel Fisher, Steven Drucker, Roland Fernandez, Xiaoji Chen
MSR-TR-2011-142 | June 2011
-
TapGlance: Designing a Unified Smartphone Interface
Daniel Robbins, Bongshin Lee, Roland Fernandez
Designing Interactive Systems 2008 | January 2008
-
Effectiveness of Animation in Trend Visualization
George Robertson, Danyel Fisher, Bongshin Lee, John Stasko, Roland Fernandez
IEEE TVCG (InfoVis 2008) | January 2008
Publications by Type
-
-
Implicit Chain of Thought Reasoning via Knowledge Distillation
Yuntian Deng, Kiran Prasad, Roland Fernandez, Paul Smolensky, Vishrav Chaudhary, Stuart Shieber
ArXiv | November 2023, Vol abs/2311.01460
Structural Biases for Improving Transformers on Translation into Morphologically Rich Languages
Paul Soulos, Sudha Rao, Caitlin Smith, Eric Rosen, Asli Celikyilmaz, Tom McCoy, Yichen Jiang, Coleman Haley, Roland Fernandez, Hamid Palangi, Jianfeng Gao, Paul Smolensky
ArXiv | August 2022, Vol abs/2208.06061
Neurocompositional computing: From the Central Paradox of Cognition to a new generation of AI systems
Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew A. Goldrick, Jianfeng Gao
AI Mag. | May 2022, Vol 43: pp. 308-322
Compositional Processing Emerges in Neural Networks Solving Math Problems
Jacob Russin, Roland Fernandez, Hamid Palangi, Eric Rosen, N. Jojic, Paul Smolensky, Jianfeng Gao
CogSci ... Annual Conference of the Cognitive Science Society. Cognitive Science Society (U.S.). Conference | May 2021, Vol 2021: pp. 1767-1773
Neuro-Symbolic Representations for Video Captioning: A Case for Leveraging Inductive Biases for Vision and Language
Hassan Akbari, Hamid Palangi, Jianwei Yang, Sudha Rao, Asli Celikyilmaz, Roland Fernandez, Paul Smolensky, Jianfeng Gao, Shih-Fu Chang
ArXiv | November 2020, Vol abs/2011.09530
Atom: A Grammar for Unit Visualizations
Deokgun Park, Steven Drucker, Roland Fernandez, Niklas Elmqvist
IEEE Transactions on Visualization and Computer Graphics | December 2018, Vol 24(12): pp. 3032-3043
Cross-Species Translation of the Morris Maze For Alzheimer’s Disease
Roland Fernandez, Katherine L. Possin, Pascal E. Sanchez, Clifford Anderson-Bergman, Roland Fernandez, Geoffrey A. Kerchner, Erica T. Johnson, Allyson Davis, Iris Lo, Nicholas T. Bott, Thomas Kiely, Michelle C. Fenesy, Bruce L. Miller, Joel H. Kramer, Steven Finkbeiner
The Journal of Clinical Investigation | January 2016
-
Differentiable Tree Operations Promote Compositional Generalization
Paul Soulos, Edward Hu, Kate McCurdy, Yunmo Chen, Roland Fernandez, Paul Smolensky, Jianfeng Gao
ICML 2023 | June 2023
Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization
Yichen Jiang, Asli Celikyilmaz, Paul Smolensky, Paul Soulos, Sudha Rao, Hamid Palangi, Roland Fernandez, Caitlin Smith, Mohit Bansal, Jianfeng Gao
North American Chapter of the Association for Computational Linguistics: Human Language Technologies | June 2021
Working Memory Graphs
Ricky Loynd, Roland Fernandez, Asli Celikyilmaz, Adith Swaminathan, Matthew Hausknecht
2020 International Conference on Machine Learning | July 2020
Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving
Imanol Schlag, Paul Smolensky, Roland Fernandez, Nebojsa Jojic, Jürgen Schmidhuber, Jianfeng Gao
Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019 | December 2019
A system for real-time interactive analysis of deep learning training
Shital Shah, Roland Fernandez, Steven Drucker
EICS | June 2019
Learning and analyzing vector encoding of symbolic representations
Roland Fernandez, Asli Celikyilmaz, Rishabh Singh, Paul Smolensky
ICLR 2018 | March 2018
Refinery: Visual Exploration of Large, Heterogeneous Networks through Associative Browsing
Sanjay Kairam, Nathalie Henry Riche, Steven Drucker, Roland Fernandez, Jeffrey Heer
In Proceedings of Eurographics Conference on Visualization (EuroVis) | January 2015
Visualizations Everywhere: A Multiplatform Infrastructure for Linked Visualizations
Danyel Fisher, Steven Drucker, Roland Fernandez, Scott Ruble
Transactions on Visualization and Computer Graphics | November 2010
What Designers Want: Needs of Interactive Application Designers
Roland Fernandez, Kori Inkpen, George Robertson
Symposium on Visual Languages and Human-Centric Computing (VLHCC 2009) | September 2009
Symposium on Visual Languages and Human-Centric Computing (VLHCC 2009)
WIPDash: Work Item and People Dashboard for Software Development Teams
Mikkel R. Jakobsen, Roland Fernandez, Mary Czerwinski, Kori Inkpen, Olga Kulyk, George Robertson
12th IFIP TC13 Conference in Human-Computer Interaction (INTERACT 2009) | August 2009
12th IFIP TC13 Conference in Human-Computer Interaction (INTERACT 2009)
GroupBanter: Supporting Serendipitous Group Conversations with IM
Kori Inkpen, Steven Whittaker, Mary Czerwinski, James Wallace, Roland Fernandez
The 4th International Conference on Collaborative Computing: Networking, Applications and Worksharing (CollaborateCom 2008) | November 2008
The 4th International Conference on Collaborative Computing: Networking, Applications and Worksharing (CollaborateCom 2008)
TapGlance: Designing a Unified Smartphone Interface
Daniel Robbins, Bongshin Lee, Roland Fernandez
Designing Interactive Systems 2008 | January 2008
Effectiveness of Animation in Trend Visualization
George Robertson, Danyel Fisher, Bongshin Lee, John Stasko, Roland Fernandez
IEEE TVCG (InfoVis 2008) | January 2008
-
Neurocompositional computing in human and machine intelligence: A tutorial
Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew Goldrick, Jianfeng Gao
MSR-TR-2022-5 | May 2022
Published by Microsoft
52 pages main text, 78 pages total, 11 figures, 2 Appendices, 239 references. For a short presentation of some of this material, see https://arxiv.org/abs/2205.01128 (to appear in AI Magazine).
A Unifying Framework for Animated and Interactive Unit Visualizations
Steven Drucker, Roland Fernandez
MSR-TR-2015-65 | August 2015
Vis-Ã -vis: A Visual Language for Spreadsheet Visualizations
Danyel Fisher, Steven Drucker, Roland Fernandez, Xiaoji Chen
MSR-TR-2011-142 | June 2011
-
Networkcube: Bringing Dynamic Network Visualizations to Domain Scientists
Benjamin Bach, Nathalie Henry Riche, Roland Fernandez, Emmanoulis Giannisakis, Bongshin Lee, Jean-Daniel Fekete
October 2015
Posters Compendium of InfoVis 2015