Research talk: Learning and pretraining strategies for dense retrieval in search and beyond
In this talk, we’ll quickly go through our recent observations and findings with dense retrieval. First, we’ll recap the standard setup and training strategies for dense retrieval models in search. We’ll then share our recent progress on generalizing dense retrieval to recommendation, complex question answering, and latent reasoning. Finally, we’ll discuss the challenges with mismatches between pretrained models and dense retrieval requirements and our early attempts in dense retrieval dedicated pretraining techniques.
Learn more about the 2021 Microsoft Research Summit: https://Aka.ms/researchsummit (opens in new tab)
- Track:
- The Future of Search & Recommendation
- Date:
- Speakers:
- Chenyan Xiong
- Affiliation:
- Microsoft Research Redmond
-
-
Chenyan Xiong
Principal Researcher
-
-
The Future of Search & Recommendation
-
-
Keynote: Universal search and recommendation
Speakers:- Paul Bennett
-
-
-
-
Research talk: Learning and pretraining strategies for dense retrieval in search and beyond
Speakers:- Chenyan Xiong
-
-
Research talk: Is phrase retrieval all we need?
Speakers:- Danqi Chen
-
-
-
-
-
Research talk: IGLU: Interactive grounded language understanding in a collaborative environment
Speakers:- Julia Kiseleva
-
Research talk: Summarizing information across multiple documents and modalities
Speakers:- Subhojit Som
-
-
-
Panel: The future of search and recommendation: Beyond web search
Speakers:- Eric Horvitz,
- Nitin Agrawal,
- Soumen Chakrabati
-
-
-
Research talk: Attentive knowledge-aware graph neural networks for recommendation
Speakers:- Yaming Yang
-
Panel: Causality in search and recommendation systems
Speakers:- Emre Kiciman,
- Amit Sharma,
- Dean Eckles
-
