Microsoft Research Lab – Asia
Nouvelles et reportages
MPNet combines strengths of masked and permuted language modeling for language understanding
| Xu Tan
Pretrained language models have been a hot research topic in natural language processing. These models, such as BERT, are usually pretrained on large-scale language corpora with carefully designed pretraining objectives and then fine-tuned on downstream tasks to boost the accuracy.…
This year, the Microsoft Research Asia Fellowship Award attracted 106 distinguished Ph.D. candidates from 36 leading research universities or institutions around the Asia Pacific Region to apply. As a result, only 12 extremely outstanding students have been awarded fellowships. This…
This year, the Microsoft Research Asia Fellowship Award attracted 106 distinguished Ph.D. candidates from 36 leading research universities or institutions around the Asia Pacific Region to apply. As a result, only 12 extremely outstanding students have been awarded fellowships. This…
NeurIPS 2020: Moving toward real-world reinforcement learning via batch RL, strategic exploration, and representation learning
As human beings, we encounter unfamiliar situations all the time—learning to drive, living on our own for the first time, starting a new job. And while we can anticipate what to expect based on what others have told us or…
Dans l’actualité | Microsoft Stories Asia
Novo Nordisk and Microsoft will introduce an educational Chinese-speaking chatbot for diabetes patients
Microsoft in China and Novo Nordisk, a leading healthcare company specializing in diabetes care globally, jointly announced the collaboration to develop a Chinese-speaking, AI chatbot for diabetic patients at the 3rd China International Import Expo. Combining Novo Nordisk’s expertise and experience in…
Prix | USENIX OSDI 2020
Jay Lepreau Best Paper Award at OSDI 2020
Our paper titled «Byzantine Ordered Consensus without Byzantine Oligarchy» won the Jay Lepreau Best Paper Award at the 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI) conference.
Bringing AI outside the lab is a formidable challenge, since the real world is full of uncertainty, non-stationarity, and plenty of unknown hidden states. Therefore, training an AI system starting from simulated data mimicking the reality will only provide limited…
Microsoft Turing Universal Language Representation model, T-ULRv2, tops XTREME leaderboard
| Saurabh Tiwary et Ming Zhou
Today, we are happy to announce that Turing multilingual language model (T-ULRv2) is the state of the art at the top of the Google XTREME public leaderboard. Created by the Microsoft Turing team in collaboration with Microsoft Research, the model…
As an adaptive learning rate stochastic optimization method, Adam has been widely used in the field of deep learning since it was first proposed in 2014. In order to improve its training efficiency when applied to large-scale tasks, Adam is…