News & features
In the past two years, there have been numerous papers written on Transformer, and researchers are designing Transformer models for all kinds of tasks. However, is attention, the core module of Transformer, really stronger than convolution? This paper may bring…
AI4Science to empower the fifth paradigm of scientific discovery
| Christopher Bishop
Editor’s note, Oct. 20, 2023 – The post was updated to remove information related to the Amsterdam lab, as those details have since changed. Over the coming decade, deep learning looks set to have a transformational impact on the natural…
Introducing the Microsoft Climate Research Initiative
Addressing and mitigating the effects of climate change requires a collective effort, bringing our strengths to bear across industry, government, academia, and civil society.
WWW (Proceedings of the ACM Web Conference) is one of the most important international conferences in the field of Internet technology. WWW 2022 was held as an online conference in Lyon, France, on April 25-29. A total of 1,822 long…
Swin Transformer supports 3-billion-parameter vision models that can train with higher-resolution images for greater task applicability
| Han Hu and Baining Guo
Early last year, our research team from the Visual Computing Group (opens in new tab) introduced Swin Transformer (opens in new tab), a Transformer-based general-purpose computer vision architecture that for the first time beat convolutional neural networks on the important…
In the news | Microsoft Innovation
Tech Minutes: Swin Transformer
Learn how Swin Transformer surpasses previously dominant CNN (convolutional neural network) architectures in computer vision. Presented by Han Hu, Principal Researcher and Research Manager from Microsoft Research Asia.
As a top international academic conference in the field of natural language processing, ACL attracts paper submissions and conference participation from a large number of scholars every year. This year’s ACL conference was held from May 22nd to May 27th.…
ICLR 2022 highlights from Microsoft Research Asia: Expanding the horizon of machine learning techniques and applications
| Shun Zheng, Jiang Bian, Tie-Yan Liu, Li Zhao, Tao Qin, Yue Wang, Dongsheng Li, Yuqing Yang, and Xufang Luo
ICLR (International Conference on Learning Representations) (opens in new tab) is recognized as one of the top conferences in the field of deep learning. Many influential papers on artificial intelligence, statistics, and data science—as well as important application fields such…
In the news | AI – Cognitive Services Blog
New technical research is advancing Azure’s Neural Text-to-Speech service
Neural Text-to-Speech (Neural TTS), a powerful speech synthesis capability of Azure Cognitive Services, enables users to convert text to lifelike speech. It is used in various scenarios including voice assistant, content read-aloud capabilities, accessibility tools, and more. Azure Neural TTS…