Online Video Super-Resolution with Convolutional Kernel Bypass Graft
Jun Xiao, Xinyang Jiang, Ningxin Zheng, Huan Yang, Yifan Yang, Yuqing Yang, Dongsheng Li, Kin-Man Lam
IEEE Transactions on Multimedia | February 2023
Publications
Publications by Year
-
-
MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation
Ludan Ruan, Yiyang Ma, Huan Yang, Huiguo He, Bei Liu, Jianlong Fu, Nicholas Jing Yuan, Qin Jin, Baining Guo
arXiv | December 2022
Fine-Grained Image Style Transfer with Visual Transformers
Jianbo Wang, Huan Yang, Jianlong Fu, Toshihiko Yamasaki, Baining Guo
ACCV 2022 | December 2022
Long-Form Video-Language Pre-Training with Multimodal Temporal Contrastive Learning
Yuchong Sun, Hongwei Xue, Ruihua Song, Bei Liu, Huan Yang, Jianlong Fu
NeurIPS 2022 | November 2022
Learning Spatiotemporal Frequency-Transformer for Compressed Video Super-Resolution
Zhongwei Qiu, Huan Yang, Jianlong Fu, Dongmei Fu
ECCV 2022 | October 2022
AI Illustrator: Translating Raw Descriptions into Images by Prompt-based Cross-Modal Generation
Yiyang Ma, Huan Yang, Bei Liu, Jianlong Fu, Jiaying Liu
ACM Multimedia 2022 | October 2022
Oral
4D LUT: Learnable Context-Aware 4D Lookup Table for Image Enhancement
Chengxu Liu, Huan Yang, Jianlong Fu, Xueming Qian
arXiv | September 2022
Rethinking Image and Video Restoration: An Industrial Perspective
Huan Yang
CTSoc-NCT | September 2022
Language-Guided Face Animation by Recurrent StyleGAN-based Generator
Tiankai Hang, Huan Yang, Bei Liu, Jianlong Fu, Xin Geng, Baining Guo
arXiv | August 2022
Degradation-Guided Meta-Restoration Network for Blind Super-Resolution
Fuzhi Yang, Huan Yang, Yanhong Zeng, Jianlong Fu, Hongtao Lu
arXiv | July 2022
Learning Trajectory-Aware Transformer for Video Frame Interpolation
Chengxu Liu, Huan Yang, Jianlong Fu, Xueming Qian
arXiv | July 2022
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions
Hongwei Xue, Tiankai Hang, Yanhong Zeng, Yuchong Sun, Bei Liu, Huan Yang, Jianlong Fu, Baining Guo
CVPR 2022 | June 2022
Learning Trajectory-Aware Transformer for Video Super-Resolution
Chengxu Liu, Huan Yang, Jianlong Fu, Xueming Qian
CVPR 2022 | June 2022
Oral
-
Improving Visual Quality of Image Synthesis by A Token-based Generator with Transformers
Yanhong Zeng, Huan Yang, Hongyang Chao, Jianbo Wang, Jianlong Fu
NeurIPS 2021 | December 2021
Learning Fine-Grained Motion Embedding for Landscape Animation
Hongwei Xue, Bei Liu, Huan Yang, Jianlong Fu, Houqiang Li, Jiebo Luo
ACM Multimedia 2021 | October 2021
Oral
A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation
Yupan Huang, Bei Liu, Jianlong Fu, Yutong Lu
ACM Multimedia 2021 | October 2021
Unifying multimodal transformer for bi-directional image and text generation
Yupan Huang, Hongwei Xue, Bei Liu, Yutong Lu
ACM Multimedia 2021 | October 2021
Domain-Aware Universal Style Transfer
Kibeom Hong, Seogkyu Jeon, Huan Yang, Jianlong Fu, Hyeran Byun
ICCV 2021 | October 2021
Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessment
Heliang Zheng, Huan Yang, Jianlong Fu, Zheng-Jun Zha, Jiebo Luo
ICCV 2021 | October 2021
MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding
Bei Liu, Jianlong Fu, Shizhe Chen, Qin Jin, Alexander Hauptmann, Yong Rui
ICMR 2021 | August 2021
Reference-Based Defect Detection Network
Zhaoyang Zeng, Bei Liu, Jianlong Fu, Hongyang Chao
IEEE Transactions on Image Processing | July 2021, Vol 30: pp. 6637-6647
Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
Zhicheng Huang*, Zhaoyang Zeng*, Yupan Huang*, Bei Liu, Dongmei Fu, Jianlong Fu
CVPR 2021 | June 2021
Oral
-
Learning Texture Transformer Network for Image Super-Resolution
Fuzhi Yang, Huan Yang, Jianlong Fu, Hongtao Lu, Baining Guo
CVPR 2020 | June 2020
Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers
Zhicheng Huang*, Zhaoyang Zeng*, Bei Liu, Dongmei Fu, Jianlong Fu
MSR-TR-2020-51 | April 2020
Published by Microsoft
-
Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences
Shizhe Chen, Bei Liu, Jianlong Fu, Ruihua Song, Qin Jin, Pingping Lin, Xiaoyu Qi, Chunting Wang, Jin Zhou
ACM Multimedia | October 2019
Emotion Reinforced Visual Storytelling
Nanxing Li, Bei Liu, Zhizhong Han, Yu-Shen Liu, Jianlong Fu
ICMR | June 2019
Learning Rich Image Region Representation for Visual Question Answering
Bei Liu, Zhicheng Huang, Zhaoyang Zeng, Zheyu Chen, Jianlong Fu
MSR-TR-2020-1 | June 2019
Published by Microsoft
CVPR 2019, VQA Workshop
-
Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training
Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa
2018 ACM Multimedia | October 2018
Best Paper Award
-
Boosting-Based Multimodal Speaker Detection for Distributed Meeting Videos
Cha Zhang, Pei Yin, Yong Rui, Ross Cutler, Paul Viola, Xinding Sun, Nelson Pinto, Zhengyou Zhang
IEEE Transactions on Multimedia | August 2008, pp. 1541-1552
Publications by Research Area
-
Online Video Super-Resolution with Convolutional Kernel Bypass Graft
Jun Xiao, Xinyang Jiang, Ningxin Zheng, Huan Yang, Yifan Yang, Yuqing Yang, Dongsheng Li, Kin-Man Lam
IEEE Transactions on Multimedia | February 2023
MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation
Ludan Ruan, Yiyang Ma, Huan Yang, Huiguo He, Bei Liu, Jianlong Fu, Nicholas Jing Yuan, Qin Jin, Baining Guo
arXiv | December 2022
Fine-Grained Image Style Transfer with Visual Transformers
Jianbo Wang, Huan Yang, Jianlong Fu, Toshihiko Yamasaki, Baining Guo
ACCV 2022 | December 2022
Learning Spatiotemporal Frequency-Transformer for Compressed Video Super-Resolution
Zhongwei Qiu, Huan Yang, Jianlong Fu, Dongmei Fu
ECCV 2022 | October 2022
AI Illustrator: Translating Raw Descriptions into Images by Prompt-based Cross-Modal Generation
Yiyang Ma, Huan Yang, Bei Liu, Jianlong Fu, Jiaying Liu
ACM Multimedia 2022 | October 2022
Oral
Rethinking Image and Video Restoration: An Industrial Perspective
Huan Yang
CTSoc-NCT | September 2022
4D LUT: Learnable Context-Aware 4D Lookup Table for Image Enhancement
Chengxu Liu, Huan Yang, Jianlong Fu, Xueming Qian
arXiv | September 2022
Language-Guided Face Animation by Recurrent StyleGAN-based Generator
Tiankai Hang, Huan Yang, Bei Liu, Jianlong Fu, Xin Geng, Baining Guo
arXiv | August 2022
Learning Trajectory-Aware Transformer for Video Frame Interpolation
Chengxu Liu, Huan Yang, Jianlong Fu, Xueming Qian
arXiv | July 2022
Degradation-Guided Meta-Restoration Network for Blind Super-Resolution
Fuzhi Yang, Huan Yang, Yanhong Zeng, Jianlong Fu, Hongtao Lu
arXiv | July 2022
Learning Trajectory-Aware Transformer for Video Super-Resolution
Chengxu Liu, Huan Yang, Jianlong Fu, Xueming Qian
CVPR 2022 | June 2022
Oral
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions
Hongwei Xue, Tiankai Hang, Yanhong Zeng, Yuchong Sun, Bei Liu, Huan Yang, Jianlong Fu, Baining Guo
CVPR 2022 | June 2022
Improving Visual Quality of Image Synthesis by A Token-based Generator with Transformers
Yanhong Zeng, Huan Yang, Hongyang Chao, Jianbo Wang, Jianlong Fu
NeurIPS 2021 | December 2021
Learning Fine-Grained Motion Embedding for Landscape Animation
Hongwei Xue, Bei Liu, Huan Yang, Jianlong Fu, Houqiang Li, Jiebo Luo
ACM Multimedia 2021 | October 2021
Oral
Unifying multimodal transformer for bi-directional image and text generation
Yupan Huang, Hongwei Xue, Bei Liu, Yutong Lu
ACM Multimedia 2021 | October 2021
A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation
Yupan Huang, Bei Liu, Jianlong Fu, Yutong Lu
ACM Multimedia 2021 | October 2021
Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessment
Heliang Zheng, Huan Yang, Jianlong Fu, Zheng-Jun Zha, Jiebo Luo
ICCV 2021 | October 2021
Domain-Aware Universal Style Transfer
Kibeom Hong, Seogkyu Jeon, Huan Yang, Jianlong Fu, Hyeran Byun
ICCV 2021 | October 2021
MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding
Bei Liu, Jianlong Fu, Shizhe Chen, Qin Jin, Alexander Hauptmann, Yong Rui
ICMR 2021 | August 2021
Reference-Based Defect Detection Network
Zhaoyang Zeng, Bei Liu, Jianlong Fu, Hongyang Chao
IEEE Transactions on Image Processing | July 2021, Vol 30: pp. 6637-6647
Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
Zhicheng Huang*, Zhaoyang Zeng*, Yupan Huang*, Bei Liu, Dongmei Fu, Jianlong Fu
CVPR 2021 | June 2021
Oral
Learning Texture Transformer Network for Image Super-Resolution
Fuzhi Yang, Huan Yang, Jianlong Fu, Hongtao Lu, Baining Guo
CVPR 2020 | June 2020
Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers
Zhicheng Huang*, Zhaoyang Zeng*, Bei Liu, Dongmei Fu, Jianlong Fu
MSR-TR-2020-51 | April 2020
Published by Microsoft
Learning Rich Image Region Representation for Visual Question Answering
Bei Liu, Zhicheng Huang, Zhaoyang Zeng, Zheyu Chen, Jianlong Fu
MSR-TR-2020-1 | June 2019
Published by Microsoft
CVPR 2019, VQA Workshop
Boosting-Based Multimodal Speaker Detection for Distributed Meeting Videos
Cha Zhang, Pei Yin, Yong Rui, Ross Cutler, Paul Viola, Xinding Sun, Nelson Pinto, Zhengyou Zhang
IEEE Transactions on Multimedia | August 2008, pp. 1541-1552
-
Long-Form Video-Language Pre-Training with Multimodal Temporal Contrastive Learning
Yuchong Sun, Hongwei Xue, Ruihua Song, Bei Liu, Huan Yang, Jianlong Fu
NeurIPS 2022 | November 2022
Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
Zhicheng Huang*, Zhaoyang Zeng*, Yupan Huang*, Bei Liu, Dongmei Fu, Jianlong Fu
CVPR 2021 | June 2021
Oral
Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers
Zhicheng Huang*, Zhaoyang Zeng*, Bei Liu, Dongmei Fu, Jianlong Fu
MSR-TR-2020-51 | April 2020
Published by Microsoft
Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences
Shizhe Chen, Bei Liu, Jianlong Fu, Ruihua Song, Qin Jin, Pingping Lin, Xiaoyu Qi, Chunting Wang, Jin Zhou
ACM Multimedia | October 2019
Learning Rich Image Region Representation for Visual Question Answering
Bei Liu, Zhicheng Huang, Zhaoyang Zeng, Zheyu Chen, Jianlong Fu
MSR-TR-2020-1 | June 2019
Published by Microsoft
CVPR 2019, VQA Workshop
Emotion Reinforced Visual Storytelling
Nanxing Li, Bei Liu, Zhizhong Han, Yu-Shen Liu, Jianlong Fu
ICMR | June 2019
Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training
Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa
2018 ACM Multimedia | October 2018
Best Paper Award
-
Learning Fine-Grained Motion Embedding for Landscape Animation
Hongwei Xue, Bei Liu, Huan Yang, Jianlong Fu, Houqiang Li, Jiebo Luo
ACM Multimedia 2021 | October 2021
Oral
Unifying multimodal transformer for bi-directional image and text generation
Yupan Huang, Hongwei Xue, Bei Liu, Yutong Lu
ACM Multimedia 2021 | October 2021
A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation
Yupan Huang, Bei Liu, Jianlong Fu, Yutong Lu
ACM Multimedia 2021 | October 2021
MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding
Bei Liu, Jianlong Fu, Shizhe Chen, Qin Jin, Alexander Hauptmann, Yong Rui
ICMR 2021 | August 2021
Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences
Shizhe Chen, Bei Liu, Jianlong Fu, Ruihua Song, Qin Jin, Pingping Lin, Xiaoyu Qi, Chunting Wang, Jin Zhou
ACM Multimedia | October 2019
Emotion Reinforced Visual Storytelling
Nanxing Li, Bei Liu, Zhizhong Han, Yu-Shen Liu, Jianlong Fu
ICMR | June 2019
Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training
Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa
2018 ACM Multimedia | October 2018
Best Paper Award
-
Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training
Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa
2018 ACM Multimedia | October 2018
Best Paper Award
-
Boosting-Based Multimodal Speaker Detection for Distributed Meeting Videos
Cha Zhang, Pei Yin, Yong Rui, Ross Cutler, Paul Viola, Xinding Sun, Nelson Pinto, Zhengyou Zhang
IEEE Transactions on Multimedia | August 2008, pp. 1541-1552
Publications by Type
-
MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation
Ludan Ruan, Yiyang Ma, Huan Yang, Huiguo He, Bei Liu, Jianlong Fu, Nicholas Jing Yuan, Qin Jin, Baining Guo
arXiv | December 2022
Fine-Grained Image Style Transfer with Visual Transformers
Jianbo Wang, Huan Yang, Jianlong Fu, Toshihiko Yamasaki, Baining Guo
ACCV 2022 | December 2022
Long-Form Video-Language Pre-Training with Multimodal Temporal Contrastive Learning
Yuchong Sun, Hongwei Xue, Ruihua Song, Bei Liu, Huan Yang, Jianlong Fu
NeurIPS 2022 | November 2022
Learning Spatiotemporal Frequency-Transformer for Compressed Video Super-Resolution
Zhongwei Qiu, Huan Yang, Jianlong Fu, Dongmei Fu
ECCV 2022 | October 2022
AI Illustrator: Translating Raw Descriptions into Images by Prompt-based Cross-Modal Generation
Yiyang Ma, Huan Yang, Bei Liu, Jianlong Fu, Jiaying Liu
ACM Multimedia 2022 | October 2022
Oral
4D LUT: Learnable Context-Aware 4D Lookup Table for Image Enhancement
Chengxu Liu, Huan Yang, Jianlong Fu, Xueming Qian
arXiv | September 2022
Language-Guided Face Animation by Recurrent StyleGAN-based Generator
Tiankai Hang, Huan Yang, Bei Liu, Jianlong Fu, Xin Geng, Baining Guo
arXiv | August 2022
Learning Trajectory-Aware Transformer for Video Frame Interpolation
Chengxu Liu, Huan Yang, Jianlong Fu, Xueming Qian
arXiv | July 2022
Degradation-Guided Meta-Restoration Network for Blind Super-Resolution
Fuzhi Yang, Huan Yang, Yanhong Zeng, Jianlong Fu, Hongtao Lu
arXiv | July 2022
Learning Trajectory-Aware Transformer for Video Super-Resolution
Chengxu Liu, Huan Yang, Jianlong Fu, Xueming Qian
CVPR 2022 | June 2022
Oral
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions
Hongwei Xue, Tiankai Hang, Yanhong Zeng, Yuchong Sun, Bei Liu, Huan Yang, Jianlong Fu, Baining Guo
CVPR 2022 | June 2022
Improving Visual Quality of Image Synthesis by A Token-based Generator with Transformers
Yanhong Zeng, Huan Yang, Hongyang Chao, Jianbo Wang, Jianlong Fu
NeurIPS 2021 | December 2021
Learning Fine-Grained Motion Embedding for Landscape Animation
Hongwei Xue, Bei Liu, Huan Yang, Jianlong Fu, Houqiang Li, Jiebo Luo
ACM Multimedia 2021 | October 2021
Oral
Unifying multimodal transformer for bi-directional image and text generation
Yupan Huang, Hongwei Xue, Bei Liu, Yutong Lu
ACM Multimedia 2021 | October 2021
A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation
Yupan Huang, Bei Liu, Jianlong Fu, Yutong Lu
ACM Multimedia 2021 | October 2021
Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessment
Heliang Zheng, Huan Yang, Jianlong Fu, Zheng-Jun Zha, Jiebo Luo
ICCV 2021 | October 2021
Domain-Aware Universal Style Transfer
Kibeom Hong, Seogkyu Jeon, Huan Yang, Jianlong Fu, Hyeran Byun
ICCV 2021 | October 2021
MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding
Bei Liu, Jianlong Fu, Shizhe Chen, Qin Jin, Alexander Hauptmann, Yong Rui
ICMR 2021 | August 2021
Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
Zhicheng Huang*, Zhaoyang Zeng*, Yupan Huang*, Bei Liu, Dongmei Fu, Jianlong Fu
CVPR 2021 | June 2021
Oral
Learning Texture Transformer Network for Image Super-Resolution
Fuzhi Yang, Huan Yang, Jianlong Fu, Hongtao Lu, Baining Guo
CVPR 2020 | June 2020
Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences
Shizhe Chen, Bei Liu, Jianlong Fu, Ruihua Song, Qin Jin, Pingping Lin, Xiaoyu Qi, Chunting Wang, Jin Zhou
ACM Multimedia | October 2019
Emotion Reinforced Visual Storytelling
Nanxing Li, Bei Liu, Zhizhong Han, Yu-Shen Liu, Jianlong Fu
ICMR | June 2019
Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training
Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa
2018 ACM Multimedia | October 2018
Best Paper Award
-
Online Video Super-Resolution with Convolutional Kernel Bypass Graft
Jun Xiao, Xinyang Jiang, Ningxin Zheng, Huan Yang, Yifan Yang, Yuqing Yang, Dongsheng Li, Kin-Man Lam
IEEE Transactions on Multimedia | February 2023
Rethinking Image and Video Restoration: An Industrial Perspective
Huan Yang
CTSoc-NCT | September 2022
Reference-Based Defect Detection Network
Zhaoyang Zeng, Bei Liu, Jianlong Fu, Hongyang Chao
IEEE Transactions on Image Processing | July 2021, Vol 30: pp. 6637-6647
Boosting-Based Multimodal Speaker Detection for Distributed Meeting Videos
Cha Zhang, Pei Yin, Yong Rui, Ross Cutler, Paul Viola, Xinding Sun, Nelson Pinto, Zhengyou Zhang
IEEE Transactions on Multimedia | August 2008, pp. 1541-1552
-
Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers
Zhicheng Huang*, Zhaoyang Zeng*, Bei Liu, Dongmei Fu, Jianlong Fu
MSR-TR-2020-51 | April 2020
Published by Microsoft
Learning Rich Image Region Representation for Visual Question Answering
Bei Liu, Zhicheng Huang, Zhaoyang Zeng, Zheyu Chen, Jianlong Fu
MSR-TR-2020-1 | June 2019
Published by Microsoft
CVPR 2019, VQA Workshop
People
Qi Dai
Senior Researcher
Jianlong Fu
Senior Research Manager
Bei Liu
Senior Researcher
Kai Qiu
Researcher