Hearable devices with sound bubbles
Tuochao Chen, Malek Itani, Sefik Emre Eskimez, Takuya Yoshioka, Shyamnath Gollakota
Nature Electronics | November 2024, pp. 1-12
Publications
Publications by Year
-
An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS
Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Hemin Yang, Zirun Zhu, Min Tang, Yufei Xia, Jinzhu Li, sheng zhao , Jinyu Li, Naoyuki Kanda
Interspeech 2024 | September 2024
Knowledge boosting during low-latency inference
Tuochao Chen, Malek Itani, Vidya Srinivas, Sefik Emre Eskimez, Takuya Yoshioka, Shyamnath Gollakota
Interspeech 2024 | September 2024
Target conversation extraction: Source separation using turn-taking dynamics
Tuochao Chen, Qirui Wang, Bohan Wu, Malek Itani, Sefik Emre Eskimez, Takuya Yoshioka, Shyamnath Gollakota
Interspeech 2024 | September 2024
Total-Duration-Aware Duration Modeling for Text-to-Speech Systems
Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Jinyu Li, Sheng Zhao, Naoyuki Kanda
Interspeech 2024 | September 2024
-
SpeechX: Neural Codec Language Model as a Versatile Speech Transformer
Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka
August 2023
Real-Time Audio-Visual End-To-End Speech Enhancement
Zirun Zhu, Hemin Yang, Min Tang, Ziyi Yang, Sefik Emre Eskimez, Huaming Wang
2023 IEEE International Conference on Acoustics, Speech and Signal Processing | June 2023
-
Speech separation with large-scale self-supervised learning
Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
arXiv:2211.05172 | November 2022
Breaking the trade-off in personalized speech enhancement with cross-task knowledge distillation
Hassan Taherian, Sefik Emre Eskimez, Takuya Yoshioka
November 2022
Submitted to ICASSP 2023
Real-Time Joint Personalized Speech Enhancement and Acoustic Echo Cancellation with E3Net
Sefik Emre Eskimez, Takuya Yoshioka, Alex Ju, Min tang, Tanel Parnamaa, Huaming Wang
November 2022
Submitted to ICASSP 2023
Separating Long-Form Speech with Group-Wise Permutation Invariant Training
Wangyou Zhang, Zhuo Chen, Naoyuki Kanda, Shujie Liu, Jinyu Li, Sefik Emre Eskimez, Takuya Yoshioka, Xiong Xiao, Zhong Meng, Yanmin Qian, Furu Wei
Interspeech 2022 | September 2022
Fast Real-time Personalized Speech Enhancement: End-to-End Enhancement Network (E3Net) and Knowledge Distillation
Manthan Thakker, Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang
Interspeech 2022 | September 2022
Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation
Xiaofei Wang, Dongmei Wang, Naoyuki Kanda, Sefik Emre Eskimez, Takuya Yoshioka
INTERSPEECH 2022 | September 2022
One Model to Enhance Them All: Array Geometry Agnostic Multi-Channel Personalized Speech Enhancement
Hassan Taherian, Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Zhuo Chen, Xuedong Huang
ICASSP 2022 | May 2022
Personalized Speech Enhancement: New Models and Comprehensive Evaluation
Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Xiaofei Wang, Zhuo Chen, Xuedong Huang
ICASSP 2022 | May 2022
All-Neural Beamformer for Continuous Speech Separation
Zhuohuang Zhang, Takuya Yoshioka, Naoyuki Kanda, Zhuo Chen, Xiaofei Wang, Dongmei Wang, Sefik Emre Eskimez
ICASSP 2022 | May 2022
ICASSP 2022 Deep Noise Suppression Challenge
Harishchandra Dubey, Vishak Gopal, Ross Cutler, Ashkan Aazami, Sergiy Matusevych, Sebastian Braun, Sefik Emre Eskimez, Manthan Thakker, Takuya Yoshioka, Hannes Gamper, Robert Aichner
ICASSP | May 2022
-
Human Listening and Live Captioning: Multi-Task Training for Speech Enhancement
Sefik Emre Eskimez, Xiaofei Wang, Min Tang, Hemin Yang, Zirun Zhu, Zhuo Chen, Huaming Wang, Takuya Yoshioka
Interspeech 2021 | August 2021
One-Shot Voice Conversion with Speaker-Agnostic StarGAN
Sefik Emre Eskimez, Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr
INTERSPEECH 2022 | August 2021
-
Sequence-Level Self-Learning with Multiple Hypotheses
Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng
Interspeech | October 2020
A Federated Approach in Training Acoustic Models
Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez
INTERSPEECH 2020 | October 2020
GAN-based Data Generation for Speech Emotion Recognition
Sefik Emre Eskimez, Dimitrios Dimitriadis, Robert Gmyr, Kenichi Kumatani
INTERSPEECH 2020 | October 2020
Sequence-level self-learning with multi-task learning framework
Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng
October 2020
Federated Transfer Learning with Dynamic Gradient Aggregation
Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez
August 2020
End-To-End Generation of Talking Faces from Noisy Speech
Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan
ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | May 2020
Improving Readability for Automatic Speech Recognition Transcription
Junwei Liao, Yu Shi, Sefik Emre Eskimez, Liyang Lu, Ming Gong (YIMING), Linjun Shou (寿林钧), Hong Qu, Michael Zeng
arXiv:2004.04438 | April 2020
-
Noise-Resilient Training Method for Face Landmark Generation From Speech
Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan
IEEE/ACM Transactions on Audio, Speech, and Language Processing | October 2019, Vol 28: pp. 27-38
Speech Super Resolution Generative Adversarial Network
Sefik Emre Eskimez, Kazuhito Koishida
ICASSP 2019 | May 2019
Adversarial Training for Speech Super-Resolution
Sefik Emre Eskimez, Kazuhito Koishida, Zhiyao Duan
IEEE Journal of Selected Topics in Signal Processing | April 2019, Vol 13(2): pp. 347-358
-
Unsupervised Learning Approach to Feature Analysis for Automatic Speech Emotion Recognition
Sefik Emre Eskimez, Zhiyao Duan, Wendi Heinzelman
2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | September 2018
Generating Talking Face Landmarks from Speech
Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan
LVA/ICA 2018 | June 2018
Front-end speech enhancement for commercial speaker verification systems
Sefik Emre Eskimez (seeskime), Peter Soufleris, Zhiyao Duan, Wendi Heinzelman
Speech Communication | May 2018, Vol 99: pp. 101-113
-
WISE: Web-based Interactive Speech Emotion Classification
Sefik Emre Eskimez, Melissa Sturge-Apple, Zhiyao Duan, Wendi Heinzelman
International Joint Conferences on Artificial Intelligence | July 2016
Emotion classification: How does an automated system compare to Naive human coders?
Sefik Emre Eskimez, Kenneth Imade, Na Yang, Melissa Sturge-Apple, Zhiyao Duan, Wendi Heinzelman
2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | May 2016
Publications by Research Area
-
Hearable devices with sound bubbles
Tuochao Chen, Malek Itani, Sefik Emre Eskimez, Takuya Yoshioka, Shyamnath Gollakota
Nature Electronics | November 2024, pp. 1-12
Target conversation extraction: Source separation using turn-taking dynamics
Tuochao Chen, Qirui Wang, Bohan Wu, Malek Itani, Sefik Emre Eskimez, Takuya Yoshioka, Shyamnath Gollakota
Interspeech 2024 | September 2024
Knowledge boosting during low-latency inference
Tuochao Chen, Malek Itani, Vidya Srinivas, Sefik Emre Eskimez, Takuya Yoshioka, Shyamnath Gollakota
Interspeech 2024 | September 2024
Total-Duration-Aware Duration Modeling for Text-to-Speech Systems
Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Jinyu Li, Sheng Zhao, Naoyuki Kanda
Interspeech 2024 | September 2024
SpeechX: Neural Codec Language Model as a Versatile Speech Transformer
Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka
August 2023
Speech separation with large-scale self-supervised learning
Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
arXiv:2211.05172 | November 2022
Separating Long-Form Speech with Group-Wise Permutation Invariant Training
Wangyou Zhang, Zhuo Chen, Naoyuki Kanda, Shujie Liu, Jinyu Li, Sefik Emre Eskimez, Takuya Yoshioka, Xiong Xiao, Zhong Meng, Yanmin Qian, Furu Wei
Interspeech 2022 | September 2022
One Model to Enhance Them All: Array Geometry Agnostic Multi-Channel Personalized Speech Enhancement
Hassan Taherian, Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Zhuo Chen, Xuedong Huang
ICASSP 2022 | May 2022
Personalized Speech Enhancement: New Models and Comprehensive Evaluation
Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Xiaofei Wang, Zhuo Chen, Xuedong Huang
ICASSP 2022 | May 2022
Human Listening and Live Captioning: Multi-Task Training for Speech Enhancement
Sefik Emre Eskimez, Xiaofei Wang, Min Tang, Hemin Yang, Zirun Zhu, Zhuo Chen, Huaming Wang, Takuya Yoshioka
Interspeech 2021 | August 2021
One-Shot Voice Conversion with Speaker-Agnostic StarGAN
Sefik Emre Eskimez, Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr
INTERSPEECH 2022 | August 2021
Sequence-Level Self-Learning with Multiple Hypotheses
Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng
Interspeech | October 2020
Sequence-level self-learning with multi-task learning framework
Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng
October 2020
GAN-based Data Generation for Speech Emotion Recognition
Sefik Emre Eskimez, Dimitrios Dimitriadis, Robert Gmyr, Kenichi Kumatani
INTERSPEECH 2020 | October 2020
A Federated Approach in Training Acoustic Models
Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez
INTERSPEECH 2020 | October 2020
Federated Transfer Learning with Dynamic Gradient Aggregation
Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez
August 2020
End-To-End Generation of Talking Faces from Noisy Speech
Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan
ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | May 2020
Improving Readability for Automatic Speech Recognition Transcription
Junwei Liao, Yu Shi, Sefik Emre Eskimez, Liyang Lu, Ming Gong (YIMING), Linjun Shou (寿林钧), Hong Qu, Michael Zeng
arXiv:2004.04438 | April 2020
Noise-Resilient Training Method for Face Landmark Generation From Speech
Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan
IEEE/ACM Transactions on Audio, Speech, and Language Processing | October 2019, Vol 28: pp. 27-38
Unsupervised Learning Approach to Feature Analysis for Automatic Speech Emotion Recognition
Sefik Emre Eskimez, Zhiyao Duan, Wendi Heinzelman
2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | September 2018
Generating Talking Face Landmarks from Speech
Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan
LVA/ICA 2018 | June 2018
Front-end speech enhancement for commercial speaker verification systems
Sefik Emre Eskimez (seeskime), Peter Soufleris, Zhiyao Duan, Wendi Heinzelman
Speech Communication | May 2018, Vol 99: pp. 101-113
WISE: Web-based Interactive Speech Emotion Classification
Sefik Emre Eskimez, Melissa Sturge-Apple, Zhiyao Duan, Wendi Heinzelman
International Joint Conferences on Artificial Intelligence | July 2016
Emotion classification: How does an automated system compare to Naive human coders?
Sefik Emre Eskimez, Kenneth Imade, Na Yang, Melissa Sturge-Apple, Zhiyao Duan, Wendi Heinzelman
2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | May 2016
-
Hearable devices with sound bubbles
Tuochao Chen, Malek Itani, Sefik Emre Eskimez, Takuya Yoshioka, Shyamnath Gollakota
Nature Electronics | November 2024, pp. 1-12
Target conversation extraction: Source separation using turn-taking dynamics
Tuochao Chen, Qirui Wang, Bohan Wu, Malek Itani, Sefik Emre Eskimez, Takuya Yoshioka, Shyamnath Gollakota
Interspeech 2024 | September 2024
Knowledge boosting during low-latency inference
Tuochao Chen, Malek Itani, Vidya Srinivas, Sefik Emre Eskimez, Takuya Yoshioka, Shyamnath Gollakota
Interspeech 2024 | September 2024
Total-Duration-Aware Duration Modeling for Text-to-Speech Systems
Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Jinyu Li, Sheng Zhao, Naoyuki Kanda
Interspeech 2024 | September 2024
SpeechX: Neural Codec Language Model as a Versatile Speech Transformer
Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka
August 2023
Real-Time Audio-Visual End-To-End Speech Enhancement
Zirun Zhu, Hemin Yang, Min Tang, Ziyi Yang, Sefik Emre Eskimez, Huaming Wang
2023 IEEE International Conference on Acoustics, Speech and Signal Processing | June 2023
Speech separation with large-scale self-supervised learning
Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
arXiv:2211.05172 | November 2022
Breaking the trade-off in personalized speech enhancement with cross-task knowledge distillation
Hassan Taherian, Sefik Emre Eskimez, Takuya Yoshioka
November 2022
Submitted to ICASSP 2023
Real-Time Joint Personalized Speech Enhancement and Acoustic Echo Cancellation with E3Net
Sefik Emre Eskimez, Takuya Yoshioka, Alex Ju, Min tang, Tanel Parnamaa, Huaming Wang
November 2022
Submitted to ICASSP 2023
Separating Long-Form Speech with Group-Wise Permutation Invariant Training
Wangyou Zhang, Zhuo Chen, Naoyuki Kanda, Shujie Liu, Jinyu Li, Sefik Emre Eskimez, Takuya Yoshioka, Xiong Xiao, Zhong Meng, Yanmin Qian, Furu Wei
Interspeech 2022 | September 2022
Fast Real-time Personalized Speech Enhancement: End-to-End Enhancement Network (E3Net) and Knowledge Distillation
Manthan Thakker, Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang
Interspeech 2022 | September 2022
Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation
Xiaofei Wang, Dongmei Wang, Naoyuki Kanda, Sefik Emre Eskimez, Takuya Yoshioka
INTERSPEECH 2022 | September 2022
One Model to Enhance Them All: Array Geometry Agnostic Multi-Channel Personalized Speech Enhancement
Hassan Taherian, Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Zhuo Chen, Xuedong Huang
ICASSP 2022 | May 2022
Personalized Speech Enhancement: New Models and Comprehensive Evaluation
Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Xiaofei Wang, Zhuo Chen, Xuedong Huang
ICASSP 2022 | May 2022
ICASSP 2022 Deep Noise Suppression Challenge
Harishchandra Dubey, Vishak Gopal, Ross Cutler, Ashkan Aazami, Sergiy Matusevych, Sebastian Braun, Sefik Emre Eskimez, Manthan Thakker, Takuya Yoshioka, Hannes Gamper, Robert Aichner
ICASSP | May 2022
All-Neural Beamformer for Continuous Speech Separation
Zhuohuang Zhang, Takuya Yoshioka, Naoyuki Kanda, Zhuo Chen, Xiaofei Wang, Dongmei Wang, Sefik Emre Eskimez
ICASSP 2022 | May 2022
Human Listening and Live Captioning: Multi-Task Training for Speech Enhancement
Sefik Emre Eskimez, Xiaofei Wang, Min Tang, Hemin Yang, Zirun Zhu, Zhuo Chen, Huaming Wang, Takuya Yoshioka
Interspeech 2021 | August 2021
End-To-End Generation of Talking Faces from Noisy Speech
Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan
ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | May 2020
Improving Readability for Automatic Speech Recognition Transcription
Junwei Liao, Yu Shi, Sefik Emre Eskimez, Liyang Lu, Ming Gong (YIMING), Linjun Shou (寿林钧), Hong Qu, Michael Zeng
arXiv:2004.04438 | April 2020
Noise-Resilient Training Method for Face Landmark Generation From Speech
Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan
IEEE/ACM Transactions on Audio, Speech, and Language Processing | October 2019, Vol 28: pp. 27-38
Speech Super Resolution Generative Adversarial Network
Sefik Emre Eskimez, Kazuhito Koishida
ICASSP 2019 | May 2019
Adversarial Training for Speech Super-Resolution
Sefik Emre Eskimez, Kazuhito Koishida, Zhiyao Duan
IEEE Journal of Selected Topics in Signal Processing | April 2019, Vol 13(2): pp. 347-358
Unsupervised Learning Approach to Feature Analysis for Automatic Speech Emotion Recognition
Sefik Emre Eskimez, Zhiyao Duan, Wendi Heinzelman
2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | September 2018
Generating Talking Face Landmarks from Speech
Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan
LVA/ICA 2018 | June 2018
Front-end speech enhancement for commercial speaker verification systems
Sefik Emre Eskimez (seeskime), Peter Soufleris, Zhiyao Duan, Wendi Heinzelman
Speech Communication | May 2018, Vol 99: pp. 101-113
WISE: Web-based Interactive Speech Emotion Classification
Sefik Emre Eskimez, Melissa Sturge-Apple, Zhiyao Duan, Wendi Heinzelman
International Joint Conferences on Artificial Intelligence | July 2016
Emotion classification: How does an automated system compare to Naive human coders?
Sefik Emre Eskimez, Kenneth Imade, Na Yang, Melissa Sturge-Apple, Zhiyao Duan, Wendi Heinzelman
2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | May 2016
-
An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS
Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Hemin Yang, Zirun Zhu, Min Tang, Yufei Xia, Jinzhu Li, sheng zhao , Jinyu Li, Naoyuki Kanda
Interspeech 2024 | September 2024
SpeechX: Neural Codec Language Model as a Versatile Speech Transformer
Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka
August 2023
Speech separation with large-scale self-supervised learning
Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
arXiv:2211.05172 | November 2022
Separating Long-Form Speech with Group-Wise Permutation Invariant Training
Wangyou Zhang, Zhuo Chen, Naoyuki Kanda, Shujie Liu, Jinyu Li, Sefik Emre Eskimez, Takuya Yoshioka, Xiong Xiao, Zhong Meng, Yanmin Qian, Furu Wei
Interspeech 2022 | September 2022
Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation
Xiaofei Wang, Dongmei Wang, Naoyuki Kanda, Sefik Emre Eskimez, Takuya Yoshioka
INTERSPEECH 2022 | September 2022
All-Neural Beamformer for Continuous Speech Separation
Zhuohuang Zhang, Takuya Yoshioka, Naoyuki Kanda, Zhuo Chen, Xiaofei Wang, Dongmei Wang, Sefik Emre Eskimez
ICASSP 2022 | May 2022
Improving Readability for Automatic Speech Recognition Transcription
Junwei Liao, Yu Shi, Sefik Emre Eskimez, Liyang Lu, Ming Gong (YIMING), Linjun Shou (寿林钧), Hong Qu, Michael Zeng
arXiv:2004.04438 | April 2020
-
Real-Time Audio-Visual End-To-End Speech Enhancement
Zirun Zhu, Hemin Yang, Min Tang, Ziyi Yang, Sefik Emre Eskimez, Huaming Wang
2023 IEEE International Conference on Acoustics, Speech and Signal Processing | June 2023
End-To-End Generation of Talking Faces from Noisy Speech
Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan
ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | May 2020
Noise-Resilient Training Method for Face Landmark Generation From Speech
Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan
IEEE/ACM Transactions on Audio, Speech, and Language Processing | October 2019, Vol 28: pp. 27-38
Generating Talking Face Landmarks from Speech
Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan
LVA/ICA 2018 | June 2018
-
Sequence-level self-learning with multi-task learning framework
Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng
October 2020
Federated Transfer Learning with Dynamic Gradient Aggregation
Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez
August 2020
-
Sequence-level self-learning with multi-task learning framework
Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng
October 2020
GAN-based Data Generation for Speech Emotion Recognition
Sefik Emre Eskimez, Dimitrios Dimitriadis, Robert Gmyr, Kenichi Kumatani
INTERSPEECH 2020 | October 2020
A Federated Approach in Training Acoustic Models
Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez
INTERSPEECH 2020 | October 2020
Federated Transfer Learning with Dynamic Gradient Aggregation
Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez
August 2020
-
A Federated Approach in Training Acoustic Models
Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez
INTERSPEECH 2020 | October 2020
Federated Transfer Learning with Dynamic Gradient Aggregation
Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez
August 2020
Publications by Type
-
Hearable devices with sound bubbles
Tuochao Chen, Malek Itani, Sefik Emre Eskimez, Takuya Yoshioka, Shyamnath Gollakota
Nature Electronics | November 2024, pp. 1-12
SpeechX: Neural Codec Language Model as a Versatile Speech Transformer
Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda, Sefik Emre Eskimez, Sanyuan Chen, Min Tang, Shujie Liu, Jinyu Li, Takuya Yoshioka
August 2023
Speech separation with large-scale self-supervised learning
Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
arXiv:2211.05172 | November 2022
Noise-Resilient Training Method for Face Landmark Generation From Speech
Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan
IEEE/ACM Transactions on Audio, Speech, and Language Processing | October 2019, Vol 28: pp. 27-38
Adversarial Training for Speech Super-Resolution
Sefik Emre Eskimez, Kazuhito Koishida, Zhiyao Duan
IEEE Journal of Selected Topics in Signal Processing | April 2019, Vol 13(2): pp. 347-358
Front-end speech enhancement for commercial speaker verification systems
Sefik Emre Eskimez (seeskime), Peter Soufleris, Zhiyao Duan, Wendi Heinzelman
Speech Communication | May 2018, Vol 99: pp. 101-113
-
An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS
Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Hemin Yang, Zirun Zhu, Min Tang, Yufei Xia, Jinzhu Li, sheng zhao , Jinyu Li, Naoyuki Kanda
Interspeech 2024 | September 2024
Target conversation extraction: Source separation using turn-taking dynamics
Tuochao Chen, Qirui Wang, Bohan Wu, Malek Itani, Sefik Emre Eskimez, Takuya Yoshioka, Shyamnath Gollakota
Interspeech 2024 | September 2024
Knowledge boosting during low-latency inference
Tuochao Chen, Malek Itani, Vidya Srinivas, Sefik Emre Eskimez, Takuya Yoshioka, Shyamnath Gollakota
Interspeech 2024 | September 2024
Total-Duration-Aware Duration Modeling for Text-to-Speech Systems
Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Jinyu Li, Sheng Zhao, Naoyuki Kanda
Interspeech 2024 | September 2024
Real-Time Audio-Visual End-To-End Speech Enhancement
Zirun Zhu, Hemin Yang, Min Tang, Ziyi Yang, Sefik Emre Eskimez, Huaming Wang
2023 IEEE International Conference on Acoustics, Speech and Signal Processing | June 2023
Breaking the trade-off in personalized speech enhancement with cross-task knowledge distillation
Hassan Taherian, Sefik Emre Eskimez, Takuya Yoshioka
November 2022
Submitted to ICASSP 2023
Real-Time Joint Personalized Speech Enhancement and Acoustic Echo Cancellation with E3Net
Sefik Emre Eskimez, Takuya Yoshioka, Alex Ju, Min tang, Tanel Parnamaa, Huaming Wang
November 2022
Submitted to ICASSP 2023
Separating Long-Form Speech with Group-Wise Permutation Invariant Training
Wangyou Zhang, Zhuo Chen, Naoyuki Kanda, Shujie Liu, Jinyu Li, Sefik Emre Eskimez, Takuya Yoshioka, Xiong Xiao, Zhong Meng, Yanmin Qian, Furu Wei
Interspeech 2022 | September 2022
Fast Real-time Personalized Speech Enhancement: End-to-End Enhancement Network (E3Net) and Knowledge Distillation
Manthan Thakker, Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang
Interspeech 2022 | September 2022
Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation
Xiaofei Wang, Dongmei Wang, Naoyuki Kanda, Sefik Emre Eskimez, Takuya Yoshioka
INTERSPEECH 2022 | September 2022
One Model to Enhance Them All: Array Geometry Agnostic Multi-Channel Personalized Speech Enhancement
Hassan Taherian, Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Zhuo Chen, Xuedong Huang
ICASSP 2022 | May 2022
Personalized Speech Enhancement: New Models and Comprehensive Evaluation
Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Xiaofei Wang, Zhuo Chen, Xuedong Huang
ICASSP 2022 | May 2022
ICASSP 2022 Deep Noise Suppression Challenge
Harishchandra Dubey, Vishak Gopal, Ross Cutler, Ashkan Aazami, Sergiy Matusevych, Sebastian Braun, Sefik Emre Eskimez, Manthan Thakker, Takuya Yoshioka, Hannes Gamper, Robert Aichner
ICASSP | May 2022
All-Neural Beamformer for Continuous Speech Separation
Zhuohuang Zhang, Takuya Yoshioka, Naoyuki Kanda, Zhuo Chen, Xiaofei Wang, Dongmei Wang, Sefik Emre Eskimez
ICASSP 2022 | May 2022
Human Listening and Live Captioning: Multi-Task Training for Speech Enhancement
Sefik Emre Eskimez, Xiaofei Wang, Min Tang, Hemin Yang, Zirun Zhu, Zhuo Chen, Huaming Wang, Takuya Yoshioka
Interspeech 2021 | August 2021
One-Shot Voice Conversion with Speaker-Agnostic StarGAN
Sefik Emre Eskimez, Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr
INTERSPEECH 2022 | August 2021
Sequence-Level Self-Learning with Multiple Hypotheses
Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng
Interspeech | October 2020
GAN-based Data Generation for Speech Emotion Recognition
Sefik Emre Eskimez, Dimitrios Dimitriadis, Robert Gmyr, Kenichi Kumatani
INTERSPEECH 2020 | October 2020
A Federated Approach in Training Acoustic Models
Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez
INTERSPEECH 2020 | October 2020
End-To-End Generation of Talking Faces from Noisy Speech
Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan
ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | May 2020
Improving Readability for Automatic Speech Recognition Transcription
Junwei Liao, Yu Shi, Sefik Emre Eskimez, Liyang Lu, Ming Gong (YIMING), Linjun Shou (寿林钧), Hong Qu, Michael Zeng
arXiv:2004.04438 | April 2020
Speech Super Resolution Generative Adversarial Network
Sefik Emre Eskimez, Kazuhito Koishida
ICASSP 2019 | May 2019
Unsupervised Learning Approach to Feature Analysis for Automatic Speech Emotion Recognition
Sefik Emre Eskimez, Zhiyao Duan, Wendi Heinzelman
2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | September 2018
Generating Talking Face Landmarks from Speech
Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, Zhiyao Duan
LVA/ICA 2018 | June 2018
WISE: Web-based Interactive Speech Emotion Classification
Sefik Emre Eskimez, Melissa Sturge-Apple, Zhiyao Duan, Wendi Heinzelman
International Joint Conferences on Artificial Intelligence | July 2016
Emotion classification: How does an automated system compare to Naive human coders?
Sefik Emre Eskimez, Kenneth Imade, Na Yang, Melissa Sturge-Apple, Zhiyao Duan, Wendi Heinzelman
2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | May 2016
-
Federated Transfer Learning with Dynamic Gradient Aggregation
Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez
August 2020
-
Sequence-level self-learning with multi-task learning framework
Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng
October 2020