Learning Audio-Visual Speech Representation by Masked Multimodal Cluster PredictionBowen Shi, Wei-Ning Hsu, Kushal Lakhotia +1 moreeess.AS · January 2022 · cited 523× · arXiv ↗ · save
Robust Self-Supervised Audio-Visual Speech RecognitionBowen Shi, Wei-Ning Hsu, Abdelrahman Mohamedcs.SD · January 2022 · cited 133× · arXiv ↗ · save
Is Lip Region-of-Interest Sufficient for Lipreading?Jing-Xuan Zhang, Gen-Shun Wan, Jia Pancs.CV · May 2022 · cited 8× · arXiv ↗ · save
Learning Lip-Based Audio-Visual Speaker Embeddings with AV-HuBERTBowen Shi, Abdelrahman Mohamed, Wei-Ning Hsueess.AS · May 2022 · cited 24× · arXiv ↗ · save
u-HuBERT: Unified Mixed-Modal Speech Pretraining And Zero-Shot Transfer to Unlabeled ModalityWei-Ning Hsu, Bowen Shics.CL · July 2022 · cited 58× · arXiv ↗ · save
Learning Audio-Visual Speech Representation by Masked Multimodal Cluster PredictionBowen Shi, Wei-Ning Hsu, Kushal Lakhotia +1 moreeess.AS · January 2022 · cited 523× · arXiv ↗ · save
Robust Self-Supervised Audio-Visual Speech RecognitionBowen Shi, Wei-Ning Hsu, Abdelrahman Mohamedcs.SD · January 2022 · cited 133× · arXiv ↗ · save
VATLM: Visual-Audio-Text Pre-Training with Unified Masked Prediction for Speech Representation LearningQiushi Zhu, Long Zhou, Ziqiang Zhang +7 moreeess.AS · November 2022 · cited 64× · arXiv ↗ · save
u-HuBERT: Unified Mixed-Modal Speech Pretraining And Zero-Shot Transfer to Unlabeled ModalityWei-Ning Hsu, Bowen Shics.CL · July 2022 · cited 58× · arXiv ↗ · save
Learning Lip-Based Audio-Visual Speaker Embeddings with AV-HuBERTBowen Shi, Abdelrahman Mohamed, Wei-Ning Hsueess.AS · May 2022 · cited 24× · arXiv ↗ · save
From Spectrograms to Shallow Speech SSL: Audio-Frontend Design for Generator-Disjoint and Low-Latency Audio--Visual Deepfake DetectionQiwu Wen, Jahangir Alam, Eric Chartoncs.SD · 16 Oct 2026 · cited 0× · arXiv ↗ · save
Optimal Transport-based Semantic Alignment for LLM-based Audio-Visual Speech RecognitionXugang Lu, Peng Shen, Yu Tsao +1 morecs.SD · July 2026 · arXiv ↗ · save
BUT System Description for CHiME-9 MCoRec ChallengeDominik Klement, Alexander Polok, Nguyen Hai Phong +2 moreeess.AS · 30 Apr 2026 · arXiv ↗ · save
VisG AV-HuBERT: Viseme-Guided AV-HuBERTAristeidis Papadopoulos, Rishabh Jain, Naomi Harteeess.AS · April 2026 · arXiv ↗ · save
Bootstrapping Audiovisual Speech Recognition in Zero-AV-Resource ScenariosPol Buitrago, Javier Hernandoeess.AS · 9 Mar 2026 · arXiv ↗ · save