Hi there, I'm Yu Zhang (张彧) 
Research Scientist at ByteDance
Multi-Modal Generative AI · Speech · Spatial Audio · Singing Voice
I am Yu Zhang (张彧). Now, I am a Research Scientist at ByteDance. If you are seeking any form of academic cooperation, please feel free to email me at aaron9834@icloud.com.
I earned my PhD in the College of Computer Science and Technology, Zhejiang University (浙江大学计算机科学与技术学院), under the supervision of Prof. Zhou Zhao (赵洲). Previously, I graduated from Chu Kochen Honors College, Zhejiang University (浙江大学竺可桢学院), with dual bachelor's degrees in Computer Science and Automation. I have also served as a visiting scholar at University of Rochester with Prof. Zhiyao Duan and University of Massachusetts Amherst with Prof. Przemyslaw Grabowicz.
My research interests primarily focus on Multi-Modal Generative AI, specifically in Speech, Spatial Audio, and Singing Voice. I have published 10+ first-author papers at top international AI conferences, such as NeurIPS, ICML, and ACL.
*denotes co-first authors
Technique ReportSwanTale: Unified Multi-Speaker Speech and Audio Generation for Instruct and Zero-Shot Tasks, Yu Zhang, Ruiqi Li, Changhao Pan, et al.Technique ReportSwanVoice: Expressive Long-Form Zero-Shot Speech Synthesis for Both Monologue and Dialogue, Ruiqi Li*, Yu Zhang*, Changhao Pan, et al.ASRU 2025Conan: A Chunkwise Online Network for Zero-Shot Adaptive Voice Conversion, Yu Zhang, Baotong Tian, Zhiyao Duan.
ACM-MM 2025ISDrama: Immersive Spatial Drama Generation through Multimodal Prompting, Yu Zhang, Wenxiang Guo, Changhao Pan, et al.ICML 2026Towards Streaming Synchronized Spatial Audio Generation via Autoregressive Diffusion Transformer, Ke Lei*, Yu Zhang*, Changhao Pan, et al.IJCNLP-AACL 2025ASAudio: A Survey of Advanced Spatial Audio Research, Zhiyuan Zhu*, Yu Zhang*, Wenxiang Guo, et al.ACM-MM 2025A Multimodal Evaluation Framework for Spatial Audio Playback Systems: From Localization to Listener Preference, Changhao Pan*, Wenxiang Guo*, Yu Zhang*, et al.EMNLP 2026One-Stage Multi-Task Instruction-Guided 3D Spatial Audio Editing, Ke Lei*, Chenyuhao Wen*, Yu Zhang*, et al.NeurIPS 2025MRSAudio: A Large-Scale Multimodal Recorded Spatial Audio Dataset with Refined Annotations, Wenxiang Guo*, Changhao Pan*, Zhiyuan Zhu*, Xintong Hu*, Yu Zhang*, et al.
NeurIPS 2024 SpotlightGTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Tasks, Yu Zhang, Changhao Pan, Wenxinag Guo, et al.EMNLP 2025Versatile Framework for Song Generation with Prompt-based Control, Yu Zhang, Wenxiang Guo, Changhao Pan, et al.ACL 2025TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesis, Yu Zhang, Wenxiang Guo, Changhao Pan, et al.EMNLP 2024TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control, Yu Zhang, Ziyue Jiang, Ruiqi Li, et al.AAAI 2024StyleSinger: Style Transfer for Out-of-Domain Singing Voice Synthesis, Yu Zhang, Rongjie Huang, Ruiqi Li, et al.ACL 2025STARS: A Unified Framework for Singing Transcription, Alignment, and Refined Style Annotation, Wenxiang Guo*, Yu Zhang*, Changhao Pan, et al.
