sample

Mengyue WU 吴梦玥

Digital Mental Health and Auditory Analysis


Hi hi! This is Mengyue 梦玥 [IPA:[məŋ4 y̯ɛ4], both high falling tones], interested in everything about human speech and perception/production. Specifically, my current research mainly lies on Rich Audio Analysis, though I always reckon this is an invented term. It does not have a definition per se, however I refer it to everything in audio processing excluding speech recognition. I'd like to stick to it - my very first student (co-supervised PhD, Heinrich) at SJTU has a funny username "richman" and my very first learned French sentence is "Je suis riche" (pls blame Duolingo for boosting our ego)!

Due to work requirements (probably only existing in my head), I'll present a very official biography below.
However just feel free to drop me a line if you share any similar interests/curiosity towards audio/acoustics/language/psychology/psychiatry/neuroscience etc.
Have a chat - should be fun (not guaranteed on your side)!

Basics 



Associate Professor, PhD Supervisor

X-LANCE LAB

Department of Computer Science and Engineering

Shanghai Jiao Tong University

Address : 3-543 SEIEE Building, 800 Dongchuan Road, Shanghai 200240, China

Email : mengyuewu@sjtu.edu.cn

 

Research



SJTU X-LANCE Lab 上海交通大学跨媒体语言智能实验室丰富音频研究组

Environment Sound

Human Speech: Medical Application

Digital Mental Health: Text and Dialogue

Open-Sourced Data and Models

Publications


Selected Papers. Full list please see my Google Scholar

  1. Siyu Lou, Xuenan Xu, Mengyue Wu and Kai Yu. Audio-Text Retrieval in Context. ICASSP'22, syl92-lou-icassp22.pdf
  2. Xuenan Xu, Mengyue Wu and Kai Yu. Diversity-controllable and Accurate Audio Captioning Based on Neural Condition. ICASSP'22, xnx98-xu-icassp22.pdf
  3. Wen Wu, Mengyue Wu and Kai Yu. Climate and Weather: Inspecting Depression Detection via Emotion Recognition. ICASSP'22, myw19-wu-icassp22-1.pdf
  4. Zhiling Zhang, Siyuan Chen, Mengyue Wu, Kenny Zhu. Psychiatric Scale Guided Risky Post Screening for Early Detection of Depression. IJCAI'22, syc20-chen-ijcai22.pdf
  5. Pingyue Zhang, Mengyue Wu, Heinrich Dinkel and Kai Yu. DEPA: Self-Supervised Audio Embedding for Depression Detection. ACM-MM'21, myw19-wu-mm2021.pdf
  6. Heinrich Dinkel, Mengyue Wu and Kai Yu. Towards Duration Robust Weakly Supervised Sound Event Detection. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2021, hedi7-dinkel-taslp2021.pdf
  7. Mengyue Wu, Heinrich Dinkel and Kai Yu. Audio Caption: Listen and Tell. ICASSP'19, myw19-wu-icassp2019.pdf

Teaching



AI3611 Deep Learning: A Practical Course on Perception and Cognition

CS3309 Computer Ethics - A newly-designed course covering AI ethics, fairness, bias, etc.

GE6001 Scientific Writing, Integrity and Ethics - A compulsory course for graduate students, I renovated the course and basically talked about how academia works. Comment from students:" thought would be boring, but turned out super practical and fun"

Students(Booming in progress)



Current Students

Xuenan Xu, PhD Candidate, graduate in 2025. Audio understanding and generation.

Kunyao Lan, PhD Candidate. Digital mental health.

Xiujie Song, Co-advised PhD Candidate. Cognitive function evaluation and its application in LLM.

Jiaming Luo, Co-advised PhD Candidate. Multimodal imagination.

Zeyu Xie, Master Candidate, graduate in 2025. Audio generation.

Siyuan Chen, Master Candidate. Digital mental health.

Fei Yang, Master Candidate. Pathological speech detection.

Xiaohang Xu, Master Candidate. Emotion speech analysis and generation.

Minghao Lv, Master Candidate. Causal relations.

Haoan Jin, Master Candidate. Mental and ancient Chinese decoding.

Hao Tang, Master Candidate. Agents and so on.

Xingyuan Li, Master Candidate. Animal language decoding.

Chunhao Zhang, Master Candidate. Cognitive reasoning.

Yufei Wang, Master Candidate. Multimodal emotion recognition.

Zhige Huang, Master Candidate. Ancient language decoding.

Jiaxi Liu, Master Candidate to be. Pathological speech.

Baihan Li, Master Candidate to be. Audio generation.

Alumni

Heinrick Dinkel, Co-advised PhD, 2020. Senior Algorithm Researcher at Xiaomi

Binwei Yao, B.Eng, 2022. Current PhD candidate at the Univeristy of Wisconsin-Madison.

Guangwei Li, Master, 2023. Algorithm researcher at Ant Group.

Pingyue Zhang, Master, 2024. Pursue PhD overseas.

Dengdeng Huang, B.Eng, 2024. PhD at SJTU.