SJTU X-LANCE Lab 上海交通大学跨媒体语言智能实验室丰富音频研究组
Environment Sound
- Sound event and scene detection, generation (!almost every student interested in genreation now..)
- Audio caption, bridging the gap between audio analysis and natural language description
- Audio-visual event detection
- Animal language decoding, now puppy language, in expansion
Human Speech: Medical Application
- Speech emotion analysis
- Depression/Parkinson’s/Alzheimer’s disease detection
- Acoustic-based disease diagnosis, e.g. coughing, voice, heartsound…
Digital Mental Health: Text and Dialogue
- Large Language Model for mental health
- Social media based disease detection and causal mining
- Dialogue based depression/anxiety diagnosis and therapy - building psychiatrist and therapist bots! Fun!
Open-Sourced Data and Models
- CogBench: A Cognitive Evaluation Benchmark of Image Reasoning and Description for LLM
- PsySym: An Interpretable Mental Health Symptom Detection Dataset and Model. ( EMNLP'22 )
- PsyEx: Detection of Multiple Mental Disorders from Social Media with Two-Stream Psychiatric Experts. ( EMNLP'23 )
- PsyEval: A Comprehensive Large Language Model Evaluation Benchmark for Mental Health
- PsyDial: LLM-empowered chatbots for psychiatrist and patient simulation: application and evaluation
- D4: A Chinese Dialogue Dataset for Depression-Diagnosis-Oriented Chat ( EMNLP'22 ) - we built a system supporting spoken dialogue for depression diagnosis on this!