情感计算与医学人工智能,近年来主要关注:
(1)情感计算:微表情分析、儿童面部表情识别、说话人无关语音情感识别、多模态情感识别;
(2)医学人工智能(AI辅助的精神障碍诊断):基于表情、语音、文本等多模态行为分析的精神障碍(抑郁症、孤独症、阿尔茨海默病等)早期筛查;
(3)医学人工智能(其他):基于血流音信号分析的动静脉瘘狭窄率评估、基于面部表情分析的实验动物疼痛评估。
1. 中国图象图形学学会(CSIG)高级会员
2. 中国图象图形学学会(CSIG)情感计算与理解专委会委员
3. 中国人工智能学会(CAAI)情感智能专委会委员
4. 中国图象图形学学会(CSIG)多媒体专委会委员
1. 国家自然科学基金面上项目,基于表情、语音和动作多模态行为分析的孤独症谱系障碍早期筛查方法研究,62476057,2025.01-2028.12,主持,在研
2. 东南大学“至善青年学者”(A层次)资助经费,融合多模态行为信息的谎言识别技术研究,2242025RCB0015,2025.01-2027.12,主持,在研
3. 航空科学基金自由探索类一般项目,基于多模态情绪行为分析的飞行员负性隐藏意图识别技术研究,2023Z071069003,2023.10-2025.09,主持,在研
4. 中国科协“青年人才托举工程”项目,精神疾病的心理测量和评估,2023QNRC001,2023.09-2025.12,主持,在研
5. 国家重点研发计划课题“多模态情感交互认知障碍诊疗系统集成”任务,可穿戴力触觉、视听觉模块等核心部件国产化,2022YFC2405604-2,2022.11-2027.10,负责人,在研
6. 东南大学“至善青年学者”(B层次)资助经费,面向人机自然交互的多模态情感识别与意图理解,2242021R40014,2021.01-2023.12,主持,结题
7. 国家自然科学基金青年科学基金项目,基于深度学习的非正面微表情识别研究,61902064,2020.01-2022.12,主持,结题
(* 通讯作者,# 共同一作;全部论文发表记录详见本人谷歌学术主页)
1. Sunan Li, Cheng Lu, Yan Zhao, Hailun Lian, Tianhua Qi, and Yuan Zong(*), “Low-Rank Joint Distribution Adaptation for Cross-Corpus Speech Emotion Recognition,” Knowledge-Based Systems, Vol. 315, pp. 113260, 2025. (JCR Q1, IF: 7.2; 中科院一区TOP)
2. Hailun Lian, Cheng Lu, Hongli Chang, Yan Zhao, Sunan Li, Yang Li, and Yuan Zong(*), “AMGCN: An Adaptive Multi-graph Convolutional Network for Speech Emotion Recognition,” Speech Communication, Vol. 168, pp. 103184, 2025. (JCR Q2, IF: 2.4, CCF B; 语音信号处理领域TOP期刊)
3. Zhaoyang Li, Cheng Lu, Xiaolin Xu, Kaifei Zhang, Yujia Gu, Banghua Li, Yuan Zong(*), and Wenming Zheng(*), “Enhancing Task-Specific Feature Learning with LLMs for Multimodal Emotion and Intent Joint Understanding,” in IEEE ICASSP, 2025. (CCF B; 语音信号处理两大旗舰会议之一)
4. Xiaolin Xu, Cheng Lu, Zhaoyang Li, Yuyun Liu, Yinghao Ma, Jiahao Luo, Yuan Zong(*), and Wenming Zheng(*), “Reliable Learning From LLM Features for Multimodal Emotion and Intent Joint Understanding,” in IEEE ICASSP, 2025. (CCF B; 语音信号处理两大旗舰会议之一)
5. Yan Zhao, Yuan Zong(*), Hailun Lian, Cheng Lu, Jingang Shi, and Wenming Zheng(*), “Towards Domain-Specific Cross-Corpus Speech Emotion Recognition Approach,” IEEE Transactions on Computational Social Systems, 2024. DOI: 10.1109/TCSS.2024.3483964 (JCR Q1, IF: 4.5)
6. Yan Zhao, Yuan Zong(*), Jincen Wang, Hailun Lian, Cheng Lu, Li Zhao, and Wenming Zheng(*), “Layer-Adapted Implicit Distribution Alignment Networks for Cross-Corpus Speech Emotion Recognition,” IEEE Transactions on Computational Social Systems, Vol. 11, No. 4, pp. 5419 – 5430, 2024. (JCR Q1, IF: 4.5)
7. Hailun Lian, Cheng Lu, Yan Zhao, Sunan Li, Tianhua Qi, and Yuan Zong(*), “Exploring Corpus-Invariant Emotional Acoustic Feature for Cross-Corpus Speech Emotion Recognition,” Expert Systems with Applications, Vol. 258, pp. 125162, 2024. (JCR Q1, IF: 7.5; 中科院一区TOP)
8. Jie Zhu, Wanyuan He, Feifan Wang, Hongli Chang, Cheng Lu, and Yuan Zong(*), “Exploring Holistic Discriminative Representation for Micro-Expression Recognition via Contrastive Learning,” Image and Vision Computing, Vol. 149, pp. 105186, 2024. (JCR Q1, IF: 4.2)
9. Cheng Lu, Yuan Zong(*), Hailun Lian, Yan Zhao, Chuangao Tang, Björn Schuller, and Wenming Zheng(*), “Improving Speaker-independent Speech Emotion Recognition Using Dynamic Joint Distribution Adaptation,” in IEEE ICASSP, 2024. (CCF B; 语音信号处理两大旗舰会议之一)
10. Yong Wang, Cheng Lu, Hailun Lian, Yan Zhao, Björn Schuller, Yuan Zong(*), and Wenming Zheng(*), “Speech Swin-Transformer: Exploring a Hierarchical Transformer with Shifted Windows for Speech Emotion Recognition,” in IEEE ICASSP, 2024. (CCF B; 语音信号处理两大旗舰会议之一)
11. Yan Zhao, Jincen Wang, Cheng Lu, Sunan Li, Bjoern W Schuller, Yuan Zong(*), and Wenming Zheng(*), “Emotion-Aware Contrastive Adaptation Network for Source-Free Cross-Corpus Speech Emotion Recognition,” in IEEE ICASSP, 2024. (CCF B; 语音信号处理两大旗舰会议之一)
12. Cheng Lu, Yuan Zong(*), Yan Zhao, Hailun Lian, Tianhua Qi, Bjorn Schuller, and Wenming Zheng(*), “Hierarchical Distribution Adaptation for Unsupervised Cross-corpus Speech Emotion Recognition,” in INTERSPEECH, 2024. (CCF C; 语音信号处理两大旗舰会议之一)
13. Jincen Wang, Yan Zhao, Cheng Lu, Hailun Lian, Hongli Chang, Yuan Zong(*), Wenming Zheng(*), “Confidence-aware Hypothesis Transfer Networks for Source-Free Cross-Corpus Speech Emotion Recognition,” in INTERSPEECH, 2024. (CCF C; 语音信号处理两大旗舰会议之一)
14. Jincen Wang, Yan Zhao, Cheng Lu, Chuangao Tang, Sunan Li, Yuan Zong(*), Wenming Zheng(*), “Boosting Cross-Corpus Speech Emotion Recognition using CycleGAN with Contrastive Learning,” in INTERSPEECH, 2024. (CCF C; 语音信号处理两大旗舰会议之一)
15. Cheng Lu, Wenming Zheng(*), Hailun Lian, Yuan Zong(*), Chuangao Tang, Sunan Li, and Yan Zhao, “Speech Emotion Recognition via an Attentive Time-Frequency Neural Network,” IEEE Transactions on Computational Social Systems, Vol. 10, No. 6, pp. 3159 - 3168, 2023. (JCR Q1, IF: 4.5)
16. Mengting Wei, Xingxun Jiang, Wenming Zheng(*), Yuan Zong(*), and Cheng Lu, “CMNet: Contrastive Magnification Network for Micro-Expression Recognition,” in AAAI, 2023. (CCF A)
17. Sunan Li, Hailun Lian, Cheng Lu, Yan Zhao, Chuangao Tang, Yuan Zong(*), and Wenming Zheng(*), “Multimodal Emotion Recognition in Noisy Environment Based on Progressive Label Revision,” in ACM Multimedia, 2023. (CCF A)
18. Yan Zhao, Jincen Wang, Yuan Zong(*), Wenming Zheng(*), Hailun Lian, and Li Zhao, “Deep Implicit Distribution Alignment Networks for Cross-Corpus Speech Emotion Recognition,” in IEEE ICASSP, 2023. (CCF B; 语音信号处理两大旗舰会议之一)
19. Cheng Lu, Hailun Lian, Wenming Zheng(*), Yuan Zong(*), Yan Zhao, and Sunan Li, “Learning Local to Global Feature Aggregation for Speech Emotion Recognition,” in INTERSPEECH, 2023. (CCF B; 语音信号处理两大旗舰会议之一)
20. Tong Zhang, Yuan Zong(*), Wenming Zheng(*), C. L. Philip Chen, Xiaopeng Hong, Chuangao Tang, Zhen Cui, and Guoying Zhao, “Cross-Database Micro-Expression Recognition: A Benchmark,” IEEE Transactions on Knowledge and Data Engineering, Vol.34, No.2, pp. 544-559, 2022. (JCR Q1, IF: 8.9)
21. Cheng Lu(#), Yuan Zong(#), Wenming Zheng, Yang Li, Chuangao Tang, and Bjorn Schuller, “Domain Invariant Feature Learning for Speaker-independent Speech Emotion Recognition,” IEEE/ACM Transactions on Audio, Speech, and Language Processing, Vol. 30, pp. 2217-2230, 2022. (JCR Q1, IF: 4.1; 语音信号处理领域TOP期刊)
22. Jie Zhu, Yuan Zong(*), Hongli Chang, Yushun Xiao, and Li Zhao, “A Sparse-Based Transformer Network with Associated Spatiotemporal Feature for Micro-Expression Recognition,” IEEE Signal Processing Letters, Vol. 29, pp. 2073 – 2077, 2022. (JCR Q2, IF: 3.2)
23. Yan Zhao, Jincen Wang, Ru Ye, Yuan Zong(*), Wenming Zheng(*), and Li Zhao, “Deep Transductive Transfer Regression Network for Cross-Corpus Speech Emotion Recognition, ” in INTERSPEECH, 2022. (CCF C; 语音信号处理两大旗舰会议之一)
24. Jiacheng Zhang, Lin Jiang, Yuan Zong(*), Wenming Zheng(*), and Li Zhao, “Cross-Corpus Speech Emotion Recognition Using Joint Distribution Adaptive Regression,” in IEEE ICASSP, 2021. (CCF B; 语音信号处理两大旗舰会议之一)
25. Yuan Zong, Wenming Zheng, Zhen Cui, Guoying Zhao, and Bin Hu, “Toward Bridging Microexpressions from Different Domains,” IEEE Transactions on Cybernetics, Vol.50, No.12, pp.5047-5060, 2020. (JCR Q1, IF: 9.4)
26. Xingxun Jiang(#), Yuan Zong(#), Wenming Zheng, Chuangao Tang, Wanchuang Xia, Cheng Lu, and Jiateng Liu, “DFEW: A Large-Scale Database for Recognizing Dynamic Facial Expressions in the Wild,” in ACM Multimedia, 2020. (CCF A)【学术界首个样本量破万的真实场景动态表情数据集,欢迎申请下载使用】
27. Yuan Zong, Wenming Zheng, Xiaohua Huang, Jingang Shi, Zhen Cui, and Guoying Zhao. “Domain Regeneration for Cross-Database Micro-Expression Recognition,” IEEE Transactions on Image Processing, Vol. 27, No. 5, pp. 2484 – 2498, 2018. (JCR Q1, IF: 10.8)
28. Yuan Zong, Xiaohua Huang, Wenming Zheng, Zhen Cui, and Guoying Zhao. “Learning from Hierarchical Spatiotemporal Descriptors for Micro-Expression Recognition,” IEEE Transactions on Multimedia, Vol. 20, No. 11, pp. 3160 – 3172, 2018. (JCR Q1, IF: 8.4)
29. Wenming Zheng, Yuan Zong, Xiaoyan Zhou, and Minghai Xin, “Cross-Domain Color Facial Expression Recognition Using Transductive Transfer Subspace Learning,” IEEE Transactions on Affective Computing, Vol. 9, No. 1, pp. 21 – 37, 2018. (JCR Q1, IF: 9.6)
30. Yuan Zong, Xiaohua Huang, Wenming Zheng, Zhen Cui, and Guoying Zhao. “Learning a Target Sample Re-Generator for Cross-Database Micro-Expression Recognition,” in ACM Multimedia, 2017. (CCF A)
31. Yuan Zong, Wenming Zheng, Tong Zhang, and Xiaohua Huang, “Cross-Corpus Speech Emotion Recognition Based on Domain-Adaptive Least-Squares Regression,” IEEE Signal Processing Letters, Vol. 23, No. 5, pp. 585 – 589, 2016. (JCR Q2, IF: 3.2)
1. 2025年获IEEE ICASSP多模态情感和意图联合理解挑战赛(MEIJU’25)不平衡情感和意图识别赛道冠军(包揽中文子赛道和英文子赛道冠军)
2. 2024年指导研究生获第二届全国人工智能应用场景创新挑战赛全国总决赛特等奖(研究生:齐天铧等;指导老师:郑文明,宗源)
3. 2024年指导研究生获第二届全国人工智能应用场景创新挑战赛智能助残康复专项赛一等奖(研究生:齐天铧等;指导老师:郑文明,宗源)
4. 2024年评为第二届全国人工智能应用场景创新挑战赛优秀指导老师
5. 2024年指导本科生获第九届全国大学生生物医学工程创新设计竞赛二等奖(本科生:李邦华等;指导老师:宗源)
6. 2024年入选东南大学“至善青年学者”(A层次)
7. 2024年评为东南大学“学习优秀生”优秀导师
8. 2023年入选第九届中国科协“青年人才托举工程”
9. 2023和2024年入选斯坦福全球前2%顶尖科学家榜单(World’s Top 2% Scientists 2023&2024)
10. 2023年获ACM Multimedia多模态情感识别挑战赛(MER’23)MULTI赛道亚军、NOISE赛道亚军
11. 2023年获ACM ICMI真实场景情感识别挑战赛(EmotiW’23)AVGER赛道亚军
12. 2023年指导本科生获第四届江苏省生物医学工程创新设计竞赛三等奖(本科生:李邦华等;指导老师:宗源)
13. 2022年获中央网信办“智能社会治理创新案例”三等奖(《智能学习过程支持场景研究》)
14. 2021年获第29届东南大学青年教师授课竞赛提名奖
15. 2020年入选东南大学“至善青年学者”(B层次)
16. 2020年获南京市留学人员科技创新项目择优资助(C类)
17. 2020年获东南大学优秀博士学位论文
18. 2019年获ACM ICMI真实场景情感识别挑战赛(EmotiW’19)AVER赛道冠军
1. 硕博士研究生:每年可在生医学院083100生物医学工程(学术学位)或085409生物医学工程(专业学位)两个专业招收博士生1名、硕士生3名,苏州联合研究生院085400电子信息(专业学位)专业健康数据科学方向招收硕士生1名,欢迎拥有计算机/电子信息/自动化/生物医学工程(电类方向)等专业背景、有志于从事情感计算与医学人工智能方向研究并做出优异成绩的同学联系,有意向的同学请发送学术简历至本人邮箱;
2. 教育学博士生:每年可在040100教育学(学术学位)专业特殊教育学方向招收博士生,将由本人与所在教育部重点实验室梁宗保副教授组成导师组共同指导,进行特殊儿童心理机制及教育策略方面的研究。欢迎具有教育学、心理学(特别是教育心理学)等相关专业背景、有志于从事这方面研究并做出优异成绩的同学报考。联系邮件请同时发送至本人邮箱与梁老师邮箱(lzb@seu.edu.cn);
3. 本科SRTP:每年招收1~2组生医学院本科生SRTP队伍(每组1-5人),欢迎有一定Coding能力、良好的英文阅读水平、对情感计算与医学人工智能研究感兴趣的同学联系;
4. 导师制本科生/学优生:每年从生物医学工程大类、生物科学大类、生物医学工程(七年制)专业中招收导师制本科生2名,其中大类学生建议为大一下有意愿分流至生物医学工程/智能医学工程等生医学院相关专业、且大二上愿意参加本人所指导的SRTP项目的学生;为保证指导的延续性,学优生原则上为本人所带的导师制本科生和SRTP项目组成员;
5. 本科毕设:每年招收1-2名本科生开展毕业设计/论文研究工作,优先接收课题组(东南大学情感信息处理实验室)的本校应届推免生,以及曾在组内做过SRTP的本校学生。