CPsyCoun: A Report-based Multi-turn Dialogue Reconstruction and Evaluation Framework for Chinese Psychological Counseling
Chenhao Zhang, Renhao Li, Minghuan Tan, Min Yang, Jingwei Zhu, Di, Yang, Jiahao Zhao, Guancheng Ye, Chengming Li, Xiping Hu

TL;DR
This paper introduces CPsyCoun, a framework that reconstructs and evaluates multi-turn Chinese psychological counseling dialogues using report data, addressing the lack of professional knowledge and automatic assessment methods.
Contribution
It presents a novel two-phase approach for dialogue reconstruction and a comprehensive benchmark for automatic evaluation in Chinese psychological counseling.
Findings
Effective dialogue reconstruction demonstrated by experimental results.
Benchmark facilitates automatic evaluation of multi-turn psychological consultations.
Open-source datasets and models support future research.
Abstract
Using large language models (LLMs) to assist psychological counseling is a significant but challenging task at present. Attempts have been made on improving empathetic conversations or acting as effective assistants in the treatment with LLMs. However, the existing datasets lack consulting knowledge, resulting in LLMs lacking professional consulting competence. Moreover, how to automatically evaluate multi-turn dialogues within the counseling process remains an understudied area. To bridge the gap, we propose CPsyCoun, a report-based multi-turn dialogue reconstruction and evaluation framework for Chinese psychological counseling. To fully exploit psychological counseling reports, a two-phase approach is devised to construct high-quality dialogues while a comprehensive evaluation benchmark is developed for the effective automatic evaluation of multi-turn psychological consultations.…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsEducational and Psychological Assessments
