Enhancing Conversational Recommender Systems with Tree-Structured Knowledge and Pretrained Language Models
Yongwen Ren, Chao Wang, Peng Du, Chuan Qin, Dazhong Shen, Hui Xiong

TL;DR
This paper introduces PCRS-TKA, a prompt-based framework that enhances conversational recommender systems by integrating knowledge graphs with pretrained language models through structured knowledge trees and selective filtering, improving accuracy and coherence.
Contribution
The paper presents a novel retrieval-augmented generation framework that constructs dialogue-specific knowledge trees and models collaborative preferences, addressing key limitations of previous methods.
Findings
PCRS-TKA outperforms baselines in recommendation accuracy.
The structured knowledge trees improve reasoning over graph relationships.
Selective knowledge filtering reduces noise and enhances conversational quality.
Abstract
Recent advances in pretrained language models (PLMs) have significantly improved conversational recommender systems (CRS), enabling more fluent and context-aware interactions. To further enhance accuracy and mitigate hallucination, many methods integrate PLMs with knowledge graphs (KGs), but face key challenges: failing to fully exploit PLM reasoning over graph relationships, indiscriminately incorporating retrieved knowledge without context filtering, and neglecting collaborative preferences in multi-turn dialogues. To this end, we propose PCRS-TKA, a prompt-based framework employing retrieval-augmented generation to integrate PLMs with KGs. PCRS-TKA constructs dialogue-specific knowledge trees from KGs and serializes them into texts, enabling structure-aware reasoning while capturing rich entity semantics. Our approach selectively filters context-relevant knowledge and explicitly…
Peer Reviews
Decision·Submitted to ICLR 2025
- The authors clearly and thoroughly explained the proposed method to address the limitations of Conversational Recommender Systems (CRS). - The authors demonstrate the effectiveness of the proposed framework and its components in enhancing recommendation capability.
- **The proposed method does not fully handle the limitations.** The authors pointed out the issue of inaccurate generation caused by hallucinations. However, the proposed framework has different input prompts for the recommendation and response generation tasks. While the proposed module components can effectively bridge the semantic gap between the conversation prompt and the entity prompt, they cannot completely resolve the issue. Providing different input prompts to the same model can lead
- Clear presentation of the framework and results. - Interesting perspective on representing KG triples as a tree structure for prompt learning for CRS.
- PCRS-TKA heavily relies on established techniques and follows UniCRS[1] architecture, While the knowledge tree module introduces some innovation, other components like constructive learning and prompt-based design are mainly adaptations of existing methods from CRS [1][2]. - The choice of PLMs needs justification given LLMs have demonstrated promising performance in CRS. - The benchmark comparison focuses on older models (up to 2022); the authors should include later models. - The authors emph
1. **Integration of PLMs with KGs**: - The framework effectively combines the strengths of PLMs and KGs, enabling richer contextual understanding and improved recommendation accuracy. 2. **Reproducibility**: - The availability of the source code enhances the reproducibility of the results, allowing other researchers to validate and build upon the findings. 3. **Experimental Results**: - Extensive experiments demonstrate significant improvements in recommendation accuracy and conversat
1. **Lack of Novelty**: - The framework appears to be a straightforward extension of existing methods, lacking unique ideas or contributions in the proposed modules, architecture, and training objectives. 2. **Insufficient Literature Review**: - The paper does not adequately survey recent advancements in prompt learning, which diminishes the contextual grounding of the proposed approach within the broader research landscape. 3. **Hallucination Challenge**: - While the authors mention
Videos
Taxonomy
TopicsTopic Modeling · Multimodal Machine Learning Applications · Recommender Systems and Techniques
