LeKUBE: A Legal Knowledge Update BEnchmark
Changyue Wang, Weihang Su, Hu Yiran, Qingyao Ai, Yueyue Wu, Cheng Luo,, Yiqun Liu, Min Zhang, Shaoping Ma

TL;DR
LeKUBE is a new benchmark designed to evaluate how effectively legal language models can update their knowledge in response to changes in legal statutes, addressing a critical gap in legal AI research.
Contribution
The paper introduces LeKUBE, a specialized benchmark for assessing legal knowledge update methods, including synthetic legal updates and evaluation across multiple dimensions.
Findings
Existing methods show significant gaps in legal knowledge updates.
Legal domain-specific challenges require tailored update mechanisms.
LeKUBE reveals the need for further research in legal knowledge updating.
Abstract
Recent advances in Large Language Models (LLMs) have significantly shaped the applications of AI in multiple fields, including the studies of legal intelligence. Trained on extensive legal texts, including statutes and legal documents, the legal LLMs can capture important legal knowledge/concepts effectively and provide important support for downstream legal applications such as legal consultancy. Yet, the dynamic nature of legal statutes and interpretations also poses new challenges to the use of LLMs in legal applications. Particularly, how to update the legal knowledge of LLMs effectively and efficiently has become an important research problem in practice. Existing benchmarks for evaluating knowledge update methods are mostly designed for the open domain and cannot address the specific challenges of the legal domain, such as the nuanced application of new legal knowledge, the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsDispute Resolution and Class Actions
