Understand the Dynamic World: An End-to-End Knowledge Informed Framework for Open Domain Entity State Tracking
Mingchen Li, Lifu Huang

TL;DR
This paper introduces KIEST, an end-to-end framework that leverages external knowledge graphs and novel decoding strategies to improve open domain entity state tracking, crucial for reasoning tasks involving dynamic attribute changes.
Contribution
The paper proposes a novel knowledge-informed, dynamic encoder-decoder framework with constraint decoding for entity state tracking, outperforming existing methods on benchmark datasets.
Findings
KIEST significantly outperforms strong baselines on OpenPI.
Explicit knowledge retrieval improves state change prediction accuracy.
Constraint decoding enhances logical coherence in predictions.
Abstract
Open domain entity state tracking aims to predict reasonable state changes of entities (i.e., [attribute] of [entity] was [before_state] and [after_state] afterwards) given the action descriptions. It's important to many reasoning tasks to support human everyday activities. However, it's challenging as the model needs to predict an arbitrary number of entity state changes caused by the action while most of the entities are implicitly relevant to the actions and their attributes as well as states are from open vocabularies. To tackle these challenges, we propose a novel end-to-end Knowledge Informed framework for open domain Entity State Tracking, namely KIEST, which explicitly retrieves the relevant entities and attributes from external knowledge graph (i.e., ConceptNet) and incorporates them to autoregressively generate all the entity state changes with a novel dynamic knowledge…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsTopic Modeling · Explainable Artificial Intelligence (XAI) · Advanced Graph Neural Networks
