Cognitive Interpretation of Everyday Activities: Toward Perceptual Narrative Based Visuo-Spatial Scene Interpretation
Mehul Bhatt, Jakob Suchan, Carl Schultz

TL;DR
This paper introduces a narrative-based computational model for high-level visuo-spatial scene understanding, focusing on human activity interpretation in smart environments to enhance assistive technologies and perceptual reasoning.
Contribution
It presents a novel narrative model for representing space, events, and actions, along with preliminary work on perceptual narrativisation for cognitive scene interpretation.
Findings
Developed a narrative model encompassing space, events, and actions.
Applied the model to human-activity interpretation in smart environments.
Outlined plans for open-source tools for perceptual narrativisation.
Abstract
We position a narrative-centred computational model for high-level knowledge representation and reasoning in the context of a range of assistive technologies concerned with "visuo-spatial perception and cognition" tasks. Our proposed narrative model encompasses aspects such as \emph{space, events, actions, change, and interaction} from the viewpoint of commonsense reasoning and learning in large-scale cognitive systems. The broad focus of this paper is on the domain of "human-activity interpretation" in smart environments, ambient intelligence etc. In the backdrop of a "smart meeting cinematography" domain, we position the proposed narrative model, preliminary work on perceptual narrativisation, and the immediate outlook on constructing general-purpose open-source tools for perceptual narrativisation. ACM Classification: I.2 Artificial Intelligence: I.2.0 General -- Cognitive…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
