Conversational Sensing
Alun Preece, Chris Gwilliams, Christos Parizas, Diego Pizzocaro,, Jonathan Z. Bakdash, Dave Braines

TL;DR
This paper introduces a conversational approach using natural language and controlled natural language for information fusion and situational awareness in security and emergency response scenarios, enabling richer human-machine interactions.
Contribution
It presents a novel conversational protocol leveraging CNL for collaborative sensing, reasoning, and information fusion among humans and machines at network edges.
Findings
Prototype conversational agent successfully gathers CNL info from untrained users.
Supports transformation of eyewitness reports into actionable data.
Enhances situational awareness through semantic fusion and reasoning.
Abstract
Recent developments in sensing technologies, mobile devices and context-aware user interfaces have made it possible to represent information fusion and situational awareness as a conversational process among actors - human and machine agents - at or near the tactical edges of a network. Motivated by use cases in the domain of security, policing and emergency response, this paper presents an approach to information collection, fusion and sense-making based on the use of natural language (NL) and controlled natural language (CNL) to support richer forms of human-machine interaction. The approach uses a conversational protocol to facilitate a flow of collaborative messages from NL to CNL and back again in support of interactions such as: turning eyewitness reports from human observers into actionable information (from both trained and untrained sources); fusing information from humans and…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
