TOM: A Development Platform For Wearable Intelligent Assistants

TL;DR

TOM is a versatile software platform designed to streamline the development of context-aware wearable intelligent assistants, supporting diverse applications, user interaction analysis, and integration of new devices.

Contribution

The paper introduces TOM, a novel development platform that enables efficient creation of wearable intelligent assistants with contextual awareness and multi-stakeholder support.

Findings

Successfully developed proof-of-concept assistive services

Supports integration of new devices and user interaction analysis

Facilitates creation of assistive AR applications for daily activities

Abstract

Advanced digital assistants can significantly enhance task performance, reduce user burden, and provide personalized guidance to improve users' abilities. However, the development of such intelligent digital assistants presents a formidable challenge. To address this, we introduce TOM, a conceptual architecture and software platform (https://github.com/TOM-Platform) designed to support the development of intelligent wearable assistants that are contextually aware of both the user and the environment. This system was developed collaboratively with AR/MR researchers, HCI researchers, AI/Robotic researchers, and software developers, and it continues to evolve to meet the diverse requirements of these stakeholders. TOM facilitates the creation of intelligent assistive AR applications for daily activities and supports the recording and analysis of user interactions, integration of new devices, and the provision of assistance for various activities. Additionally, we showcase several proof-of-concept assistive services and discuss the challenges involved in developing such services.