Accelerating the Development of Multimodal, Integrative-AI Systems with Platform for Situated Intelligence

TL;DR

Platform for Situated Intelligence is an open-source framework designed to facilitate the development of multimodal, real-time AI systems for interactive applications like social robots and virtual assistants, emphasizing ease of use and integration.

Contribution

This paper introduces a comprehensive open-source framework that accelerates multimodal, situated AI system development with infrastructure, tools, and components.

Findings

Supports real-time multimodal data processing

Enables development of physically situated interactive systems

Facilitates research in human-robot interaction

Abstract

We describe Platform for Situated Intelligence, an open-source framework for multimodal, integrative-AI systems. The framework provides infrastructure, tools, and components that enable and accelerate the development of applications that process multimodal streams of data and in which timing is critical. The framework is particularly well-suited for developing physically situated interactive systems that perceive and reason about their surroundings in order to better interact with people, such as social robots, virtual assistants, smart meeting rooms, etc. In this paper, we provide a brief, high-level overview of the framework and its main affordances, and discuss its implications for HRI.