Report on the software "SemanticModellingFramework"

TL;DR

This paper presents a semantics-aware 3D shape modelling framework that preserves functional and semantic integrity during geometric deformation, integrating annotation, analysis, and constraint-based deformation within a single environment.

Contribution

It introduces a modular framework for semantics-preserving shape deformation using annotated parametric templates and formalized knowledge.

Findings

Framework enables semantic constraint-based shape deformation.

Tools for annotation, analysis, and deformation are integrated.

Modular design allows for continuous tool addition.

Abstract

The evolution of 3D visual content calls for innovative methods for modelling shapes based on their intended usage, function and role in a complex scenario. Even if different attempts have been done in this direction, shape modelling still mainly focuses on geometry. However, 3D models have a structure, given by the arrangement of salient parts, and shape and structure are deeply related to semantics and functionality. Changing geometry without semantic clues may invalidate such functionalities or the meaning of objects or their parts. Here, the problem is approached by considering semantics as the formalised knowledge related to a category of objects; the geometry can vary provided that the semantics is preserved. The semantics and the variable geometry of a class of shapes is represented through the parametric template: an annotated 3D model whose geometry can be deformed provided that some semantic constraints remain satisfied. In this work, the design and development of a framework for the semantics-aware modelling of shapes is presented, offering the user a single application environment where the whole workflow of defining the parametric template and applying semantics-aware deformations can take place. In particular, the system provides tools for the selection and annotation of geometry based on a formalised contextual knowledge; shape analysis methods to derive new knowledge implicitly encoded in the geometry, and possibly enrich the given semantics; a set of constraints that the user can apply to salient parts and a deformation operation that takes into account the semantic constraints and provides an optimal solution. The framework is modular so that new tools can be continuously added.