# Succinct Representations for Concepts

## TL;DR

This paper introduces a novel approach using category theory to create succinct, hierarchical concept representations that improve model understanding, enable accurate learning, and facilitate manual verification of complex concepts.

## Contribution

It proposes a new concept representation method based on category theory, providing invariance properties and a hierarchical decomposition for better model interpretability and learning accuracy.

## Key findings

- Provides a new theoretical framework for concept representation
- Enables provably accurate learning of complex concepts
- Facilitates manual verification through hierarchical decomposition

## Abstract

Foundation models like chatGPT have demonstrated remarkable performance on various tasks. However, for many questions, they may produce false answers that look accurate. How do we train the model to precisely understand the concepts? In this paper, we introduce succinct representations of concepts based on category theory. Such representation yields concept-wise invariance properties under various tasks, resulting a new learning algorithm that can provably and accurately learn complex concepts or fix misconceptions. Moreover, by recursively expanding the succinct representations, one can generate a hierarchical decomposition, and manually verify the concept by individually examining each part inside the decomposition.