# Super Interaction Neural Network

## TL;DR

The paper introduces Super Interaction Neural Networks (SINet), a novel lightweight model that enhances feature interaction through exchange shortcut connections, dense funnel layers, and hierarchical decision mechanisms, improving accuracy on ImageNet.

## Contribution

SINet innovatively improves feature interaction in lightweight networks using new connection and layer designs, boosting performance without extra computational cost.

## Key findings

- SINet outperforms state-of-the-art lightweight models on ImageNet.
- Proposed components are effective and universally applicable.
- Ablation studies confirm the contribution of each component.

## Abstract

Recent studies have demonstrated that the convolutional networks heavily rely on the quality and quantity of generated features. However, in lightweight networks, there are limited available feature information because these networks tend to be shallower and thinner due to the efficiency consideration. For farther improving the performance and accuracy of lightweight networks, we develop Super Interaction Neural Networks (SINet) model from a novel point of view: enhancing the information interaction in neural networks. In order to achieve information interaction along the width of the deep network, we propose Exchange Shortcut Connection, which can integrate the information from different convolution groups without any extra computation cost. And then, in order to achieve information interaction along the depth of the network, we proposed Dense Funnel Layer and Attention based Hierarchical Joint Decision, which are able to make full use of middle layer features. Our experiments show that the superior performance of SINet over other state-of-the-art lightweight models in ImageNet dataset. Furthermore, we also exhibit the effectiveness and universality of our proposed components by ablation studies.