AugOp: Inject Transformation into Neural Operator
Longqing Ye

TL;DR
AugOp introduces a method to augment convolutional neural networks with group-wise transformations during training, enhancing learning capacity without increasing inference complexity, demonstrated by improved image classification results on CIFAR-10.
Contribution
The paper presents a novel augmentation technique for convolution operators that boosts training performance while maintaining inference efficiency.
Findings
AugResNet outperforms baseline models on CIFAR-10.
The method adds no extra computational cost during inference.
Transformations can be merged with regular convolution without altering topology.
Abstract
In this paper, we propose a simple and general approach to augment regular convolution operator by injecting extra group-wise transformation during training and recover it during inference. Extra transformation is carefully selected to ensure it can be merged with regular convolution in each group and will not change the topological structure of regular convolution during inference. Compared with regular convolution operator, our approach (AugConv) can introduce larger learning capacity to improve model performance during training but will not increase extra computational overhead for model deployment. Based on ResNet, we utilize AugConv to build convolutional neural networks named AugResNet. Result on image classification dataset Cifar-10 shows that AugResNet outperforms its baseline in terms of model performance.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNeural Networks and Applications · Machine Learning and Data Classification · Domain Adaptation and Few-Shot Learning
MethodsBatch Normalization · Residual Connection · *Communicated@Fast*How Do I Communicate to Expedia? · Max Pooling · Average Pooling · Residual Block · 1x1 Convolution · Kaiming Initialization · Global Average Pooling · Bottleneck Residual Block
