GluonCV and GluonNLP: Deep Learning in Computer Vision and Natural Language Processing

TL;DR

GluonCV and GluonNLP are comprehensive deep learning toolkits for computer vision and NLP, offering pre-trained models, flexible APIs, and cross-platform deployment to accelerate research and development.

Contribution

Introduction of modular, open-source toolkits based on MXNet that facilitate rapid prototyping, customization, and reproducible research in computer vision and NLP.

Findings

Provision of state-of-the-art pre-trained models

Flexible APIs for customization

Cross-platform deployment capabilities

Abstract

We present GluonCV and GluonNLP, the deep learning toolkits for computer vision and natural language processing based on Apache MXNet (incubating). These toolkits provide state-of-the-art pre-trained models, training scripts, and training logs, to facilitate rapid prototyping and promote reproducible research. We also provide modular APIs with flexible building blocks to enable efficient customization. Leveraging the MXNet ecosystem, the deep learning models in GluonCV and GluonNLP can be deployed onto a variety of platforms with different programming languages. The Apache 2.0 license has been adopted by GluonCV and GluonNLP to allow for software distribution, modification, and usage.