ART: Actually Robust Training

TL;DR

ART is a Python library that structures deep learning training into validated steps to improve robustness, reproducibility, and interpretability of neural network development.

Contribution

It introduces a practical framework with predefined steps and validation checks to standardize and enhance deep learning training processes.

Findings

Provides a structured pipeline for neural network training

Includes validation steps to improve robustness

Integrates visualization and logging tools

Abstract

Current interest in deep learning captures the attention of many programmers and researchers. Unfortunately, the lack of a unified schema for developing deep learning models results in methodological inconsistencies, unclear documentation, and problems with reproducibility. Some guidelines have been proposed, yet currently, they lack practical implementations. Furthermore, neural network training often takes on the form of trial and error, lacking a structured and thoughtful process. To alleviate these issues, in this paper, we introduce Art, a Python library designed to help automatically impose rules and standards while developing deep learning pipelines. Art divides model development into a series of smaller steps of increasing complexity, each concluded with a validation check improving the interpretability and robustness of the process. The current version of Art comes equipped with nine predefined steps inspired by Andrej Karpathy's Recipe for Training Neural Networks, a visualization dashboard, and integration with loggers such as Neptune. The code related to this paper is available at: https://github.com/SebChw/Actually-Robust-Training.