The Ocean Tensor Package

TL;DR

The Ocean Tensor Package is an open-source, modular library designed to provide a comprehensive and extensible framework for dense tensor operations across various hardware devices, filling a gap in existing software tools.

Contribution

It introduces a new standalone tensor library that supports general dense tensor operations on multiple device types, enhancing flexibility and usability.

Findings

Provides a powerful, extensible API for tensor operations

Supports multiple device types including CPU and GPU

Available as open source for community use

Abstract

Matrix and tensor operations form the basis of a wide range of fields and applications, and in many cases constitute a substantial part of the overall computational complexity. The ability of general-purpose GPUs to speed up many of these operations and enable others has resulted in a widespread adaptation of these devices. In order for tensor operations to take full advantage of the computational power, specialized software is required, and currently there exist several packages (predominantly in the area of deep learning) that incorporate tensor operations on both CPU and GPU. Nevertheless, a stand-alone framework that supports general tensor operations is still missing. In this paper we fill this gap and propose the Ocean Tensor Library: a modular tensor-support package that is designed to serve as a foundational layer for applications that require dense tensor operations on a variety of device types. The API is carefully designed to be powerful, extensible, and at the same time easy to use. The package is available as open source.