cutensor-cu12 2.0.1

Key Features

• Extensive mixed-precision support:

  • FP64 inputs with FP32 compute.

  • FP32 inputs with FP16, BF16, or TF32 compute.

  • Complex-times-real operations.

  • Conjugate (without transpose) support.

• Support for up to 64-dimensional tensors.

• Arbitrary data layouts.

• Trivially serializable data structures.

• Main computational routines:

  • Direct (i.e., transpose-free) tensor contractions.

    • Support just-in-time compilation of dedicated kernels.

  • Tensor reductions (including partial reductions).

  • Element-wise tensor operations:

    • Support for various activation functions.

    • Support for padding of the output tensor

    • Arbitrary tensor permutations.

    • Conversion between different data types.

Documentation

Please refer to https://docs.nvidia.com/cuda/cutensor/index.html for the cuTENSOR documentation.

Installation

The cuTENSOR wheel can be installed as follows:

pip install cutensor-cuXX

where XX is the CUDA major version (currently CUDA 11 & 12 are supported). The package cutensor (without the -cuXX suffix) is deprecated. If you have cutensor installed, please remove it prior to installing cutensor-cuXX.