Displaying 1 to 1 from 1 results

sparse-structured-attention - Sparse and structured neural attention mechanisms

  •    Python

Efficient implementation of structured sparsity inducing attention mechanisms: fusedmax, oscarmax and sparsemax. Currently available for pytorch v0.2. Requires python (3.6, 3.5, or 2.7), cython, numpy, scipy, scikit-learn, and lightning.