GitHub - NX-AI/xlstm: Official repository of the xLSTM.
xLSTM: Extended Long Short-Term Memory
Paper: https://arxiv.org/abs/2405.04517
About
xLSTM is a new Recurrent Neural Network architecture based on ideas of the original LSTM.
Through Exponential Gating with appropriate normalization and stabilization techniques and a new Matrix Memory it overcomes the limitations of the original LSTM
and shows promising performance on Language Modeling when compared to Transformers or State Space Models.
Minimal Installation
Create a conda environment from the f...
Read more at github.com