GitHub - Blealtan/efficient-kan: An efficient pure-PyTorch implementation of Kolmogorov-Arnold Network (KAN).
An Efficient Implementation of Kolmogorov-Arnold Network
This repository contains an efficient implementation of Kolmogorov-Arnold Network (KAN).
The original implementation of KAN is available here.
The performance issue of the original implementation is mostly because it needs to expand all intermediate variables to perform the different activation functions.
For a layer with in_features input and out_features output, the original implementation needs to expand the input to a tensor with shape...
Read more at github.com