Authors: Moussa Koulako Bala Doumbouya, Dan Jurafsky, Christopher D. ManningPaper: https://arxiv.org/abs/2506.11035Once a year, some interesting architecture inevitably appears where they change some fundamental building block. This happened with KAN last year, where they changed the parameterization of the neuron activation function (though it's unclear what the outcome is after a year — many follow-up works seem to have appeared, but KANs haven't displaced anyone anywhere yet). The same is tru...