Ask HN: Is anybody building an alternative transformer? 15 points by taiboku256 31 minutes ago | hide | past | favorite | 10 comments Curious if anybody out there is trying to build a new model/architecture that would succeed the transformer?I geek out on this subject in my spare time. Curious if anybody else is doing so and if you're willing to share ideas? The xLSTM could become a good alternative to transformers: https://arxiv.org/abs/2405.04517. On very long contexts, such as those arising...