StripedHyena: A new architecture for next-generation generative AI?
Skip to content
AI researchDec 10, 2023Dec 10, 2023
DALL-E 3 prompted by THE DECODER
Max is managing editor at THE DECODER. As a trained philosopher, he deals with consciousness, AI, and the question of whether machines can really think or just pretend to.
GPT-4 and other models rely on transformers. With StripedHyena, researchers present an alternative to the widely used architecture.
With StripedHyena, the Together AI team presents a family of language models with 7 billion parameters. What ma...
Read more at the-decoder.com