News Score: Score the News, Sort the News, Rewrite the Headlines

Gemma 3n Architectural Innovations - Speculation and poking around in the model.

Gemma 3n is a new member of the Gemma family with free weights that was released during Google I/O. It's dedicated to on-device (edge) inference and supports image and text input, with audio input. Google has released an app that can be used for inference on the phone. What is clear from the documentation, is that this model is stuffed to the brim with architectural innovations: Per-Layer Embedding (PLE), MatFormer Architecture, Conditional Parameter Loading. Unfortunately, there is no paper out...

Read more at old.reddit.com

© News Score  score the news, sort the news, rewrite the headlines