This is great news for my own Rockchip chipset exploration, which still has a ways to go–there now seems to be working Mali GPU acceleration for LLMs, and having more people doing this kind of testing on ARM is both informative and a sign there’s interest in the small model, edge AI scenarios I’ve been toying with. Serendipitously, I did look at llm-rk3588 when I got my Orange Pi 5+ (it was actually developed on one) but discarded it because the NPU can’t really be used for LLMs and the required...