GitHub - turingmotors/swan: This project aims to enable language model inference on FPGAs, supporting AI applications in edge devices and environments with limited resources.
Swan
A Lightweight Language Model Execution Environment Using FPGA
English | 日本語 | 中文
Swan is an OSS project implemented in C++.
Its goal is to efficiently run language models on general-purpose FPGAs using High-Level Synthesis (HLS).
This project aims to enable language model inference on FPGAs, supporting AI applications in edge devices and environments with limited resources.
Features
Versatility: Supports common FPGA boards such as the KV260.
Scalability: The source code is written in C++, m...
Read more at github.com