GitHub - microsoft/aici: AICI: Prompts as (Wasm) Programs
Artificial Intelligence Controller Interface (AICI)
The Artificial Intelligence Controller Interface (AICI) lets you build Controllers that constrain and direct output of a Large Language Model (LLM) in real time.
Controllers are flexible programs capable of implementing constrained decoding, dynamic editing of prompts and generated text, and coordinating execution across multiple, parallel generations.
Controllers incorporate custom logic during the token-by-token decoding and maintain state du...
Read more at github.com