GitHub - louis030195/screen-pipe: Turn your screen into actions (using LLMs). Inspired by adept.ai, rewind.ai, Apple Shortcut. Rust + WASM.
Turn your screen into actions (using LLMs). Inspired by adept.ai, rewind.ai, Apple Shortcut. Rust + WASM.
Screen to action using LLMs
Here's an example of server-side code written in TypeScript that takes the streamed data from ScreenPipe and uses a Large Language Model like OpenAI's to process text and images for analyzing sales conversations:
import { ScreenPipe } from "screenpipe";
import { generateObject } from 'ai';
import { z } from 'zod';
const screenPipe = new ScreenPipe();
export async ...
Read more at github.com