GitHub - amanvirparhar/chaplin: A real-time silent speech recognition tool.
Chaplin
A visual speech recognition (VSR) tool that reads your lips in real-time and types whatever you silently mouth. Runs fully locally.
Relies on a model trained on the Lip Reading Sentences 3 dataset as part of the Auto-AVSR project.
Watch a demo of Chaplin here.
Setup
Clone the repository, and cd into it:
git clone https://github.com/amanvirparhar/chaplin
cd chaplin
Download the required model components: LRS3_V_WER19.1 and lm_en_subword.
Unzip both folders, and place them in their respect...
Read more at github.com