GitHub - facebookresearch/large_concept_model: Large Concept Models: Language modeling in a sentence representation space
Large Concept Models
Language Modeling in a Sentence Representation Space
[Blog] [Paper]
This repository provides the official implementations and experiments for Large Concept Models (LCM).
The LCM operates on an explicit higher-level semantic representation,
which we name a "concept". Concepts are language- and modality-agnostic and represent a higher
level idea. In this work, a concept corresponds to a sentence, and we use the SONAR
embedding space, which supports up to 200 languages in text ...
Read more at github.com