The Best Way to Use Text Embeddings Portably is With Parquet and Polars
Text embeddings, particularly modern embeddings generated from large language models, are one of the most useful applications coming from the generative AI boom. Embeddings are a list of numbers which represent an object: in the case of text embeddings, they can represent words, sentences, and full paragraphs and documents, and they do so with a surprising amount of distinctiveness.Recently, I created text embeddings representing every distinct Magic: the Gathering card released as of the Februa...
Read more at minimaxir.com