News Score: Score the News, Sort the News, Rewrite the Headlines

Harnessing the Universal Geometry of Embeddings

View PDF HTML (experimental) Abstract:We introduce the first method for translating text embeddings from one vector space to another without any paired data, encoders, or predefined sets of matches. Our unsupervised approach translates any embedding to and from a universal latent representation (i.e., a universal semantic structure conjectured by the Platonic Representation Hypothesis). Our translations achieve high cosine similarity across model pairs with different architectures, parameter cou...

Read more at arxiv.org

© News Score  score the news, sort the news, rewrite the headlines