News Score: Score the News, Sort the News, Rewrite the Headlines

Just Ask for Generalization

This blog post outlines a key engineering principle I’ve come to believe strongly in for building general AI systems with deep learning. This principle guides my present-day research tastes and day-to-day design choices in building large-scale, general-purpose ML systems. Discoveries around Neural Scaling Laws, unsupervised pretraining on Internet-scale datasets, and other work on Foundation Models have pointed to a simple yet exciting narrative for making progress in Machine Learning: Large amo...

Read more at evjang.com

© News Score  score the news, sort the news, rewrite the headlines