News Score: Score the News, Sort the News, Rewrite the Headlines

650GB of Data (Delta Lake on S3). Polars vs DuckDB vs Daft vs Spark.

I recently tried to light the tinder for what I hoped would be a revolt — the Single Node Rebellion — but, of course, it sputtered out immediately. Truth be told, it was one of the most popular articles I’ve written about in some time, purely based on the stats.The fact that I even sold t-shirts, tells me I have born a few acolytes into this troubled Lake House world.Without rehashing the entire article, it’s clear that there is what I would call “cluster fatigue.” We all know it, but never talk...

Read more at dataengineeringcentral.substack.com

© News Score  score the news, sort the news, rewrite the headlines