In recent years we have seen the emergence of open source "table formats" projects such as Apache Iceberg, Apache Hudi and Delta by Databricks.These formats allow you to store large collections of analytical data in static files which are well structured, fast to query and modifiable using insert, update, delete and merge operations. Though data formats sound like a dry technical topic to anyone outside of data engineering geeks, I think this will be one of the bigger architectural changes in e...