GitHub - facebookexternal/nimble: New file format for storage of large columnar datasets.
The Nimble File Format
Nimble (formerly known as “Alpha”) is a new columnar file format for large
datasets created by Meta. Nimble is meant to be a replacement for file formats
such as Apache Parquet and ORC.
Watch this talk to learn more
about Nimble’s internals.
Nimble has the following design principles:
Wide: Nimble is better suited for workloads that are wide in nature, such
as tables with thousands of columns (or streams) which are commonly found in
feature engineering workloads and traini...
Read more at github.com