UIT - Universal Information Terminal X Thread Hackernews Thread UIT is a library for performant, modular, low-memory file processing at scale, in the Cloud. It works by offering a 4-step process to gather a file hierarchy from any desired modality, apply filters and transformations, and output it in any desired modality. performance: speed is of essence when navigating and searching through large amounts of data low-memory by applying streaming and parallelization we can run this in low-memory e...