Introducing SPDL: Faster AI model training with thread-based data loading
Takeaways:We present SPDL, a new data loading solution for AI model training.SPDL is a framework-agnostic data loading solution that utilizes multi-threading, which achieves high-throughput in a regular Python interpreter (built without free-threading option enabled).When compared against conventional process-based solutions, SPDL achieves 2x – 3x throughput while using a smaller amount of compute resources.SPDL is compatible with Free-Threaded Python. Our experiment shows that running SPDL in F...
Read more at ai.meta.com