Meta launches SAM 3D, two AI models that reconstruct 3D objects and human bodies from single 2D images; powering Facebook Marketplace's View in Room feature, releasing datasets and code for researchers and creators.

Introducing SAM 3D: Powerful 3D Reconstruction for Physical World Images

Takeaways:We’re announcing SAM 3D. This release includes two new state-of-the-art models: SAM 3D Objects for object and scene reconstruction, and SAM 3D Body for human body and shape estimation. SAM 3D sets a new standard for grounded 3D reconstruction in physical world scenarios.As part of this release, we’re sharing training and evaluation data, an evaluation benchmark, model checkpoints, inference code and a parametric human model. This work has potential to be used for creative applications ...