GitHub - containers/ramalama: The goal of RamaLama is to make working with AI boring.
RamaLama
The RamaLama project's goal is to make working with AI boring
through the use of OCI containers.
RamaLama tool facilitates local management and serving of AI Models.
On first run RamaLama inspects your system for GPU support, falling back to CPU support if no GPUs are present.
RamaLama uses container engines like Podman or Docker to pull the appropriate OCI image with all of the software necessary to run an AI Model for your systems setup.
Running in containers eliminates the need for u...
Read more at github.com