The modelcar-catalog repo is designed to provide patterns for building ModelCar images for commonly used LLMs. Be sure to check out the modelcar-catalog registry to find many of these images pre-built and ready to use.
The huggingface-modelcar-builder
is a helper container designed to make it easier to pull models from huggingface to build a modelcar container.
https://huggingface.co/ibm-granite/granite-3.0-2b-instruct
quay.io/redhat-ai-services/modelcar-catalog:granite-3.0-2b-instruct
https://huggingface.co/ibm-granite/granite-3.0-8b-instruct
quay.io/redhat-ai-services/modelcar-catalog:granite-3.0-8b-instruct
https://huggingface.co/ibm-granite/granite-3.1-2b-instruct
quay.io/redhat-ai-services/modelcar-catalog:granite-3.1-2b-instruct
https://huggingface.co/ibm-granite/granite-3.1-8b-instruct
quay.io/redhat-ai-services/modelcar-catalog:granite-3.1-8b-instruct
https://huggingface.co/ibm-granite/llama-3.2-1b-instruct
quay.io/redhat-ai-services/modelcar-catalog:llama-3.2-1b-instruct
https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3
quay.io/redhat-ai-services/modelcar-catalog:mistral-7b-instruct-v0.3
https://huggingface.co/ibm-granite/sparse-llama-3.1-8b-2of4
quay.io/redhat-ai-services/modelcar-catalog:sparse-llama-3.1-8b-2of4