Chapter 3. Validated model support matrix
You can use the model support matrix to verify that a model is compatible with your Red Hat AI Inference, Red Hat OpenShift AI, and vLLM version combination before deploying it for inference serving. The matrix lists all validated and enabled models with their minimum platform version requirements and modelcar container image paths.
For more information, see Red Hat AI models on Hugging Face.
Verify that your deployed Red Hat AI Inference, Red Hat OpenShift AI, and vLLM versions meet or exceed the minimum versions listed for your target model. For an explanation of the Validated and Enabled status values, see Model support levels.
Hugging Face links require internet access. If you are working in a disconnected environment, use the modelcar container image paths with your mirrored registry. For more information, see Deploying the standalone Red Hat AI Inference container in a disconnected environment.
| Model | Modelcar | Status | Min. vLLM version | Min. RHAII version | Min. RHOAI version | Min. vRAM (GB) | Supported GPUs | Migration guidance |
|---|---|---|---|---|---|---|---|---|
| registry.redhat.io/rhelai1/modelcar-qwen2-5-7b-instruct:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 17.6 GB | 1XA100-40, 1XA100-80, 1XH100, 1XH200, 1XL4, 2XA100-40, 2XA100-80, 2XH100, 2XL4, 4XA100-40, 4XA100-80, 4XH100 | n/a | |
| registry.redhat.io/rhelai1/modelcar-qwen3-coder-480b-a35b-instruct-fp8:1.5 | Validated | v0.10.1.1 | 3.2.2 | 2.25 | 554.5 GB | 4XB200, 4XH200 | n/a | |
| registry.redhat.io/rhelai1/modelcar-qwen3-embedding-8b:1.5 | Enabled | v0.11.2 | 3.2.5 | 3.2 | 17.5 GB | 1XL4 | n/a | |
| registry.redhat.io/rhai/modelcar-apertus-8b-instruct-2509-fp8-dynamic:3.0 | Validated | v0.11.2 | 3.2.5 | 3.2 | 10.5 GB | 1XA100-80, 1XB200, 1XH100, 1XH200, 2XA100-80, 2XB200, 2XH100, 2XH200, 4XA100-80, 4XB200, 4XH100, 4XH200, 8XA100-80, 8XB200, 8XH100, 8XH200 | n/a | |
| registry.redhat.io/rhelai1/modelcar-deepseek-r1-0528-quantized-w4a16:1.5 | Validated | v0.10.0 | 3.2.1 | 2.24 | 427.2 GB | 4XB200, 4XH200, 8XB200, 8XH100, 8XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-deepseek-v4-flash:3.0 | Validated | v0.24.0 | 3.5.0 | 3.5.0 | 183.6 GB | 4XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-deepseek-v4-pro-essential:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 994.5 GB | 8XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-foundation-sec-8b-instruct:3.0 | Enabled | v0.13.0 | 3.3.0 | 3.3.0 | 18.5 GB | 1XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-glm-5-2-fp8:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 869.0 GB | 4XMI300X, 8XH200, 8XMI300X | n/a | |
| registry.redhat.io/rhelai1/modelcar-kimi-k2-instruct-quantized-w4a16:1.5 | Validated | v0.10.0 | 3.2.1 | 2.24 | 628.7 GB | 4XB200, 8XB200, 8XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-laguna-xs-2:3.0 | Validated | v0.24.0 | 3.5.0 | 3.5.0 | 77.0 GB | 1XH200, 8XA100-80 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-laguna-xs-2-fp8:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 40.7 GB | 4XL4 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-laguna-xs-2-nvfp4:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 24.8 GB | 1XA100-40 | n/a | |
| v0.11.2 | 3.2.5 | 3.2 | 1XH200 | n/a | ||||
| registry.redhat.io/rhelai1/modelcar-llama-3-1-nemotron-70b-instruct-hf-fp8-dynamic:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 83.6 GB | 1XH200, 2XA100-80, 2XH100, 4XA100-40, 4XA100-80, 4XH100, 8XA100-40, 8XH100 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-llama-3-2-3b-instruct-quantized-w8a8:3.0 | Validated | v0.24.0 | 3.5.0 | 3.5.0 | 5.1 GB | 1XH200 | n/a | |
| registry.redhat.io/rhelai1/modelcar-llama-3-3-70b-instruct-fp8-dynamic:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 83.6 GB | 1XH200, 2XH100, 4XA100-40, 4XA100-80, 4XH100, 8XA100-40, 8XA100-80, 8XH100 | n/a | |
| registry.redhat.io/rhelai1/modelcar-llama-3-3-70b-instruct-quantized-w4a16:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 45.5 GB | 1XH100, 2XH100, 4XA100-40, 4XH100, 8XA100-40, 8XH100 | n/a | |
| registry.redhat.io/rhelai1/modelcar-llama-3-3-70b-instruct-quantized-w8a8:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 83.6 GB | 2XH100, 4XA100-40, 4XA100-80, 4XH100, 8XA100-40, 8XH100 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-llama-3-1-nemotron-ultra-253b-v1:3.0 | Validated | v0.24.0 | 3.5.0 | 3.5.0 | 582.9 GB | 8XH100 | n/a | |
| registry.redhat.io/rhelai1/modelcar-llama-4-scout-17b-16e-instruct-fp8-dynamic:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 131.9 GB | 2XH100, 2XH200, 4XH100, 8XH100, 8XL4 | n/a | |
| registry.redhat.io/rhelai1/modelcar-llama-4-scout-17b-16e-instruct-quantized-w4a16:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 74.7 GB | 2XH100, 2XH200, 4XA100-40, 4XH100, 8XA100-40, 8XH100 | n/a | |
| registry.redhat.io/rhai/modelcar-llama-guard-4-12b:3.0 | Enabled | v0.11.2 | 3.2.5 | 3.2 | 27.7 GB | 1XH200 | n/a | |
| registry.redhat.io/rhelai1/modelcar-llama-3-1-8b-instruct-fp8-dynamic:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 10.5 GB | 1XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-minimax-m2-5:3.0 | Validated | v0.14.1 | 3.4.0-ea.1 | 3.4.0-ea.1 | 264.7 GB | 2XB200, 4XA100-80, 4XB200, 4XH100, 4XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-ministral-3-14b-instruct-2512:3.0 | Validated | v0.10.1.1 | 3.2.2 | 2.25 | 18.1 GB | 1XA100-80, 1XB200, 1XH100, 1XH200, 1XL4, 2XA100-80, 2XB200, 2XH100, 2XH200, 2XL4, 4XA100-80, 4XB200, 4XH100, 4XH200, 4XL4, 8XA100-80, 8XB200, 8XH100, 8XH200, 8XL4 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-mistral-medium-3-5-128b:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 153.7 GB | 1XMI300X, 2XA100-80, 2XH100, 2XH200, 2XMI300X, 4XA100-80, 4XH100, 4XMI300X, 8XH100, 8XMI300X | n/a | |
| registry.redhat.io/rhelai1/modelcar-mistral-small-3-1-24b-instruct-2503-fp8-dynamic:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 29.7 GB | 1XA100-80, 1XH100, 1XH200, 2XA100-40, 2XA100-80, 2XH100, 2XL4, 4XA100-40, 4XA100-80, 4XH100, 4XL4, 8XA100-40, 8XH100 | n/a | |
| RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16 | registry.redhat.io/rhelai1/modelcar-mistral-small-3-1-24b-instruct-2503-quantized-w4a16:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 17.3 GB | 1XA100-40, 1XA100-80, 1XH100, 1XH200, 2XA100-40, 2XA100-80, 2XH100, 4XA100-40, 4XA100-80, 4XH100, 8XA100-40, 8XH100 | n/a |
| registry.redhat.io/rhelai1/modelcar-mistral-small-3-1-24b-instruct-2503-quantized-w8a8:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 29.7 GB | 1XA100-40, 1XA100-80, 1XH100, 1XH200, 2XA100-40, 2XA100-80, 2XH100, 2XL4, 4XA100-40, 4XA100-80, 4XH100, 4XL4, 8XA100-40, 8XA100-80, 8XH100 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-mistral-small-3-2-24b-instruct-2506:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 55.3 GB | 2XA100-80, 4XL4 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-molmo2-4b:3.0 | Validated | v0.24.0 | 3.5.0 | 3.5.0 | 22.4 GB | 1XA100-80 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-molmo2-8b:3.0 | Validated | v0.24.0 | 3.5.0 | 3.5.0 | 39.9 GB | 1XA100-80 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-nvidia-nemotron-3-super-120b-a12b-fp8:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 147.7 GB | 1XMI300X, 2XMI300X, 4XMI300X, 8XL4, 8XMI300X | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-nemotron-ultra-550b-bf16-fp8-block:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 647.8 GB | 8XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-nemotron-ultra-550b-bf16-w4a16-g128:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 336.5 GB | 4XH200, 8XA100-80 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-nvidia-nemotron-3-ultra-550b-a55b-fp8-dynamic:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 647.8 GB | 4XMI300X, 8XA100-80, 8XH200, 8XMI300X | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-nvidia-nemotron-3-ultra-550b-a55b-nvfp4:3.0 | Validated | v0.24.0 | 3.5.0 | 3.5.0 | 405.2 GB | 4XH200, 8XH100 | n/a | |
| registry.redhat.io/rhelai1/modelcar-nvidia-nemotron-nano-9b-v2-fp8-dynamic:1.5 | Validated | v0.10.1.1 | 3.2.2 | 2.25 | 11.6 GB | 1XA100-40, 1XB200, 1XH100, 1XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-phi-4-mini-instruct-fp8-dynamic:3.0 | Validated | v0.14.1 | 3.4.0-ea.1 | 3.4.0-ea.1 | 6.6 GB | 1XA100-80, 1XB200, 1XH100, 1XH200, 1XL4, 2XA100-80, 2XB200, 2XH100, 2XH200, 2XL4, 4XA100-80, 4XB200, 4XH100, 4XH200, 4XL4, 8XA100-80, 8XH100, 8XH200, 8XL4 | n/a | |
| registry.redhat.io/rhai/modelcar-phi-4-reasoning:3.0 | Enabled | v0.11.2 | 3.2.5 | 3.2 | 33.8 GB | 1XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-phi-4-reasoning-fp8-dynamic:3.0 | Validated | v0.13.0 | 3.3.0 | 3.3.0 | 18.1 GB | 1XA100-80, 1XB200, 1XH100, 1XH200, 1XL4, 2XA100-40, 2XA100-80, 2XB200, 2XH100, 2XH200, 2XL4 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-qwen2-5-1-5b-quantized-w8a8:3.0 | Validated | v0.24.0 | 3.5.0 | 3.5.0 | 2.6 GB | 1XH200 | n/a | |
| registry.redhat.io/rhelai1/modelcar-qwen2-5-7b-instruct-fp8-dynamic:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 10.1 GB | 1XA100-40, 1XA100-80, 1XH100, 1XH200, 1XL4, 2XA100-40, 2XA100-80, 2XH100, 2XL4, 4XA100-40, 4XA100-80, 4XH100 | n/a | |
| registry.redhat.io/rhelai1/modelcar-qwen2-5-7b-instruct-quantized-w4a16:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 6.4 GB | 1XA100-40, 1XA100-80, 1XH100, 1XL4, 2XA100-40, 2XH100, 4XA100-40, 4XH100, 4XL4 | n/a | |
| registry.redhat.io/rhelai1/modelcar-qwen2-5-7b-instruct-quantized-w8a8:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 10.1 GB | 1XA100-40, 1XA100-80, 1XH100, 1XL4, 2XA100-40, 2XA100-80, 2XH100, 2XL4, 4XA100-40, 4XH100, 4XL4 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-qwen3-8b:3.0 | Validated | v0.24.0 | 3.5.0 | 3.5.0 | 18.9 GB | 1XH200, 8XA100-80 | n/a | |
| registry.redhat.io/rhelai1/modelcar-qwen3-8b-fp8-dynamic:1.5 | Validated | v0.10.0 | 3.2.1 | 2.24 | 10.9 GB | 1XA100-40, 1XH100, 1XH200, 1XL4, 2XA100-40, 2XH100, 2XH200, 2XL4, 4XA100-40, 4XH100, 4XH200, 4XL4, 8XA100-40, 8XH100, 8XH200, 8XL4 | n/a | |
| registry.redhat.io/rhelai1/modelcar-qwen3-coder-480b-a35b-instruct-fp8:1.5 | Validated | v0.10.1.1 | 3.2.2 | 2.25 | 554.5 GB | 4XB200, 4XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-qwen3-coder-next-nvfp4:3.0 | Validated | v0.14.1 | 3.4.0-ea.1 | 3.4.0-ea.1 | 54.8 GB | 1XB200, 1XH100, 1XH200, 2XB200, 2XH100, 2XH200, 4XB200, 4XH100, 4XH200, 8XB200, 8XH100, 8XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-qwen3-next-80b-a3b-instruct-fp8:3.0 | Validated | v0.13.0 | 3.3.0 | 3.3.0 | 94.4 GB | 1XB200, 2XA100-80, 2XB200, 2XH200, 4XA100-80, 4XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-qwen3-next-80b-a3b-instruct-quantized-w4a16:3.0 | Validated | v0.13.0 | 3.3.0 | 3.3.0 | 50.5 GB | 1XA100-80, 1XB200, 1XH100, 1XH200, 2XA100-80, 2XB200, 2XH100, 2XH200, 4XA100-80, 4XB200, 4XH100, 4XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-qwen3-vl-235b-a22b-instruct-nvfp4:3.0 | Validated | v0.11.2 | 3.2.5 | 3.2 | 155.6 GB | 1XB200, 2XA100-80, 2XB200, 2XH100, 2XH200, 4XA100-80, 4XB200, 4XH100, 4XH200, 8XA100-80, 8XB200, 8XH100, 8XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-qwen3-vl-30b-a3b-instruct:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 71.5 GB | 1XA100-80, 1XH100, 1XH200, 1XMI300X, 2XA100-80, 2XH100, 2XMI300X, 4XA100-80, 4XH100, 4XL4, 4XMI300X, 8XA100-80, 8XMI300X | n/a | |
| registry.redhat.io/rhai/modelcar-qwen3-5-122b-a10b-fp8-dynamic:3.0 | Validated | v0.17.1 | 3.4.0-ea.2 | 3.4.0-ea.2 | 147.1 GB | 2XA100-80, 2XH100, 4XA100-80, 4XH200, 8XA100-80, 8XH100 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-qwen3-5-2b:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 5.3 GB | 8XA100-80 | n/a | |
| registry.redhat.io/rhai/modelcar-qwen3-5-35b-a3b-fp8-dynamic:3.0 | Validated | v0.17.1 | 3.4.0-ea.2 | 3.4.0-ea.2 | 43.4 GB | 1XA100-80, 1XH100, 1XH200, 2XA100-80, 2XH100, 2XH200, 4XA100-80, 4XH100, 4XH200, 8XA100-80, 8XH100, 8XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-qwen3-5-397b-a17b-fp8-dynamic:3.0 | Validated | v0.17.1 | 3.4.0-ea.2 | 3.4.0-ea.2 | 466.0 GB | 4XH200, 8XA100-80, 8XH100 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-qwen3-6-27b-fp8:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 35.5 GB | 8XH100 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-qwen3-6-35b-a3b:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 82.7 GB | 1XA100-80, 1XH100, 2XA100-80, 2XH100, 2XH200, 4XA100-80, 4XH100, 8XH100, 8XL4 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-qwen3-6-35b-a3b-fp8:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 43.1 GB | 1XA100-80, 1XH100, 1XH200, 1XMI300X, 2XA100-80, 2XH100, 2XH200, 2XL4, 2XMI300X, 4XA100-80, 4XH100, 4XH200, 4XL4, 4XMI300X, 8XH100, 8XMI300X | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-qwen3-6-35b-a3b-fp8-dynamic:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 45.3 GB | 1XA100-80, 1XH100, 1XH200, 2XA100-80, 2XH100, 2XH200, 2XL4, 4XA100-80, 4XH100, 4XH200, 4XL4, 8XA100-80, 8XH100 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-qwen3-6-35b-a3b-nvfp4:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 28.9 GB | 1XA100-40, 1XA100-80, 1XH100, 1XH200, 2XA100-80, 2XH100, 2XH200, 4XA100-80, 4XH100, 4XH200, 8XA100-80, 8XH100 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-trinity-large-thinking-nvfp4:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 266.3 GB | 2XH200, 4XA100-80, 4XH100, 4XH200, 8XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-diffusiongemma-26b-a4b-it-fp8-dynamic:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 31.3 GB | 1XA100-80, 1XMI300X, 2XMI300X, 4XMI300X, 8XMI300X | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-diffusiongemma-26b-a4b-it-nvfp4:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 20.8 GB | 1XA100-80 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-gemma-3-12b-it:3.0 | Enabled | v0.11.2 | 3.2.5 | 3.2 | 28.1 GB | 1XH200 | n/a | |
| registry.redhat.io/rhelai1/modelcar-gemma-3n-e4b-it-fp8-dynamic:1.5 | Validated | v0.10.0 | 3.2.1 | 2.24 | 13.6 GB | 1XA100-40, 1XH100, 1XH200, 1XL4, 2XA100-40, 2XH100, 2XH200, 2XL4, 4XA100-40, 4XH100, 4XH200, 4XL4, 8XA100-40, 8XH100, 8XH200, 8XL4 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-gemma-4-12b-it-fp8-dynamic:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 17.3 GB | 1XA100-80, 1XH100, 1XH200, 2XA100-80, 2XH100, 2XH200, 4XA100-80, 4XH100, 8XA100-80 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-gemma-4-12b-it-nvfp4:3.0 | Validated | v0.24.0 | 3.5.0 | 3.5.0 | 11.9 GB | 1XA100-80, 1XH100, 1XH200, 2XA100-80, 2XH100, 2XH200, 4XA100-80, 4XH100, 8XA100-80 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-gemma-4-26b-a4b-it:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 59.4 GB | 1XA100-80, 1XH100, 1XH200, 2XA100-80, 2XH100, 2XH200, 4XA100-80, 4XH100, 4XL4 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-gemma-4-26b-a4b-it-fp8-dynamic:3.0 | Enabled | v0.18.0 | 3.4.0 | 3.4.0 | 33.0 GB | 1XA100-80, 1XH100, 1XH200, 1XMI300X, 2XA100-80, 2XH100, 2XH200, 2XL4, 2XMI300X, 4XH100, 4XMI300X, 8XMI300X | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-gemma-4-26b-a4b-it-nvfp4:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 18.9 GB | 1XA100-40, 1XA100-80, 1XH100, 1XH200, 2XA100-80, 2XH100, 4XA100-80, 4XH100 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-gemma-4-26b-a4b:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 59.4 GB | 1XA100-80, 1XH100, 1XH200, 2XA100-80, 2XH100, 2XH200, 4XA100-80, 4XH100, 4XH200, 8XA100-80 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-gemma-4-31b-it:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 72.0 GB | 1XA100-80, 1XH100, 1XH200, 2XA100-80, 2XH100, 4XA100-80, 4XH100 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-gemma-4-31b-it-fp8-dynamic:3.0 | Enabled | v0.18.0 | 3.4.0 | 3.4.0 | 38.3 GB | 1XA100-80, 1XH100, 1XH200, 1XMI300X, 2XA100-80, 2XH100, 2XH200, 2XL4, 2XMI300X, 4XA100-80, 4XH100, 4XMI300X, 8XA100-80, 8XMI300X | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-gemma-4-31b-it-fp8-block:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 38.3 GB | 1XA100-80, 1XH100, 1XH200, 2XA100-80, 2XH100, 2XL4, 4XA100-80, 4XH100 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-gemma-4-31b-it-nvfp4:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 26.8 GB | 1XA100-40, 1XA100-80, 1XH100, 1XH200, 2XA100-40, 2XA100-80, 2XH100, 4XA100-80, 4XH100, 8XA100-80 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-gemma-4-31b:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 72.0 GB | 1XA100-80, 1XH100, 1XH200, 2XA100-80, 2XH100, 4XA100-80, 4XH100, 8XA100-80 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-gemma-4-e4b-it:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 18.4 GB | 1XA100-80, 1XH100, 1XH200, 2XA100-80, 2XH100, 2XH200, 4XA100-80, 4XH100, 8XA100-80 | n/a | |
| v0.13.0 | 3.3.0 | 3.3.0 | 1XH200 | n/a | ||||
| Validated | v0.13.0 | 3.3.0 | 3.3.0 | 15.9 GB | 1XA100-80, 1XH200 | n/a | ||
| registry.redhat.io/rhelai1/modelcar-granite-3-1-8b-instruct-fp8-dynamic:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 10.1 GB | 1XH200 | n/a | |
| registry.redhat.io/rhelai1/modelcar-granite-3-1-8b-instruct-quantized-w4a16:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 5.7 GB | 1XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-granite-4-0-h-small-fp8-dynamic:3.0 | Validated | v0.13.0 | 3.3.0 | 3.3.0 | 37.6 GB | 1XA100-80, 1XB200, 1XH100, 1XH200 | n/a | |
| registry.redhat.io/rhelai1/modelcar-phi-4-fp8-dynamic:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 18.1 GB | 1XA100-40, 1XA100-80, 1XH100, 1XH200, 2XA100-40, 2XA100-80, 2XH100, 2XL4 | n/a | |
| registry.redhat.io/rhelai1/modelcar-phi-4-quantized-w4a16:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 10.5 GB | 1XA100-40, 1XA100-80, 1XH100, 2XA100-40, 2XA100-80, 2XH100, 2XL4 | n/a | |
| registry.redhat.io/rhelai1/modelcar-phi-4-quantized-w8a8:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 18.1 GB | 1XA100-40, 1XA100-80, 1XH100, 2XA100-40, 2XA100-80, 2XH100 | n/a | |
| registry.redhat.io/rhai/modelcar-sarvam-105b-fp8-dynamic:3.0 | Validated | v0.18.0 | 3.4.0 | 3.4.0 | 129.6 GB | 1XH200, 2XH200, 4XH100, 4XH200, 8XH100, 8XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-sarvam-30b-fp8-dynamic:3.0 | Validated | v0.18.0 | 3.4.0 | 3.4.0 | 44.5 GB | 1XA100-80, 1XH100, 1XH200, 2XA100-80, 2XH100, 2XH200, 4XA100-80, 4XH100, 4XH200, 8XA100-80, 8XH100, 8XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-snowflake-arctic-embed-l-v2-0:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 2.7 GB | 1XL4 | n/a | |
| registry.redhat.io/rhai/modelcar-redhatai-translategemma-4b-it:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 9.9 GB | 1XA100-80, 1XL4 | n/a | |
| registry.redhat.io/rhai/modelcar-allenai-olmocr-2-7b-1025-fp8:3.0 | Validated | v0.19.1 | 3.5.0-ea.1 | 3.5.0-ea.1 | 11.6 GB | 1XA100-80, 1XL4 | n/a | |
| registry.redhat.io/rhelai1/modelcar-granite-3-1-8b-instruct:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 18.8 GB | 1XA100-40, 1XA100-80, 1XH100, 1XH200, 1XL4, 2XA100-40, 2XA100-80, 2XH100, 2XL4, 4XA100-40, 4XA100-80, 4XH100, 4XL4, 8XA100-40, 8XA100-80 | n/a | |
| registry.redhat.io/rhai/modelcar-ibm-granite-granite-docling-258m:3.0 | Validated | v0.19.1 | 3.5.0-ea.1 | 3.5.0-ea.1 | 0.6 GB | 1XA100-80, 1XL4 | n/a | |
| registry.redhat.io/rhai/modelcar-granite-guardian-3-2-5b:3.0 | Enabled | v0.11.2 | 3.2.5 | 3.2 | 13.3 GB | 1XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-granite-4-0-h-tiny-fp8-dynamic:3.0 | Validated | v0.10.1.1 | 3.2.2 | 2.25 | 8.2 GB | 1XB200, 1XH100, 1XH200, 1XL4 | n/a | |
| registry.redhat.io/rhai/modelcar-llama-2-7b-chat-hf:3.0 | Enabled | v0.11.2 | 3.2.5 | 3.2 | 15.5 GB | 1XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-llama-3-1-8b-instruct-essential:3.0 | Validated | v0.8.4 | 3.0 | 2.21 | 18.5 GB | 1XA100-40, 1XA100-80, 1XH100, 1XH200, 1XL4, 2XA100-40, 2XA100-80, 2XH100, 2XL4, 4XA100-40, 4XA100-80, 4XH100, 4XL4, 8XA100-40, 8XA100-80 | n/a | |
| registry.redhat.io/rhelai1/modelcar-llama-3-3-70b-instruct:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 162.3 GB | 2XH200, 4XA100-80, 4XH100, 8XA100-40, 8XH100 | n/a | |
| registry.redhat.io/rhelai1/modelcar-llama-4-maverick-17b-128e-instruct:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 923.7 GB | 8XH200 | n/a | |
| registry.redhat.io/rhelai1/modelcar-llama-4-maverick-17b-128e-instruct-fp8:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 479.3 GB | 4XH200, 8XH100 | n/a | |
| registry.redhat.io/rhelai1/modelcar-llama-4-scout-17b-16e-instruct:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 249.9 GB | 4XA100-80, 4XH100, 4XH200, 8XH100 | n/a | |
| v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 1XH200 | n/a | ||||
| registry.redhat.io/rhelai1/modelcar-phi-4:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 33.8 GB | 1XA100-40, 1XA100-80, 1XH100, 1XH200, 2XA100-40, 2XA100-80, 2XH100, 2XL4 | n/a | |
| registry.redhat.io/rhai/modelcar-devstral-small-2-24b-instruct-2512:3.0 | Validated | v0.14.1 | 3.4.0-ea.1 | 3.4.0-ea.1 | 29.7 GB | 1XA100-80, 1XB200, 1XH100, 1XH200, 2XA100-80, 2XB200, 2XH100, 2XH200, 4XA100-80, 4XB200, 4XH100, 4XH200, 4XL4, 8XA100-80, 8XB200, 8XH100, 8XH200, 8XL4 | n/a | |
| registry.redhat.io/rhai/modelcar-mistralai-magistral-small-2509:3.0 | Validated | v0.19.1 | 3.5.0-ea.1 | 3.5.0-ea.1 | 55.3 GB | 2XA100-80, 4XL4 | n/a | |
| registry.redhat.io/rhai/modelcar-ministral-3-3b-instruct-2512:3.0 | Validated | v0.14.1 | 3.4.0-ea.1 | 3.4.0-ea.1 | 5.4 GB | 1XA100-80, 1XB200, 1XH100, 1XH200, 1XL4, 2XA100-80, 2XB200, 2XH100, 2XH200, 2XL4, 4XA100-80, 4XB200, 4XH100, 4XH200, 4XL4, 8XA100-80, 8XB200, 8XH100, 8XH200, 8XL4 | n/a | |
| registry.redhat.io/rhai/modelcar-mistral-large-3-675b-instruct-2512:3.0 | Validated | v0.11.2 | 3.2.5 | 3.2 | 783.8 GB | 8XB200, 8XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-mistral-large-3-675b-instruct-2512-nvfp4:3.0 | Validated | v0.11.2 | 3.2.5 | 3.2 | 463.7 GB | 4XB200, 4XH200, 8XA100-80, 8XB200, 8XH100, 8XH200 | n/a | |
| registry.redhat.io/rhelai1/modelcar-mistral-small-24b-instruct-2501:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 54.3 GB | 1XA100-80, 1XH100, 2XA100-40, 2XA100-80, 2XH100, 4XA100-40, 4XA100-80, 4XH100, 4XL4, 8XA100-40, 8XH100 | n/a | |
| registry.redhat.io/rhelai1/modelcar-mistral-small-3-1-24b-instruct-2503:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 55.3 GB | 1XA100-80, 1XH100, 1XH200, 2XA100-40, 2XA100-80, 2XH100, 4XA100-40, 4XA100-80, 4XH100, 4XL4, 8XA100-40, 8XH100 | n/a | |
| registry.redhat.io/rhelai1/modelcar-mixtral-8x7b-instruct-v0-1:1.4 | Validated | v0.8.4 | 3.0 | 2.21 | 107.5 GB | 1XH200, 2XA100-80, 2XH100, 4XA100-40, 4XA100-80, 4XH100, 8XA100-40, 8XH100, 8XL4 | n/a | |
| registry.redhat.io/rhelai1/modelcar-llama-3-1-nemotron-70b-instruct-hf:1.5 | Validated | v0.8.4 | 3.0 | 2.21 | 162.3 GB | 2XH200, 4XA100-80, 4XH100, 8XA100-40 | n/a | |
| registry.redhat.io/rhai/modelcar-nvidia-llama-3-1-nemotron-safety-guard-8b-v3:3.0 | Validated | v0.19.1 | 3.5.0-ea.1 | 3.5.0-ea.1 | 18.5 GB | 1XA100-80, 1XL4 | n/a | |
| registry.redhat.io/rhai/modelcar-nvidia-nemotron-3-nano-30b-a3b-fp8:3.0 | Validated | v0.11.2 | 3.2.5 | 3.2 | 37.6 GB | 1XB200, 1XH100, 1XH200, 2XB200, 2XH100, 2XH200, 4XB200, 4XH100, 4XH200, 8XB200, 8XH100, 8XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-nvidia-nemotron-3-super-120b-a12b-bf16:3.0 | Validated | v0.17.1 | 3.4.0-ea.2 | 3.4.0-ea.2 | 284.4 GB | 2XH200, 4XA100-80, 4XH100, 4XH200, 8XA100-80, 8XH100, 8XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-nvidia-nemotron-3-super-120b-a12b-fp8:3.0 | Validated | v0.17.1 | 3.4.0-ea.2 | 3.4.0-ea.2 | 147.7 GB | 1XH200, 2XH100, 2XH200, 4XH100, 4XH200, 8XH100, 8XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-nvidia-nemotron-3-super-120b-a12b-nvfp4:3.0 | Validated | v0.17.1 | 3.4.0-ea.2 | 3.4.0-ea.2 | 92.4 GB | 1XH200, 2XH100, 2XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-openai-whisper-large-v3:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 10.7 GB | 1XL4 | n/a | |
| registry.redhat.io/rhelai1/modelcar-gpt-oss-120b:1.5 | Validated | v0.10.1.1 | 3.2.2 | 2.25 | 75.1 GB | 1XB200, 1XH100, 1XH200, 2XB200, 2XH100, 2XH200, 4XA100-40, 4XB200, 4XH100, 4XH200, 4XL4, 8XA100-40, 8XB200, 8XH100, 8XH200, 8XL4 | n/a | |
| registry.redhat.io/rhelai1/modelcar-gpt-oss-20b:1.5 | Validated | v0.10.1.1 | 3.5.0-ea.2 | 3.5.0-ea.2 | 15.9 GB | 1XA100-40, 1XA100-80, 1XB200, 1XH100, 1XH200, 1XL4, 2XA100-40, 2XB200, 2XH100, 2XH200, 2XL4, 4XA100-40, 4XB200, 4XH100, 4XH200, 4XL4, 8XA100-40, 8XB200, 8XH100, 8XH200, 8XL4 | n/a | |
| registry.redhat.io/rhai/modelcar-openai-gpt-oss-safeguard-120b:3.0 | Validated | v0.21.0 | 3.5.0-ea.2 | 3.5.0-ea.2 | 75.1 GB | 1XA100-80, 2XA100-40 | n/a | |
| registry.redhat.io/rhai/modelcar-openai-gpt-oss-safeguard-20b:3.0 | Validated | v0.19.1 | 3.5.0-ea.1 | 3.5.0-ea.1 | 15.9 GB | 1XA100-80, 2XL4 | n/a | |
| registry.redhat.io/rhai/modelcar-gpt-oss-120b-essential:3.0 | Validated | v0.13.0 | 3.3.0 | 3.3.0 | 75.1 GB | 1XH200 | n/a | |
| registry.redhat.io/rhai/modelcar-gpt-oss-20b-essential:3.0 | Validated | v0.13.0 | 3.3.0 | 3.3.0 | 15.9 GB | 1XA100-80, 1XH200 | n/a |
'%20d='M201.5%20305.5c-13.8%200-24.9-11.1-24.9-24.6%200-13.8%2011.1-24.9%2024.9-24.9%2013.6%200%2024.6%2011.1%2024.6%2024.9%200%2013.6-11.1%2024.6-24.6%2024.6zM504%20256c0%20137-111%20248-248%20248S8%20393%208%20256%20119%208%20256%208s248%20111%20248%20248zm-132.3-41.2c-9.4%200-17.7%203.9-23.8%2010-22.4-15.5-52.6-25.5-86.1-26.6l17.4-78.3%2055.4%2012.5c0%2013.6%2011.1%2024.6%2024.6%2024.6%2013.8%200%2024.9-11.3%2024.9-24.9s-11.1-24.9-24.9-24.9c-9.7%200-18%205.8-22.1%2013.8l-61.2-13.6c-3-.8-6.1%201.4-6.9%204.4l-19.1%2086.4c-33.2%201.4-63.1%2011.3-85.5%2026.8-6.1-6.4-14.7-10.2-24.1-10.2-34.9%200-46.3%2046.9-14.4%2062.8-1.1%205-1.7%2010.2-1.7%2015.5%200%2052.6%2059.2%2095.2%20132%2095.2%2073.1%200%20132.3-42.6%20132.3-95.2%200-5.3-.6-10.8-1.9-15.8%2031.3-16%2019.8-62.5-14.9-62.5zM302.8%20331c-18.2%2018.2-76.1%2017.9-93.6%200-2.2-2.2-6.1-2.2-8.3%200-2.5%202.5-2.5%206.4%200%208.6%2022.8%2022.8%2087.3%2022.8%20110.2%200%202.5-2.2%202.5-6.1%200-8.6-2.2-2.2-6.1-2.2-8.3%200zm7.7-75c-13.6%200-24.6%2011.1-24.6%2024.9%200%2013.6%2011.1%2024.6%2024.6%2024.6%2013.8%200%2024.9-11.1%2024.9-24.6%200-13.8-11-24.9-24.9-24.9z'/%3e%3c/svg%3e){kind=small}