Host Mistral Nemo Instruct 12B on RunPod
Mistral Nemo Instruct 12B needs 1x 24GB+ GPU, and RunPod's current cheapest qualifying row is RTX 4090 at $0.69/hr.
RunPod rows that can host Mistral Nemo Instruct 12B
The cheapest tracked way to host Mistral Nemo Instruct 12B on RunPod is RTX 4090 at $0.69/hr. The overall tracked market floor is $0.40/hr on Vast.ai, so RunPod is $0.29/hr above the current floor.
| GPU | VRAM | Per GPU | Estimated hourly | Estimated monthly | Updated |
|---|---|---|---|---|---|
| RTX 4090 | 24GB | $0.69/hr | $0.69/hr | $504/mo | Jun 21, 2026 |
| RTX 6000Ada | 48GB | $0.77/hr | $0.77/hr | $562/mo | Jun 21, 2026 |
| L40 | 48GB | $0.91/hr | $0.91/hr | $661/mo | Jun 21, 2026 |
| A100 PCIE | 80GB | $1.39/hr | $1.39/hr | $1,015/mo | Jun 21, 2026 |
| A100 SXM4 | 80GB | $1.49/hr | $1.49/hr | $1,088/mo | Jun 21, 2026 |
| H100 PCIE | 80GB | $2.89/hr | $2.89/hr | $2,110/mo | Jun 21, 2026 |
| H100 NVL | 94GB | $3.19/hr | $3.19/hr | $2,329/mo | Jun 21, 2026 |
| H100 SXM | 80GB | $3.29/hr | $3.29/hr | $2,402/mo | Jun 21, 2026 |
Why this setup does or does not fit
1x 24GB+ GPU
1x 24GB to 48GB GPU. Long prompts, batching, and KV cache can require extra headroom.
Strong long-context
Good for summarization and retrieval-heavy work, though it is not a frontier reasoning model.
Mistral 12B
Useful when long prompts matter more than absolute frontier reasoning quality.
Mistral Nemo Instruct 12B on RunPod FAQ
Can I host Mistral Nemo Instruct 12B on RunPod?
The cheapest tracked way to host Mistral Nemo Instruct 12B on RunPod is RTX 4090 at $0.69/hr.
What GPU memory does Mistral Nemo Instruct 12B need?
Our baseline for Mistral Nemo Instruct 12B is 1x 24GB+ GPU. The practical recommendation is 1x 24GB to 48GB GPU.
Is RunPod the cheapest provider for Mistral Nemo Instruct 12B?
The overall tracked market floor is $0.40/hr on Vast.ai, so RunPod is $0.29/hr above the current floor.
How fresh is this RunPod Mistral Nemo Instruct 12B cost page?
This page recalculates from the latest tracked on-demand rows. The freshest qualifying RunPod row shown here is from Jun 21, 2026.