Host Mistral Nemo Instruct 12B on Vast.ai
Mistral Nemo Instruct 12B needs 1x 24GB+ GPU, and Vast.ai's current cheapest qualifying row is RTX 4090 at $0.40/hr.
Vast.ai rows that can host Mistral Nemo Instruct 12B
The cheapest tracked way to host Mistral Nemo Instruct 12B on Vast.ai is RTX 4090 at $0.40/hr. Vast.ai is currently tied for the cheapest tracked market setup for this model.
| GPU | VRAM | Per GPU | Estimated hourly | Estimated monthly | Updated |
|---|---|---|---|---|---|
| RTX 4090 | 24GB | $0.40/hr | $0.40/hr | $293/mo | Jun 21, 2026 |
| L40 | 48GB | $0.45/hr | $0.45/hr | $331/mo | Jun 21, 2026 |
| RTX 5090 | 32GB | $0.53/hr | $0.53/hr | $390/mo | Jun 21, 2026 |
| RTX 6000Ada | 48GB | $0.60/hr | $0.60/hr | $439/mo | Jun 21, 2026 |
| A100 PCIE | 80GB | $1.00/hr | $1.00/hr | $731/mo | Jun 19, 2026 |
| A100 SXM4 | 80GB | $1.14/hr | $1.14/hr | $834/mo | Jun 21, 2026 |
| H100 PCIE | 80GB | $1.64/hr | $1.64/hr | $1,199/mo | Jun 21, 2026 |
| H100 NVL | 94GB | $2.27/hr | $2.27/hr | $1,656/mo | Jun 21, 2026 |
Why this setup does or does not fit
1x 24GB+ GPU
1x 24GB to 48GB GPU. Long prompts, batching, and KV cache can require extra headroom.
Strong long-context
Good for summarization and retrieval-heavy work, though it is not a frontier reasoning model.
Mistral 12B
Useful when long prompts matter more than absolute frontier reasoning quality.
Mistral Nemo Instruct 12B on Vast.ai FAQ
Can I host Mistral Nemo Instruct 12B on Vast.ai?
The cheapest tracked way to host Mistral Nemo Instruct 12B on Vast.ai is RTX 4090 at $0.40/hr.
What GPU memory does Mistral Nemo Instruct 12B need?
Our baseline for Mistral Nemo Instruct 12B is 1x 24GB+ GPU. The practical recommendation is 1x 24GB to 48GB GPU.
Is Vast.ai the cheapest provider for Mistral Nemo Instruct 12B?
Vast.ai is currently tied for the cheapest tracked market setup for this model.
How fresh is this Vast.ai Mistral Nemo Instruct 12B cost page?
This page recalculates from the latest tracked on-demand rows. The freshest qualifying Vast.ai row shown here is from Jun 21, 2026.