Model provider cost

Host DeepSeek-R1 Distill Qwen 32B on AWS

DeepSeek-R1 Distill Qwen 32B needs 1x 48GB+ GPU, and AWS's current cheapest qualifying row is A100 SXM4 at $3.09/hr.

1x 48GB+ GPU 32B params High-end reasoning MIT
Cheapest on this provider
$3.09/hr
A100 SXM4
Monthly estimate
$2,254/mo
730 hours at the current median
VRAM baseline
48GB
1x 48GB+ GPU
Qualifying rows
4
Updated Jun 21, 2026

AWS rows that can host DeepSeek-R1 Distill Qwen 32B

The cheapest tracked way to host DeepSeek-R1 Distill Qwen 32B on AWS is A100 SXM4 at $3.09/hr. The overall tracked market floor is $0.45/hr on Vast.ai, so AWS is $2.63/hr above the current floor.

GPU VRAM Per GPU Estimated hourly Estimated monthly Updated
A100 SXM4 80GB $3.09/hr $3.09/hr $2,254/mo Jun 21, 2026
L40 48GB $3.39/hr $3.39/hr $2,471/mo Jun 21, 2026
H100 SXM 80GB $6.88/hr $6.88/hr $5,022/mo Jun 21, 2026
H200 141GB $7.91/hr $7.91/hr $5,776/mo Jun 21, 2026

Why this setup does or does not fit

VRAM floor

1x 48GB+ GPU

1x 48GB GPU or better. Long prompts, batching, and KV cache can require extra headroom.

Model quality

High-end reasoning

Sharper planning and analysis than small models, with a corresponding jump in latency and memory needs.

Operational note

DeepSeek 32B

A good reasoning upgrade when you want chain-of-thought style behavior without a cluster.

DeepSeek-R1 Distill Qwen 32B on AWS FAQ

Can I host DeepSeek-R1 Distill Qwen 32B on AWS?

The cheapest tracked way to host DeepSeek-R1 Distill Qwen 32B on AWS is A100 SXM4 at $3.09/hr.

What GPU memory does DeepSeek-R1 Distill Qwen 32B need?

Our baseline for DeepSeek-R1 Distill Qwen 32B is 1x 48GB+ GPU. The practical recommendation is 1x 48GB GPU or better.

Is AWS the cheapest provider for DeepSeek-R1 Distill Qwen 32B?

The overall tracked market floor is $0.45/hr on Vast.ai, so AWS is $2.63/hr above the current floor.

How fresh is this AWS DeepSeek-R1 Distill Qwen 32B cost page?

This page recalculates from the latest tracked on-demand rows. The freshest qualifying AWS row shown here is from Jun 21, 2026.

Compare this setup