Text · Qwen
Qwen2.5-32B-Instruct
A 32B Qwen instruct model. Most 12 GB cards will not hold the 4-bit estimate. A 24 GB card is the first size to check.
Freshness uses the repository open date. This record is 775 days old, opened 2024-09-17. Popularity uses 1,051,337 downloads and 375 likes listed by Hugging Face. Checked 2026-11-01. Neither number grades answers. Formulas.
Hugging Face reports 65.5 GB of storage for the whole repository. That figure can include several packs, so the fit table does not use it as the size of one file.
Will it fit?
Save a machine on the hardware page and this block fills in. The table already has the sizes.
| Pack | Size | Saved machine |
|---|---|---|
| Weight shards summed | 65.5 GB weights + 2.5 GB allowance. File: 17 shard files in the repository root. | Choose a machine |
| Q4 estimate | 18.0 GB weights + 2.5 GB allowance. | Choose a machine |
| Q8 estimate | 34.4 GB weights + 2.5 GB allowance. | Choose a machine |
| FP16 estimate | 65.5 GB weights + 2.5 GB allowance. | Choose a machine |
Estimate rows use the parameter count. A measured row names a file in the repository. The allowance is fixed: it stands in for context or activations, and it is not a measurement from a run.
How to run it
Text models are usually loaded from a quantized pack in llama.cpp, Ollama, or LM Studio, or from the original weights with the publisher's own instructions. AI Price Desk does not host the weights.
Publisher repository on Hugging Face
Others in Text
Qwen3.8-27B · Qwen
gemma-4-31B-it · google
bge-m3 · BAAI
This directory is assembled from public model records. Freshness is age. Popularity is downloads and likes. A fit figure is an estimate from a parameter count or from a published file size, not a run on our hardware. How the numbers are made. AI disclosure.