Home · Models · Coding

Coding · Qwen

Qwen2.5-Coder-32B-Instruct

Qwen's 32B coder instruct model. Use the 4-bit row on a 24 GB card and the rented row if that estimate does not fit.

32.76BParameters
apache-2.0License
32,768 tokensContext
2024-11-06Opened
6Freshness 6 / 100
78Popularity 78 / 100

Freshness uses the repository open date. This record is 725 days old, opened 2024-11-06. Popularity uses 492,490 downloads and 2,202 likes listed by Hugging Face. Checked 2026-11-01. Neither number grades answers. Formulas.

Hugging Face reports 131.1 GB of storage for the whole repository. That figure can include several packs, so the fit table does not use it as the size of one file.

Will it fit?

Save a machine on the hardware page and this block fills in. The table already has the sizes.

PackSizeSaved machine
Weight shards summed65.5 GB weights + 2.5 GB allowance. File: 14 shard files in the repository root.Choose a machine
Q4 estimate18.0 GB weights + 2.5 GB allowance.Choose a machine
Q8 estimate34.4 GB weights + 2.5 GB allowance.Choose a machine
FP16 estimate65.5 GB weights + 2.5 GB allowance.Choose a machine

Estimate rows use the parameter count. A measured row names a file in the repository. The allowance is fixed: it stands in for context or activations, and it is not a measurement from a run.

How to run it

Text models are usually loaded from a quantized pack in llama.cpp, Ollama, or LM Studio, or from the original weights with the publisher's own instructions. AI Price Desk does not host the weights.

Publisher repository on Hugging Face

Others in Coding

Qwen2.5-Coder-7B-Instruct · Qwen

DeepSeek-Coder-V2-Lite-Instruct · deepseek-ai

This directory is assembled from public model records. Freshness is age. Popularity is downloads and likes. A fit figure is an estimate from a parameter count or from a published file size, not a run on our hardware. How the numbers are made. AI disclosure.