Home · Models · Text

Text · Qwen

Qwen2.5-7B-Instruct

Qwen's 7B instruct model for ordinary chat. It is the size a single desktop GPU is often asked to hold.

7.62BParameters
apache-2.0License
32,768 tokensContext
2024-09-16Opened
5Freshness 5 / 100
91Popularity 91 / 100

Freshness uses the repository open date. This record is 776 days old, opened 2024-09-16. Popularity uses 5,417,131 downloads and 2,470 likes listed by Hugging Face. Checked 2026-11-01. Neither number grades answers. Formulas.

Hugging Face reports 15.3 GB of storage for the whole repository. That figure can include several packs, so the fit table does not use it as the size of one file.

Will it fit?

Save a machine on the hardware page and this block fills in. The table already has the sizes.

PackSizeSaved machine
Weight shards summed15.2 GB weights + 1.0 GB allowance. File: 4 shard files in the repository root.Choose a machine
Q4 estimate4.2 GB weights + 1.0 GB allowance.Choose a machine
Q8 estimate8.0 GB weights + 1.0 GB allowance.Choose a machine
FP16 estimate15.2 GB weights + 1.0 GB allowance.Choose a machine

Estimate rows use the parameter count. A measured row names a file in the repository. The allowance is fixed: it stands in for context or activations, and it is not a measurement from a run.

How to run it

Text models are usually loaded from a quantized pack in llama.cpp, Ollama, or LM Studio, or from the original weights with the publisher's own instructions. AI Price Desk does not host the weights.

Publisher repository on Hugging Face

Others in Text

Qwen3.8-27B · Qwen

gemma-4-31B-it · google

bge-m3 · BAAI

This directory is assembled from public model records. Freshness is age. Popularity is downloads and likes. A fit figure is an estimate from a parameter count or from a published file size, not a run on our hardware. How the numbers are made. AI disclosure.