Model field guide

Qwen3-1.7B

42 of 44 hardware configurations have a supported memory fit at one or more recorded quantizations. Runtime compatibility still needs verification.

Total parameters2.03B
Active parameters2.03B
Recorded context limit40,960
Architecturedense
Customize the estimate ↗Official model record

Verified 2026-10-22 · license metadata: apache-2.0 · commercial use: yes (review the terms).

Actual files, not a size shortcut.

Recorded complete GGUF file sets
QuantizationTotal file sizeSource
Q4_K_M1.031 GiB1,107,409,472 bytes; 1 file(s)Sum of exact file byte sizes in the repository listing at the recorded commit; every declared shard is present. Auxiliary vision projector and speculative-decoding files are excluded. Labels follow publisher filenames; mixed-precision expert tensors may remain in a differently labeled file, so the estimator uses measured bytes rather than assumed bits per weight.Pinned file recordVerified 2026-10-22
Q5_K_M1.171 GiB1,257,880,128 bytes; 1 file(s)Sum of exact file byte sizes in the repository listing at the recorded commit; every declared shard is present. Auxiliary vision projector and speculative-decoding files are excluded. Labels follow publisher filenames; mixed-precision expert tensors may remain in a differently labeled file, so the estimator uses measured bytes rather than assumed bits per weight.Pinned file recordVerified 2026-10-22
Q8_01.708 GiB1,834,426,944 bytes; 1 file(s)Sum of exact file byte sizes in the repository listing at the recorded commit; every declared shard is present. Auxiliary vision projector and speculative-decoding files are excluded. Labels follow publisher filenames; mixed-precision expert tensors may remain in a differently labeled file, so the estimator uses measured bytes rather than assumed bits per weight.Pinned file recordVerified 2026-10-22

The hardware picture.

Q4_K_M: hardware comparison
Qwen3-1.7B · Q4_K_M · default context up to 4,096 tokens · estimated fit and speed
HardwareUsable memoryRequired memoryFit estimateEstimated generation
Mac mini M6 (12-core GPU) 16GB12.0 GiB2.47 GiBfits55.3–110.5 estimated tokens/s
Mac mini M6 (12-core GPU) 24GB18.0 GiB2.47 GiBfits61.4–122.8 estimated tokens/s
Mac mini M6 (12-core GPU) 32GB24.0 GiB2.47 GiBfits61.4–122.8 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 24GB18.0 GiB2.47 GiBfits110.9–221.8 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 48GB36.0 GiB2.47 GiBfits110.9–221.8 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 64GB48.0 GiB2.47 GiBfits110.9–221.8 estimated tokens/s
Mac Studio M5 Max (32-core GPU) 36GB27.0 GiB2.47 GiBfits166.2–332.3 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 64GB48.0 GiB2.47 GiBfits221.8–443.6 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 128GB96.0 GiB2.47 GiBfits221.8–443.6 estimated tokens/s
Mac Studio M5 Ultra (30-core CPU / 64-core GPU) 96GB72.0 GiB2.47 GiBfits433.4–866.9 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 256GB192.0 GiB2.47 GiBfits433.4–866.9 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 512GB384.0 GiB2.47 GiBfits433.4–866.9 estimated tokens/s
MacBook Pro 14-inch M5 (10-core GPU) 24GB18.0 GiB2.47 GiBfits55.3–110.5 estimated tokens/s
MacBook Pro 14-inch M5 Pro (20-core GPU) 48GB36.0 GiB2.47 GiBfits110.9–221.8 estimated tokens/s
MacBook Pro 16-inch M5 Max (40-core GPU) 128GB96.0 GiB2.47 GiBfits221.8–443.6 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 16GB12.0 GiB2.47 GiBfits43.3–86.7 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 24GB18.0 GiB2.47 GiBfits43.3–86.7 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 32GB24.0 GiB2.47 GiBfits43.3–86.7 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 24GB18.0 GiB2.47 GiBfits98.6–197.2 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 48GB36.0 GiB2.47 GiBfits98.6–197.2 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 64GB48.0 GiB2.47 GiBfits98.6–197.2 estimated tokens/s
Mac Studio (2025) M4 Max (32-core GPU) 36GB27.0 GiB2.47 GiBfits148.1–296.2 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 64GB48.0 GiB2.47 GiBfits197.2–394.4 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 128GB96.0 GiB2.47 GiBfits197.2–394.4 estimated tokens/s
Mac Studio (2025) M3 Ultra (28-core CPU / 60-core GPU) 96GB72.0 GiB2.47 GiBfits295.8–591.7 estimated tokens/s
Mac Studio (2025) M3 Ultra (32-core CPU / 80-core GPU) 256GB192.0 GiB2.47 GiBfits295.8–591.7 estimated tokens/s
NVIDIA GeForce RTX 3060 12GB10.8 GiB2.47 GiBfits130.0–260.1 estimated tokens/s
NVIDIA GeForce RTX 3090 24GB21.6 GiB2.47 GiBfits338.1–676.2 estimated tokens/s
NVIDIA GeForce RTX 4060 Ti 16GB14.4 GiB2.47 GiBfits104.0–208.1 estimated tokens/s
NVIDIA GeForce RTX 4070 12GB GDDR6X10.8 GiB2.47 GiBfits182.0–364.1 estimated tokens/s
NVIDIA GeForce RTX 4080 16GB14.4 GiB2.47 GiBfits258.9–517.8 estimated tokens/s
NVIDIA GeForce RTX 4090 24GB21.6 GiB2.47 GiBfits364.1–728.2 estimated tokens/s
NVIDIA GeForce RTX 5060 Ti 16GB14.4 GiB2.47 GiBfits161.8–323.6 estimated tokens/s
NVIDIA GeForce RTX 5070 12GB10.8 GiB2.47 GiBfits242.7–485.5 estimated tokens/s
NVIDIA GeForce RTX 5070 Ti 16GB14.4 GiB2.47 GiBfits323.6–647.3 estimated tokens/s
NVIDIA GeForce RTX 5080 16GB14.4 GiB2.47 GiBfits346.8–693.5 estimated tokens/s
NVIDIA GeForce RTX 5090 32GB28.8 GiB2.47 GiBfits647.3–1294.6 estimated tokens/s
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 96GB86.4 GiB2.47 GiBfits647.3–1294.6 estimated tokens/s
NVIDIA RTX 6000 Ada Generation 48GB43.2 GiB2.47 GiBfits346.8–693.5 estimated tokens/s
Intel Arc B580 12GB10.8 GiB2.47 GiBfits164.7–329.4 estimated tokens/s
AMD Ryzen AI Halo, Ryzen AI Max+ 395, 128GB89.6 GiB2.47 GiBfits92.5–184.9 estimated tokens/s
NVIDIA DGX Spark 128GB / 4TB96.0 GiB2.47 GiBfits98.6–197.2 estimated tokens/s
2 × GeForce RTX 3090 24GB (conditional 48GB aggregate)40.8 GiB2.47 GiBNeeds verificationEstimated speed unavailable
2 × GeForce RTX 5090 32GB (conditional 64GB aggregate)54.4 GiB2.47 GiBNeeds verificationEstimated speed unavailable
Q5_K_M: hardware comparison
Qwen3-1.7B · Q5_K_M · default context up to 4,096 tokens · estimated fit and speed
HardwareUsable memoryRequired memoryFit estimateEstimated generation
Mac mini M6 (12-core GPU) 16GB12.0 GiB2.61 GiBfits48.7–97.3 estimated tokens/s
Mac mini M6 (12-core GPU) 24GB18.0 GiB2.61 GiBfits54.1–108.1 estimated tokens/s
Mac mini M6 (12-core GPU) 32GB24.0 GiB2.61 GiBfits54.1–108.1 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 24GB18.0 GiB2.61 GiBfits97.6–195.2 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 48GB36.0 GiB2.61 GiBfits97.6–195.2 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 64GB48.0 GiB2.61 GiBfits97.6–195.2 estimated tokens/s
Mac Studio M5 Max (32-core GPU) 36GB27.0 GiB2.61 GiBfits146.3–292.6 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 64GB48.0 GiB2.61 GiBfits195.2–390.5 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 128GB96.0 GiB2.61 GiBfits195.2–390.5 estimated tokens/s
Mac Studio M5 Ultra (30-core CPU / 64-core GPU) 96GB72.0 GiB2.61 GiBfits381.6–763.2 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 256GB192.0 GiB2.61 GiBfits381.6–763.2 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 512GB384.0 GiB2.61 GiBfits381.6–763.2 estimated tokens/s
MacBook Pro 14-inch M5 (10-core GPU) 24GB18.0 GiB2.61 GiBfits48.7–97.3 estimated tokens/s
MacBook Pro 14-inch M5 Pro (20-core GPU) 48GB36.0 GiB2.61 GiBfits97.6–195.2 estimated tokens/s
MacBook Pro 16-inch M5 Max (40-core GPU) 128GB96.0 GiB2.61 GiBfits195.2–390.5 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 16GB12.0 GiB2.61 GiBfits38.2–76.3 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 24GB18.0 GiB2.61 GiBfits38.2–76.3 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 32GB24.0 GiB2.61 GiBfits38.2–76.3 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 24GB18.0 GiB2.61 GiBfits86.8–173.6 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 48GB36.0 GiB2.61 GiBfits86.8–173.6 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 64GB48.0 GiB2.61 GiBfits86.8–173.6 estimated tokens/s
Mac Studio (2025) M4 Max (32-core GPU) 36GB27.0 GiB2.61 GiBfits130.4–260.8 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 64GB48.0 GiB2.61 GiBfits173.6–347.3 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 128GB96.0 GiB2.61 GiBfits173.6–347.3 estimated tokens/s
Mac Studio (2025) M3 Ultra (28-core CPU / 60-core GPU) 96GB72.0 GiB2.61 GiBfits260.4–520.9 estimated tokens/s
Mac Studio (2025) M3 Ultra (32-core CPU / 80-core GPU) 256GB192.0 GiB2.61 GiBfits260.4–520.9 estimated tokens/s
NVIDIA GeForce RTX 3060 12GB10.8 GiB2.61 GiBfits114.5–229.0 estimated tokens/s
NVIDIA GeForce RTX 3090 24GB21.6 GiB2.61 GiBfits297.6–595.3 estimated tokens/s
NVIDIA GeForce RTX 4060 Ti 16GB14.4 GiB2.61 GiBfits91.6–183.2 estimated tokens/s
NVIDIA GeForce RTX 4070 12GB GDDR6X10.8 GiB2.61 GiBfits160.3–320.5 estimated tokens/s
NVIDIA GeForce RTX 4080 16GB14.4 GiB2.61 GiBfits227.9–455.9 estimated tokens/s
NVIDIA GeForce RTX 4090 24GB21.6 GiB2.61 GiBfits320.5–641.1 estimated tokens/s
NVIDIA GeForce RTX 5060 Ti 16GB14.4 GiB2.61 GiBfits142.5–284.9 estimated tokens/s
NVIDIA GeForce RTX 5070 12GB10.8 GiB2.61 GiBfits213.7–427.4 estimated tokens/s
NVIDIA GeForce RTX 5070 Ti 16GB14.4 GiB2.61 GiBfits284.9–569.8 estimated tokens/s
NVIDIA GeForce RTX 5080 16GB14.4 GiB2.61 GiBfits305.3–610.6 estimated tokens/s
NVIDIA GeForce RTX 5090 32GB28.8 GiB2.61 GiBfits569.8–1139.7 estimated tokens/s
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 96GB86.4 GiB2.61 GiBfits569.8–1139.7 estimated tokens/s
NVIDIA RTX 6000 Ada Generation 48GB43.2 GiB2.61 GiBfits305.3–610.6 estimated tokens/s
Intel Arc B580 12GB10.8 GiB2.61 GiBfits145.0–290.0 estimated tokens/s
AMD Ryzen AI Halo, Ryzen AI Max+ 395, 128GB89.6 GiB2.61 GiBfits81.4–162.8 estimated tokens/s
NVIDIA DGX Spark 128GB / 4TB96.0 GiB2.61 GiBfits86.8–173.6 estimated tokens/s
2 × GeForce RTX 3090 24GB (conditional 48GB aggregate)40.8 GiB2.61 GiBNeeds verificationEstimated speed unavailable
2 × GeForce RTX 5090 32GB (conditional 64GB aggregate)54.4 GiB2.61 GiBNeeds verificationEstimated speed unavailable
Q8_0: hardware comparison
Qwen3-1.7B · Q8_0 · default context up to 4,096 tokens · estimated fit and speed
HardwareUsable memoryRequired memoryFit estimateEstimated generation
Mac mini M6 (12-core GPU) 16GB12.0 GiB3.15 GiBfits33.4–66.7 estimated tokens/s
Mac mini M6 (12-core GPU) 24GB18.0 GiB3.15 GiBfits37.1–74.1 estimated tokens/s
Mac mini M6 (12-core GPU) 32GB24.0 GiB3.15 GiBfits37.1–74.1 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 24GB18.0 GiB3.15 GiBfits66.9–133.9 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 48GB36.0 GiB3.15 GiBfits66.9–133.9 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 64GB48.0 GiB3.15 GiBfits66.9–133.9 estimated tokens/s
Mac Studio M5 Max (32-core GPU) 36GB27.0 GiB3.15 GiBfits100.3–200.6 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 64GB48.0 GiB3.15 GiBfits133.9–267.8 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 128GB96.0 GiB3.15 GiBfits133.9–267.8 estimated tokens/s
Mac Studio M5 Ultra (30-core CPU / 64-core GPU) 96GB72.0 GiB3.15 GiBfits261.7–523.3 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 256GB192.0 GiB3.15 GiBfits261.7–523.3 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 512GB384.0 GiB3.15 GiBfits261.7–523.3 estimated tokens/s
MacBook Pro 14-inch M5 (10-core GPU) 24GB18.0 GiB3.15 GiBfits33.4–66.7 estimated tokens/s
MacBook Pro 14-inch M5 Pro (20-core GPU) 48GB36.0 GiB3.15 GiBfits66.9–133.9 estimated tokens/s
MacBook Pro 16-inch M5 Max (40-core GPU) 128GB96.0 GiB3.15 GiBfits133.9–267.8 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 16GB12.0 GiB3.15 GiBfits26.2–52.3 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 24GB18.0 GiB3.15 GiBfits26.2–52.3 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 32GB24.0 GiB3.15 GiBfits26.2–52.3 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 24GB18.0 GiB3.15 GiBfits59.5–119.1 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 48GB36.0 GiB3.15 GiBfits59.5–119.1 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 64GB48.0 GiB3.15 GiBfits59.5–119.1 estimated tokens/s
Mac Studio (2025) M4 Max (32-core GPU) 36GB27.0 GiB3.15 GiBfits89.4–178.8 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 64GB48.0 GiB3.15 GiBfits119.1–238.1 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 128GB96.0 GiB3.15 GiBfits119.1–238.1 estimated tokens/s
Mac Studio (2025) M3 Ultra (28-core CPU / 60-core GPU) 96GB72.0 GiB3.15 GiBfits178.6–357.2 estimated tokens/s
Mac Studio (2025) M3 Ultra (32-core CPU / 80-core GPU) 256GB192.0 GiB3.15 GiBfits178.6–357.2 estimated tokens/s
NVIDIA GeForce RTX 3060 12GB10.8 GiB3.15 GiBfits78.5–157.0 estimated tokens/s
NVIDIA GeForce RTX 3090 24GB21.6 GiB3.15 GiBfits204.1–408.2 estimated tokens/s
NVIDIA GeForce RTX 4060 Ti 16GB14.4 GiB3.15 GiBfits62.8–125.6 estimated tokens/s
NVIDIA GeForce RTX 4070 12GB GDDR6X10.8 GiB3.15 GiBfits109.9–219.8 estimated tokens/s
NVIDIA GeForce RTX 4080 16GB14.4 GiB3.15 GiBfits156.3–312.6 estimated tokens/s
NVIDIA GeForce RTX 4090 24GB21.6 GiB3.15 GiBfits219.8–439.6 estimated tokens/s
NVIDIA GeForce RTX 5060 Ti 16GB14.4 GiB3.15 GiBfits97.7–195.4 estimated tokens/s
NVIDIA GeForce RTX 5070 12GB10.8 GiB3.15 GiBfits146.5–293.1 estimated tokens/s
NVIDIA GeForce RTX 5070 Ti 16GB14.4 GiB3.15 GiBfits195.4–390.7 estimated tokens/s
NVIDIA GeForce RTX 5080 16GB14.4 GiB3.15 GiBfits209.3–418.7 estimated tokens/s
NVIDIA GeForce RTX 5090 32GB28.8 GiB3.15 GiBfits390.7–781.5 estimated tokens/s
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 96GB86.4 GiB3.15 GiBfits390.7–781.5 estimated tokens/s
NVIDIA RTX 6000 Ada Generation 48GB43.2 GiB3.15 GiBfits209.3–418.7 estimated tokens/s
Intel Arc B580 12GB10.8 GiB3.15 GiBfits99.4–198.9 estimated tokens/s
AMD Ryzen AI Halo, Ryzen AI Max+ 395, 128GB89.6 GiB3.15 GiBfits55.8–111.6 estimated tokens/s
NVIDIA DGX Spark 128GB / 4TB96.0 GiB3.15 GiBfits59.5–119.1 estimated tokens/s
2 × GeForce RTX 3090 24GB (conditional 48GB aggregate)40.8 GiB3.15 GiBNeeds verificationEstimated speed unavailable
2 × GeForce RTX 5090 32GB (conditional 64GB aggregate)54.4 GiB3.15 GiBNeeds verificationEstimated speed unavailable
A “fits” result checks estimated memory only. “Needs verification” preserves missing cache, vision, or placement information. All speed figures are estimated from the published bandwidth formula.
Field-level sources and verification dates