Hardware field guide

NVIDIA GeForce RTX 5080 16GB

16 GiB listed memory; 14.4 GiB default usable budget. Graphics card only; a compatible host computer is required.

Listed memory capacity16 GiB
Listed bandwidth960 GB/s
Power reference360 W
Approximate USD reference$999
GPU only: historical launch reference (2025-01-06). Manufacturer launch starting price published 2025-01-06. Point reference, not current street pricing, not a guaranteed offer, and not the cost of a complete computer. Host, RAM, storage, PSU, cooling and tax excluded. Price source

Affiliate linking is inactive unless an enrolled publisher supplies a tag and verified product link. Required notice for an enrolled release: “As an Amazon Associate, Web Asset House earns from qualifying purchases.”

Check a model ↗View maker product page ↗

Models to investigate by task.

Capacity-qualified choices, ordered by recorded downloads. This is a shortlist for testing, not a quality ranking.

Chat and general use

Code-focused models

Vision models

No supported memory-fit recommendation in this snapshot. Additional architecture or vision-memory evidence may be needed.

Model compatibility at a glance.

Q4_K_M where recorded, otherwise the first available format; up to 4,096 tokens
Model / quantizationRequired memoryFit estimateEstimated generation
Qwen3-0.6BQ4_K_M1.81 GiBfits968.0–1935.9 estimated tokens/s
Qwen3-4BQ4_K_M3.89 GiBfits153.8–307.5 estimated tokens/s
gemma-4-26B-A4B-itQ8_0UnknownNeeds verificationEstimated speed unavailable
Qwen3-14BQ4_K_M10.01 GiBfits42.7–85.3 estimated tokens/s
gemma-4-31B-itQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen3-8BQ4_K_M6.24 GiBfits76.4–152.8 estimated tokens/s
Qwen3.8-27BQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen3.5-4BQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen3.5-9BQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen2.5-7B-InstructQ4_K_M5.58 GiBfits82.0–164.0 estimated tokens/s
GLM-5.3-FlashQ8_0UnknownNeeds verificationEstimated speed unavailable
gpt-oss-20bQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen2.5-0.5B-InstructQ4_K_M1.50 GiBfits781.4–1562.9 estimated tokens/s
DeepSeek-V3.2Q4_K_MUnknownNeeds verificationEstimated speed unavailable
Llama-3.1-8B-InstructQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen2.5-VL-7B-InstructQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen2.5-1.5B-InstructQ4_K_M2.15 GiBfits343.7–687.4 estimated tokens/s
Qwen3-VL-8B-InstructQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Llama-3.2-1B-InstructQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen3-1.7BQ4_K_M2.47 GiBfits346.8–693.5 estimated tokens/s
Qwen2.5-3B-InstructQ4_K_M3.10 GiBfits182.4–364.9 estimated tokens/s
Qwen3.6-35B-A3BQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen3-VL-4B-InstructQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen3.5-0.8BQ4_K_MUnknownNeeds verificationEstimated speed unavailable
gpt-oss-120bQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen3.5-2BQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen3-32BQ4_K_M20.40 GiBdoesn't fitEstimated speed unavailable
Qwen3.8-Flash-NextQ8_0UnknownNeeds verificationEstimated speed unavailable
Qwen3-4B-Instruct-2507Q4_K_M3.89 GiBfits153.8–307.5 estimated tokens/s
Qwen3.6-27BQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen3-VL-2B-InstructQ4_K_MUnknownNeeds verificationEstimated speed unavailable
GLM-5.3Q8_0UnknownNeeds verificationEstimated speed unavailable
Qwen2.5-VL-3B-InstructQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen3.5-27BQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen2.5-Coder-14B-InstructQ4_K_M10.12 GiBfits42.7–85.4 estimated tokens/s
Qwen2.5-Coder-7B-InstructQ4_K_M5.58 GiBfits82.0–164.0 estimated tokens/s
SmolVLM2-500M-Video-InstructQ8_01.56 GiBNeeds verificationEstimated speed unavailable
Qwen3.5-35B-A3BQ4_K_MUnknownNeeds verificationEstimated speed unavailable
DeepSeek-R1Q4_K_MUnknownNeeds verificationEstimated speed unavailable
DeepSeek-R1-Distill-Qwen-1.5BQ4_K_M2.15 GiBfits343.7–687.4 estimated tokens/s
gemma-3-1b-itQ4_K_MUnknownNeeds verificationEstimated speed unavailable
SmolLM2-135M-InstructQ4_K_M1.19 GiBfits3641.4–7282.8 estimated tokens/s
Qwen2-VL-2B-InstructQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Llama-3.2-3B-InstructQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen3-30B-A3B-Instruct-2507Q4_K_M18.66 GiBdoesn't fitEstimated speed unavailable
Qwen3-30B-A3BQ4_K_M18.66 GiBdoesn't fitEstimated speed unavailable
gemma-3-4b-itQ4_K_MUnknownNeeds verificationEstimated speed unavailable
GLM-4.7-FlashQ4_K_MUnknownNeeds verificationEstimated speed unavailable
GLM-5Q4_K_MUnknownNeeds verificationEstimated speed unavailable
MiniMax-M2.5Q4_K_M130.81 GiBdoesn't fitEstimated speed unavailable
DeepSeek-V3-0324Q4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen2.5-14B-InstructQ4_K_M10.12 GiBfits42.7–85.4 estimated tokens/s
GLM-4.5-AirQ4_K_M69.68 GiBdoesn't fitEstimated speed unavailable
Qwen2.5-VL-32B-InstructQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen3.5-122B-A10BQ4_K_MUnknownNeeds verificationEstimated speed unavailable
SmolLM3-3BQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen3.5-397B-A17BQ4_K_MUnknownNeeds verificationEstimated speed unavailable
diffusiongemma-26B-A4B-itQ4_K_MUnknownNeeds verificationEstimated speed unavailable
granite-4.1-3bQ4_K_M3.27 GiBfits182.9–365.8 estimated tokens/s
Qwen3-4B-Thinking-2507Q4_K_M3.89 GiBfits153.8–307.5 estimated tokens/s
Qwen3-Coder-30B-A3B-InstructQ4_K_M18.66 GiBdoesn't fitEstimated speed unavailable
GLM-5.1Q8_0UnknownNeeds verificationEstimated speed unavailable
Qwen2.5-Coder-32B-InstructQ4_K_M20.49 GiBdoesn't fitEstimated speed unavailable
gemma-2-9b-itQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen3-Coder-NextQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Olmo-3-7B-ThinkQ4_K_MUnknownNeeds verificationEstimated speed unavailable
medgemma-4b-itQ4_K_MUnknownNeeds verificationEstimated speed unavailable
MiniMax-M2.7Q8_0228.41 GiBdoesn't fitEstimated speed unavailable
DeepSeek-Coder-V2-Lite-InstructQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen2.5-Coder-3B-InstructQ4_K_M3.10 GiBfits182.4–364.9 estimated tokens/s
Qwen3-235B-A22BQ4_K_M134.13 GiBdoesn't fitEstimated speed unavailable
Qwen2.5-Coder-1.5B-InstructQ4_K_M2.15 GiBfits343.7–687.4 estimated tokens/s
Meta-Llama-3-8B-InstructQ4_K_MUnknownNeeds verificationEstimated speed unavailable
DeepSeek-R1-0528-Qwen3-8BQ4_K_M6.24 GiBfits76.4–152.8 estimated tokens/s
phi-4Q4_K_M10.06 GiBfits43.2–86.4 estimated tokens/s
Kimi-K2-InstructQ4_K_MUnknownNeeds verificationEstimated speed unavailable
gemma-3-27b-itQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Phi-4-mini-instructQ4_K_MUnknownNeeds verificationEstimated speed unavailable
DeepSeek-R1-Distill-Qwen-32BQ4_K_M20.49 GiBdoesn't fitEstimated speed unavailable
DeepSeek-R1-Distill-Qwen-7BQ4_K_M5.58 GiBfits82.0–164.0 estimated tokens/s
gemma-3-12b-itQ4_K_MUnknownNeeds verificationEstimated speed unavailable
GLM-5.2Q8_0UnknownNeeds verificationEstimated speed unavailable
granite-3.3-2b-instructQ4_K_M2.75 GiBfits248.5–497.0 estimated tokens/s
Olmo-3-7B-InstructQ4_K_MUnknownNeeds verificationEstimated speed unavailable
DeepSeek-V3.1Q4_K_MUnknownNeeds verificationEstimated speed unavailable
DeepSeek-R1-Distill-Qwen-14BQ4_K_M10.12 GiBfits42.7–85.4 estimated tokens/s
Kimi-K2.5Q4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen3-VL-30B-A3B-InstructQ4_K_M18.66 GiBNeeds verificationEstimated speed unavailable
SmolLM2-1.7B-InstructQ4_K_M2.73 GiBfits363.8–727.5 estimated tokens/s
SmolVLM-256M-InstructQ8_01.25 GiBNeeds verificationEstimated speed unavailable
Llama-3.3-70B-InstructQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen3-VL-32B-InstructQ4_K_MUnknownNeeds verificationEstimated speed unavailable
MiniMax-M3Q8_0423.93 GiBNeeds verificationEstimated speed unavailable
SmolLM2-360M-InstructQ4_K_M1.41 GiBfits1419.1–2838.2 estimated tokens/s
DeepSeek-R1-0528Q4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen3-Next-80B-A3B-InstructQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Meta-Llama-3-8BQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Llama-4-Scout-17B-16E-InstructQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen3-235B-A22B-Instruct-2507Q4_K_M134.13 GiBdoesn't fitEstimated speed unavailable
granite-vision-4.1-4bQ4_K_M3.27 GiBNeeds verificationEstimated speed unavailable
MiniMax-M2Q4_K_M130.81 GiBdoesn't fitEstimated speed unavailable
DeepSeek-R1-Distill-Llama-8BQ4_K_M6.08 GiBfits78.0–156.1 estimated tokens/s
Llama-3_3-Nemotron-Super-49B-v1_5Q4_K_MUnknownNeeds verificationEstimated speed unavailable
GLM-4.5Q4_K_M204.03 GiBdoesn't fitEstimated speed unavailable
SmolVLM2-2.2B-InstructQ4_K_MUnknownNeeds verificationEstimated speed unavailable
gemma-3n-E2B-itQ4_K_MUnknownNeeds verificationEstimated speed unavailable
GLM-4.1V-9B-ThinkingQ4_K_MUnknownNeeds verificationEstimated speed unavailable
medgemma-1.5-4b-itQ4_K_MUnknownNeeds verificationEstimated speed unavailable
granite-4.1-8bQ4_K_M6.61 GiBfits71.8–143.6 estimated tokens/s
SmolVLM-500M-InstructQ8_01.56 GiBNeeds verificationEstimated speed unavailable
Llama-3.1-70B-InstructQ4_K_MUnknownNeeds verificationEstimated speed unavailable
GLM-4.6V-FlashQ4_K_MUnknownNeeds verificationEstimated speed unavailable
granite-3.3-8b-instructQ4_K_M6.23 GiBfits77.7–155.4 estimated tokens/s
granite-4.2-8bQ4_K_M6.61 GiBfits71.8–143.6 estimated tokens/s
GLM-4.7Q4_K_M204.03 GiBdoesn't fitEstimated speed unavailable
Qwen2.5-7B-Instruct-1MQ4_K_M5.58 GiBfits82.0–164.0 estimated tokens/s
olmOCR-2-7B-1025Q4_K_MUnknownNeeds verificationEstimated speed unavailable
gemma-3-270m-itQ4_K_MUnknownNeeds verificationEstimated speed unavailable
granite-guardian-4.1-8bQ4_K_M6.39 GiBfits75.0–150.1 estimated tokens/s
Qwen3-30B-A3B-Thinking-2507Q4_K_M18.66 GiBdoesn't fitEstimated speed unavailable
Kimi-K2-ThinkingQ4_K_MUnknownNeeds verificationEstimated speed unavailable
granite-4.2-3bQ4_K_M3.40 GiBfits171.1–342.2 estimated tokens/s
DeepSeek-R1-Distill-Llama-70BQ4_K_M41.85 GiBdoesn't fitEstimated speed unavailable
Phi-4-mini-reasoningQ4_K_MUnknownNeeds verificationEstimated speed unavailable
granite-4.2-30bQ4_K_M18.50 GiBdoesn't fitEstimated speed unavailable
Qwen3-Next-80B-A3B-ThinkingQ4_K_MUnknownNeeds verificationEstimated speed unavailable
SmolVLM2-256M-Video-InstructQ4_K_M1.21 GiBNeeds verificationEstimated speed unavailable
granite-4.0-h-tinyQ4_K_MUnknownNeeds verificationEstimated speed unavailable
deepseek-coder-6.7b-instructQ4_K_M6.80 GiBfits94.1–188.1 estimated tokens/s
granite-4.0-h-smallQ4_K_MUnknownNeeds verificationEstimated speed unavailable
granite-4.0-350mQ4_K_MUnknownNeeds verificationEstimated speed unavailable
granite-4.0-microQ4_K_MUnknownNeeds verificationEstimated speed unavailable
GLM-4.6Q4_K_M203.21 GiBdoesn't fitEstimated speed unavailable
gpt-oss-safeguard-20bQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Olmo-3.1-32B-InstructQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Olmo-3-32B-ThinkQ4_K_MUnknownNeeds verificationEstimated speed unavailable
DeepSeek-V3.1-TerminusQ4_K_MUnknownNeeds verificationEstimated speed unavailable
granite-4.0-1bQ4_K_MUnknownNeeds verificationEstimated speed unavailable
OLMoE-1B-7B-0924-InstructQ4_K_M5.42 GiBfitsEstimated speed unavailable
gemma-3n-E4B-itQ4_K_MUnknownNeeds verificationEstimated speed unavailable
Qwen-AgentWorld-35B-A3BQ8_0UnknownNeeds verificationEstimated speed unavailable
GLM-4.6VQ4_K_M67.44 GiBNeeds verificationEstimated speed unavailable
Field-level sources and verification dates