GGUF Model VRAM Calculator
📈
13
Calculate VRAM requirements for LLM models
LLM
-
-
matchaaaaa/Honey-Yuzu-13B
Text Generation • 12B • Updated • 3 • 7 -
QuantFactory/Mistral-Nemo-Instruct-2407-GGUF
12B • Updated • 2k • 51 -
Lewdiculous/MN-12B-Lyra-v4-GGUF-IQ-Imatrix
12B • Updated • 6.53k • 41 -
knifeayumu/Cydonia-v1.3-Magnum-v4-22B-GGUF
22B • Updated • 1.29k • 24 -
bartowski/NemoMix-Unleashed-12B-GGUF
Text Generation • 12B • Updated • 14.4k • 118