Inference Providers
Active filters: Int4
AXERA-TECH/DeepSeek-R1-Distill-Qwen-1.5B-GPTQ-Int4
Updated • 6
• 1
AXERA-TECH/DeepSeek-R1-Distill-Qwen-7B-GPTQ-Int4
Updated • 10
• 1
AXERA-TECH/Qwen2.5-1.5B-Instruct-GPTQ-Int4
Text Generation
• Updated • 104
AXERA-TECH/Qwen2.5-3B-Instruct-GPTQ-Int4
Updated
AXERA-TECH/Qwen2.5-0.5B-Instruct-GPTQ-Int4
Text Generation
• Updated • 4
AXERA-TECH/Qwen2.5-7B-Instruct-GPTQ-Int4
Updated
JunHowie/Qwen3-0.6B-GPTQ-Int4
Text Generation
• 0.6B • Updated • 89
• 1
JunHowie/Qwen3-1.7B-GPTQ-Int4
Text Generation
• 2B • Updated • 213
• 1
JunHowie/Qwen3-32B-GPTQ-Int4
Text Generation
• 33B • Updated • 1.4k
• 4
JunHowie/Qwen3-30B-A3B-GPTQ-Int4
Text Generation
• 5B • Updated • 6
• 1
JunHowie/Qwen3-14B-GPTQ-Int4
Text Generation
• 15B • Updated • 5.7k
• 4
JunHowie/Qwen3-8B-GPTQ-Int4
Text Generation
• 8B • Updated • 746
• 4
JunHowie/Qwen3-4B-GPTQ-Int4
Text Generation
• 4B • Updated • 1.68k
• 1
JunHowie/Qwen3-4B-Instruct-2507-GPTQ-Int4
Text Generation
• 4B • Updated • 132k
• 2
JunHowie/Qwen3-4B-Thinking-2507-GPTQ-Int4
Text Generation
• 4B • Updated • 84
• 1
JunHowie/Qwen3-30B-A3B-Instruct-2507-GPTQ-Int4
Text Generation
• 31B • Updated • 33.3k
JunHowie/Qwen3-30B-A3B-Thinking-2507-GPTQ-Int4
Text Generation
• 31B • Updated • 42
JunHowie/Qwen2-7B-Instruct-GPTQ-Int4
Text Generation
• 8B • Updated • 5
JunHowie/Seed-OSS-36B-Instruct-GPTQ-Int4
Text Generation
• 36B • Updated • 2
QuantTrio/KAT-Dev-GPTQ-Int4
Text Generation
• 33B • Updated • 5
• 1
QuantTrio/Kimi-Dev-72B-GPTQ-Int4
Text Generation
• 73B • Updated • 2
• 2
AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4
Image-Text-to-Text
• Updated • 73
• 1
AXERA-TECH/Qwen3-VL-4B-Instruct-GPTQ-Int4
Image-Text-to-Text
• Updated • 32
AXERA-TECH/Qwen3-VL-8B-Instruct-GPTQ-Int4
Image-Text-to-Text
• Updated • 36
• 1
AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4-AX630C
Image-Text-to-Text
• Updated • 7
AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4-AX630C-P256-CTX384
Image-Text-to-Text
• Updated • 3
AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4-AX630C-P320-CTX448
Image-Text-to-Text
• Updated • 5
AXERA-TECH/Xiaomi-MiMo-VL-Miloco-7B-AX650-GPTQ-Int4
Image-Text-to-Text
• Updated • 8
AXERA-TECH/Qwen2.5-VL-3B-Instruct-GPTQ-Int4
Image-Text-to-Text
• Updated • 6
AXERA-TECH/Qwen3-4B-Instruct-2507-GPTQ-Int4
Text Generation
• Updated • 5