AI Model Hub

Browse all available AI models with support for multiple inference frameworks

Model Replacement Deployment Guide
Total Models 123
Filtered 123
Available 123
Showing 1-24 / 123 models
Page 1 / 6
BAAI
BGE 0.5
Bge_0.5b_0.5k_b1_2core_1chip
0.5 gguf w4a8 M50 512 7 116
Text Vector
HLIECpp HLIEPython HLIELLama

Type: Bge | Size: 0.5 | Quant: w4a8 | Context: 512 | Chip: M50 | Build: 1.4.0 | Status: Stable

Detail Download
BAAI
BGE-RERANKER 0.5
Bge-Reranker_0.5b_0.5k_b1_2core_1chip
0.5 gguf w4a8 M50 512 4 113
Text Vector
HLIECpp HLIEPython HLIELLama

Type: Bge-Reranker | Size: 0.5 | Quant: w4a8 | Context: 512 | Chip: M50 | Build: 1.4.0 | Status: Stable

Detail Download
CogVideoX
COPAW 9
Copaw_9b_128k_b1_2core_1chip
9 gguf w4a8 M50 131,072 11 139
Text Text
HLIECpp HLIEPython HLIELLama

Type: Copaw | Size: 9 | Quant: w4a8 | Context: 131072 | Chip: M50 | Build: 1.3.0 | Status: Stable

Detail Download
CogVideoX
COPAW 9
Copaw_9b__b1_2core_1chip(448*448)
9 gguf w4a8 M50 Vision 6 119
Text Text
HLIECpp HLIEPython HLIELLama

Type: Copaw | Size: 9 | Quant: w4a8 | Chip: M50 | Build: 1.4.0 | Status: Stable

Detail Download
阿里云
COSYVOICE3 0.5
CosyVoice3_0.5b_2k_b1_2core_1chip
0.5 gguf w4a8 M50 2,048 5 106
Text Audio
HLIECpp HLIEPython HLIELLama

Type: CosyVoice3 | Size: 0.5 | Quant: w4a8 | Context: 2048 | Chip: M50 | Build: 1.4.0 | Status: Stable

Detail Download
阿里云
COSYVOICE3 0.5
CosyVoice3_0.5b__b1_2core_1chip
0.5 gguf w8a16 M50 5 29
Text Audio

Type: CosyVoice3 | Size: 0.5 | Quant: w8a16 | Chip: M50 | Build: 1.4.0 | Status: Testing

Detail Download
DEEPSEEK
DEEPSEEK 8
DeepSeek_8b_32k_b1_2core_1chip
8 gguf w4a8 M50 32,768 15 151
Text Text
HLIECpp HLIEPython HLIELLama

Type: DeepSeek | Size: 8 | Quant: w4a8 | Context: 32768 | Chip: M50 | Build: 1.3.0 | Status: Stable

Detail Download
Google
GEMMA4 2
Gemma4_2b_128k_b1_2core_1chip()
2 gguf w4a8 M50 131,072 Vision 5 115
Text Text
HLIECpp HLIEPython HLIELLama

Type: Gemma4 | Size: 2 | Quant: w4a8 | Context: 131072 | Chip: M50 | Build: 1.4.0 | Status: Stable

Detail Download
Google
GEMMA4 2
Gemma4_2b_128k_b1_2core_1chip()
2 gguf w4a8 M50 131,072 Vision 5 115
Text Text

Type: Gemma4 | Size: 2 | Quant: w4a8 | Context: 131072 | Chip: M50 | Build: 1.4.0 | Status: Testing

Detail Download
Google
GEMMA4 26
Gemma4_26b-a4b-mtp_256k_b1_2core_1chip(768*2520)
26 gguf w4a8 M50 262,144 Vision 6 122
Text Text
HLIECpp HLIEPython HLIELLama

Type: Gemma4 | Size: 26 | Quant: w4a8 | Context: 262144 | Chip: M50 | Build: 1.4.0 | Status: Temporary

Detail Download
Google
GEMMA4 26
Gemma4_26b-a4b_128k_b1_2core_1chip
26 gguf w4a8 M50 131,072 4 106
Text Text
HLIECpp HLIEPython HLIELLama

Type: Gemma4 | Size: 26 | Quant: w4a8 | Context: 131072 | Chip: M50 | Build: 1.4.0 | Status: Temporary

Detail Download
Google
GEMMA4 26
Gemma4_26b-a4b_128k_b1_2core_1chip(768*2520)
26 gguf w4a8 M50 131,072 Vision 4 106
Text Text
HLIECpp HLIEPython HLIELLama

Type: Gemma4 | Size: 26 | Quant: w4a8 | Context: 131072 | Chip: M50 | Build: 1.4.0 | Status: Stable

Detail Download
Google
GEMMA4 26
Gemma4_26b-a4b_256k_b1_2core_1chip(768*2520)
26 gguf w4a8 M50 262,144 Vision 11 148
Text Text
HLIECpp HLIEPython HLIELLama

Type: Gemma4 | Size: 26 | Quant: w4a8 | Context: 262144 | Chip: M50 | Build: 1.4.0 | Status: Stable

Detail Download
Google
GEMMA4 26
Gemma4_26b-a4b_256k_b1_2core_2chips(768*2520)
26 gguf w4a8 M50 262,144 Vision 3 84
Text Text
HLIECpp HLIEPython HLIELLama

Type: Gemma4 | Size: 26 | Quant: w4a8 | Context: 262144 | Chip: M50 | Build: 1.4.0 | Status: Stable

Detail Download
Google
GEMMA4 31
Gemma4_31b_256k_b1_2core_2chips(768*2520)
31 gguf w4a8 M50 262,144 Vision 11 143
Text Text
HLIECpp HLIEPython HLIELLama

Type: Gemma4 | Size: 31 | Quant: w4a8 | Context: 262144 | Chip: M50 | Build: 1.4.0 | Status: Stable

Detail Download
Google
GEMMA4 31
Gemma4_31b_256k_b1_2core_2chips(768*2520)
31 gguf w4a8 M50 262,144 Vision 11 143
Text Text

Type: Gemma4 | Size: 31 | Quant: w4a8 | Context: 262144 | Chip: M50 | Build: 1.4.0 | Status: Testing

Detail Download
Google
GEMMA4 31
Gemma4_31b_256k_b1_2core_4chips(768*2520)
31 gguf w4a8 M50 262,144 Vision 4 121
Text Text
HLIECpp HLIEPython HLIELLama

Type: Gemma4 | Size: 31 | Quant: w4a8 | Context: 262144 | Chip: M50 | Build: 1.4.0 | Status: Temporary

Detail Download
Google
GEMMA4 4
Gemma4_4b_128k_b1_2core_1chip()
4 gguf w4a8 M50 131,072 Vision 4 98
Text Text
HLIECpp HLIEPython HLIELLama

Type: Gemma4 | Size: 4 | Quant: w4a8 | Context: 131072 | Chip: M50 | Build: 1.4.0 | Status: Stable

Detail Download
Google
GEMMA4 4
Gemma4_4b_128k_b1_2core_1chip()
4 gguf w4a8 M50 131,072 Vision 4 98
Text Text

Type: Gemma4 | Size: 4 | Quant: w4a8 | Context: 131072 | Chip: M50 | Build: 1.4.0 | Status: Testing

Detail Download
智谱
GLM-ASR 1.9
GLM-ASR_1.9b__b1_2core_1chip()
1.9 gguf w4a8 M50 Vision 4 107
Audio Text
HLIECpp HLIEPython HLIELLama

Type: GLM-ASR | Size: 1.9 | Quant: w4a8 | Chip: M50 | Build: 1.4.0 | Status: Stable

Detail Download
智谱
GLM-OCR 0.9
GLM-OCR_0.9b_8k_b1_2core_1chip()
0.9 gguf w4a8 M50 8,192 Vision 4 102
Image Text
HLIECpp HLIEPython HLIELLama

Type: GLM-OCR | Size: 0.9 | Quant: w4a8 | Context: 8192 | Chip: M50 | Build: 1.4.0 | Status: Stable

Detail Download
智谱
GLM-OCR 0.9
GLM-OCR_0.9b_8k_b1_2core_1chip(672*672)
0.9 gguf w4a8 M50 8,192 Vision 4 118
Image Text
HLIECpp HLIEPython HLIELLama

Type: GLM-OCR | Size: 0.9 | Quant: w4a8 | Context: 8192 | Chip: M50 | Build: 1.3.0 | Status: Stable

Detail Download
OpenAI
GPT-OSS 120
GPT-OSS_120b_128k_b1_2core_2chips
120 gguf w4a8 M50 131,072 6 108
Text Text
HLIECpp HLIEPython HLIELLama

Type: GPT-OSS | Size: 120 | Quant: w4a8 | Context: 131072 | Chip: M50 | Build: 1.4.0 | Status: Temporary

Detail Download
OpenAI
GPT-OSS 20
GPT-OSS_20b_256k_b1_2core_1chip
20 gguf w4a8 M50 262,144 7 116
Text Text
HLIECpp HLIEPython HLIELLama

Type: GPT-OSS | Size: 20 | Quant: w4a8 | Context: 262144 | Chip: M50 | Build: 1.4.0 | Status: Stable

Detail Download