AI Model Hub

Browse all available AI models with support for multiple inference frameworks

Model Replacement Deployment Guide
100 models
Page 1 / 5
BAAI
BGE 0.5
Bge_0.5b_0.5k_b1_2core_1chip
0.5 gguf w4a8 M50 512
Text Vector
HLIECpp HLIEPython HLIELLama

Type: Bge | Size: 0.5 | Quant: w4a8 | Context: 512 | Chip: M50 | Build: 1.4.0 | Status: Testing

Detail Download
BAAI
BGE-RERANKER 0.5
Bge-Reranker_0.5b_0.5k_b1_2core_1chip
0.5 gguf w4a8 M50 512
Text Vector
HLIECpp HLIEPython HLIELLama

Type: Bge-Reranker | Size: 0.5 | Quant: w4a8 | Context: 512 | Chip: M50 | Build: 1.4.0 | Status: Testing

Detail Download
CogVideoX
COPAW 9
Copaw_9b_128k_b1_2core_1chip
9 gguf w4a8 M50 131,072
Text Text
HLIECpp HLIEPython HLIELLama

Type: Copaw | Size: 9 | Quant: w4a8 | Context: 131072 | Chip: M50 | Build: 1.3.0 | Status: Stable

Detail Download
CogVideoX
COPAW 9
Copaw_9b__b1_2core_1chip(448*448)
9 gguf w4a8 M50 Vision
Text Text
HLIECpp HLIEPython HLIELLama

Type: Copaw | Size: 9 | Quant: w4a8 | Chip: M50 | Build: 1.4.0 | Status: Testing

Detail Download
阿里云
COSYVOICE3 0.5
CosyVoice3_0.5b_2k_b1_2core_1chip
0.5 gguf w4a8 M50 2,048
Text Audio
HLIECpp HLIEPython HLIELLama

Type: CosyVoice3 | Size: 0.5 | Quant: w4a8 | Context: 2048 | Chip: M50 | Build: 1.4.0 | Status: Testing

Detail Download
DEEPSEEK
DEEPSEEK 8
DeepSeek_8b_32k_b1_2core_1chip
8 gguf w4a8 M50 32,768
Text Text
HLIECpp HLIEPython HLIELLama

Type: DeepSeek | Size: 8 | Quant: w4a8 | Context: 32768 | Chip: M50 | Build: 1.3.0 | Status: Stable

Detail Download
Google
GEMMA4 2
Gemma4_2b_128k_b1_2core_1chip()
2 gguf w4a8 M50 131,072 Vision
Text Text
HLIECpp HLIEPython HLIELLama

Type: Gemma4 | Size: 2 | Quant: w4a8 | Context: 131072 | Chip: M50 | Build: 1.4.0 | Status: Testing

Detail Download
Google
GEMMA4 26
Gemma4_26b-a4b-mtp_256k_b1_2core_1chip(768*2520)
26 gguf w4a8 M50 262,144 Vision
Text Text
HLIECpp HLIEPython HLIELLama

Type: Gemma4 | Size: 26 | Quant: w4a8 | Context: 262144 | Chip: M50 | Build: 1.4.0 | Status: Temporary

Detail Download
Google
GEMMA4 26
Gemma4_26b-a4b_128k_b1_2core_1chip
26 gguf w4a8 M50 131,072
Text Text
HLIECpp HLIEPython HLIELLama

Type: Gemma4 | Size: 26 | Quant: w4a8 | Context: 131072 | Chip: M50 | Build: 1.4.0 | Status: Temporary

Detail Download
Google
GEMMA4 26
Gemma4_26b-a4b_128k_b1_2core_1chip(768*2520)
26 gguf w4a8 M50 131,072 Vision
Text Text
HLIECpp HLIEPython HLIELLama

Type: Gemma4 | Size: 26 | Quant: w4a8 | Context: 131072 | Chip: M50 | Build: 1.4.0 | Status: Testing

Detail Download
Google
GEMMA4 26
Gemma4_26b-a4b_256k_b1_2core_1chip(768*2520)
26 gguf w4a8 M50 262,144 Vision
Text Text
HLIECpp HLIEPython HLIELLama

Type: Gemma4 | Size: 26 | Quant: w4a8 | Context: 262144 | Chip: M50 | Build: 1.4.0 | Status: Testing

Detail Download
Google
GEMMA4 26
Gemma4_26b-a4b_256k_b1_2core_2chips(768*2520)
26 gguf w4a8 M50 262,144 Vision
Text Text
HLIECpp HLIEPython HLIELLama

Type: Gemma4 | Size: 26 | Quant: w4a8 | Context: 262144 | Chip: M50 | Build: 1.4.0 | Status: Testing

Detail Download
Google
GEMMA4 31
Gemma4_31b_256k_b1_2core_2chips(768*2520)
31 gguf w4a8 M50 262,144 Vision
Text Text
HLIECpp HLIEPython HLIELLama

Type: Gemma4 | Size: 31 | Quant: w4a8 | Context: 262144 | Chip: M50 | Build: 1.4.0 | Status: Testing

Detail Download
Google
GEMMA4 31
Gemma4_31b_256k_b1_2core_4chips(768*2520)
31 gguf w4a8 M50 262,144 Vision
Text Text
HLIECpp HLIEPython HLIELLama

Type: Gemma4 | Size: 31 | Quant: w4a8 | Context: 262144 | Chip: M50 | Build: 1.4.0 | Status: Temporary

Detail Download
Google
GEMMA4 4
Gemma4_4b_128k_b1_2core_1chip()
4 gguf w4a8 M50 131,072 Vision
Text Text
HLIECpp HLIEPython HLIELLama

Type: Gemma4 | Size: 4 | Quant: w4a8 | Context: 131072 | Chip: M50 | Build: 1.4.0 | Status: Testing

Detail Download
智谱
GLM-ASR 1.9
GLM-ASR_1.9b__b1_2core_1chip()
1.9 gguf w4a8 M50 Vision
Audio Text
HLIECpp HLIEPython HLIELLama

Type: GLM-ASR | Size: 1.9 | Quant: w4a8 | Chip: M50 | Build: 1.4.0 | Status: Testing

Detail Download
智谱
GLM-OCR 0.9
GLM-OCR_0.9b_8k_b1_2core_1chip()
0.9 gguf w4a8 M50 8,192 Vision
Image Text
HLIECpp HLIEPython HLIELLama

Type: GLM-OCR | Size: 0.9 | Quant: w4a8 | Context: 8192 | Chip: M50 | Build: 1.4.0 | Status: Testing

Detail Download
智谱
GLM-OCR 0.9
GLM-OCR_0.9b_8k_b1_2core_1chip(672*672)
0.9 gguf w4a8 M50 8,192 Vision
Image Text
HLIECpp HLIEPython HLIELLama

Type: GLM-OCR | Size: 0.9 | Quant: w4a8 | Context: 8192 | Chip: M50 | Build: 1.3.0 | Status: Stable

Detail Download
OpenAI
GPT-OSS 120
GPT-OSS_120b_128k_b1_2core_2chips
120 gguf w4a8 M50 131,072
Text Text
HLIECpp HLIEPython HLIELLama

Type: GPT-OSS | Size: 120 | Quant: w4a8 | Context: 131072 | Chip: M50 | Build: 1.4.0 | Status: Temporary

Detail Download
OpenAI
GPT-OSS 20
GPT-OSS_20b_256k_b1_2core_1chip
20 gguf w4a8 M50 262,144
Text Text
HLIECpp HLIEPython HLIELLama

Type: GPT-OSS | Size: 20 | Quant: w4a8 | Context: 262144 | Chip: M50 | Build: 1.4.0 | Status: Testing

Detail Download
Alibaba
GTE 1.5
Gte_1.5b_2k_b1_2core_1chip
1.5 gguf w4a8 M50 2,048
Text Vector
HLIECpp HLIEPython HLIELLama

Type: Gte | Size: 1.5 | Quant: w4a8 | Context: 2048 | Chip: M50 | Build: 1.4.0 | Status: Testing

Detail Download
QWEN-AGENTWORLD
QWEN-AGENTWORLD 35
Qwen-AgentWorld_35b-a3b_256k_b1_2core_1chip
35 gguf w4a8 M50 262,144
Text Text
HLIECpp HLIEPython HLIELLama

Type: Qwen-AgentWorld | Size: 35 | Quant: w4a8 | Context: 262144 | Chip: M50 | Build: 1.4.0 | Status: Testing

Detail Download
阿里云
QWEN3 0.6
Qwen3_0.6b_32k_b1_2core_1chip
0.6 gguf w4a8 M50 32,768
Text Text
HLIECpp HLIEPython HLIELLama

Type: Qwen3 | Size: 0.6 | Quant: w4a8 | Context: 32768 | Chip: M50 | Build: 1.2.0 | Status: Stable

Detail Download
阿里云
QWEN3 30
Qwen3_30b-a3b_16k_b4_2core_1chip
30 gguf w4a8 M50 16,384
Text Text
HLIECpp HLIEPython HLIELLama

Type: Qwen3 | Size: 30 | Quant: w4a8 | Context: 16384 | Chip: M50 | Build: 1.4.0 | Status: Stable

Detail Download