Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

50,316

Base only

Active filters: 4-bit

unsloth/Phi-4-reasoning-plus-unsloth-bnb-4bit

Text Generation • 15B • Updated May 1, 2025 • 139 • 4

isogen/gemma-3-12b-it-exl3-4bpw

5B • Updated May 17, 2025 • 15 • 1

Qwen/Qwen3-8B-MLX-4bit

Text Generation • 8B • Updated Jul 7, 2025 • 1.56k • 12

elementalsouls/Arch_nemesisv0.2

Text Generation • 7B • Updated May 31, 2025 • 11 • 1

MuXodious/XortronCriminalComputingConfig-24B_EXL2_4.0bpw

Text Generation • Updated Jun 1, 2025 • 18 • 1

mlx-community/Qwen3-Embedding-4B-4bit-DWQ

Feature Extraction • 4B • Updated Jun 7, 2025 • 5.5k • 15

mlx-community/Qwen3-Embedding-8B-4bit-DWQ

Feature Extraction • 8B • Updated Jun 23, 2025 • 2.23k • 10

AlexTelepov/RuadaptQwen3-4B-Instruct-4bit-mlx

4B • Updated Jul 3, 2025 • 20 • 2

lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-MLX-4bit

Text Generation • 31B • Updated Jul 31, 2025 • 140k • 41

unsloth/gpt-oss-120b-unsloth-bnb-4bit

Text Generation • 117B • Updated Aug 8, 2025 • 4.8k • 20

lopho/Wan2.2-T2V-A14B-Diffusers_nf4_text_encoder

6B • Updated Aug 18, 2025 • 12 • 4

openbmb/MiniCPM-V-4_5-AWQ

Image-Text-to-Text • 9B • Updated Aug 18 • 18.7k • 15

detoxio-test/Qwen2.5-1.5B-Instruct_Jailbroken

Text Generation • 2B • Updated Aug 29, 2025 • 27 • 1

vpakarinen/qwen3-4b-lora-uncensored-thinking

Text Generation • Updated 7 days ago • 20 • 1

DreamsOfControl/Llama-3.2-8X3B-MOE-Dark-Champion-Instruct-uncensored-abliterated-18.4B-mlx-4Bit

Text Generation • 18B • Updated Sep 6, 2025 • 99 • 1

mlx-community/Ling-mini-2.0-4bit

Text Generation • 16B • Updated Sep 21, 2025 • 69 • 2

nightmedia/Qwen3-4B-Architect-mxfp4-mlx

Text Generation • 4B • Updated Dec 9, 2025 • 38 • 3

MaziyarPanahi/GLM-4.6V-Flash-GGUF

Text Generation • 9B • Updated Dec 8, 2025 • 88.2k • 7

orgessnk/olmOCR-2-7B-1025-BNB-4bit

Image-Text-to-Text • 8B • Updated Dec 30, 2025 • 157 • 1

lmstudio-community/LFM2.5-1.2B-Instruct-MLX-4bit

Text Generation • 1B • Updated Jan 7 • 81k • 2

er6y/Z-Image-Turbo-MNN-int4

Text-to-Image • Updated Jun 17 • 21 • 1

gokhanarkan/sommo-7b-v1

Text Generation • 8B • Updated Jan 13 • 22 • 2

lmstudio-community/GLM-4.7-Flash-MLX-4bit

Text Generation • 30B • Updated Jan 22 • 3.46k • 14

openbmb/MiniCPM-o-4_5-awq

Any-to-Any • 9B • Updated Aug 18 • 30.4k • 23

Vishva007/Qwen3-VL-8B-Instruct-W4A16-AutoRound-AWQ

Image-Text-to-Text • 2B • Updated 17 days ago • 604 • 1

LiquidAI/LFM2-24B-A2B-MLX-4bit

Text Generation • 24B • Updated Feb 24 • 357 • 11

saricles/Qwen3-Coder-Next-NVFP4-GB10

Text Generation • Updated Mar 1 • 71.8k • 49

CogHyn/llama-3.2-1B-3bit

Text Generation • 1B • Updated Feb 24 • 52 • 1

TheCluster/Hypernova-60B-2602-MLX-mxfp4

Text Generation • 59B • Updated Feb 27 • 205 • 2

aufklarer/Qwen3-ASR-0.6B-MLX-4bit

0.8B • Updated Apr 12 • 5.25k • 6