Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,159

Base only

Active filters: granite

ibm-granite/granite-4.1-8b

Text Generation • 9B • Updated May 4 • 1.35M • 220

ibm-granite/granite-docling-258M

Image-Text-to-Text • 0.3B • Updated Sep 23, 2025 • 71.5k • 1.22k

ibm-granite/granite-4.1-3b

Text Generation • 3B • Updated May 4 • 331k • 90

ibm-granite/granite-embedding-311m-multilingual-r2

Feature Extraction • 0.3B • Updated May 18 • 111k • • 112

AnkitAI/Parable-Granite-4.1-8B-Claude-Fable-5

Text Generation • 8B • Updated 2 days ago • 1.08k • 2

cobrakenji/granite-3b-code-base-Q5_K_M-GGUF

Text Generation • 3B • Updated May 11, 2024 • 18 • 1

mozilla-ai/granite-34b-code-instruct-llamafile

Text Generation • Updated Jul 17, 2024 • 105 • 6

ibm-granite/granite-embedding-125m-english

Sentence Similarity • 0.1B • Updated Aug 19, 2025 • 39.1k • • 38

lmstudio-community/granite-embedding-278m-multilingual-GGUF

Text Generation • 0.3B • Updated Dec 23, 2024 • 317 • 4

glogwa68/granite-4.0-h-tiny-DISTILL-OPUS-4.5-think-GGUF

Text Generation • 7B • Updated Dec 23, 2025 • 422 • 1

ibm-granite/granite-4.1-30b

Text Generation • 29B • Updated May 4 • 78.2k • 137

ibm-granite/granite-4.1-8b-fp8

Text Generation • 9B • Updated Apr 29 • 9.79k • 14

roger33303/Jarvis_granite_4.1_3b_finetuned_gguf

3B • Updated 25 days ago • 699 • 1

AnkitAI/Parable-Granite-4.1-8B-Claude-Fable-5-GGUF

Text Generation • 8B • Updated 2 days ago • 356 • 1

AnkitAI/Parable-Granite-4.1-3B-Claude-Fable-5-GGUF

Text Generation • 3B • Updated 2 days ago • 101 • 1

AnkitAI/Parable-Granite-4.1-3B-Claude-Fable-5

Text Generation • 3B • Updated 2 days ago • 173 • 1

litert-community/granite-4.0-350m-litert-lm

Text Generation • Updated about 22 hours ago • 1

instructlab/granite-7b-lab

Text Generation • 7B • Updated Jun 5, 2024 • 162 • • 43

instructlab/granite-7b-lab-GGUF

7B • Updated Apr 24, 2024 • 620 • 26

ibm-granite/granite-20b-code-base-8k

Text Generation • 20B • Updated Apr 25 • 1k • 14

ibm-granite/granite-8b-code-base-4k

Text Generation • 8B • Updated Apr 25 • 688 • 30

ibm-granite/granite-34b-code-base-8k

Text Generation • 34B • Updated Apr 25 • 80 • 20

ibm-granite/granite-3b-code-base-2k

Text Generation • 3B • Updated Apr 25 • 14.2k • 38

ibm-granite/granite-3b-code-instruct-2k

Text Generation • 3B • Updated Apr 25 • 4.16k • 40

ibm-granite/granite-8b-code-instruct-4k

Text Generation • 8B • Updated Apr 25 • 2.04k • 115

ibm-granite/granite-20b-code-instruct-8k

Text Generation • 20B • Updated Apr 25 • 3.95k • 43

ibm-granite/granite-34b-code-instruct-8k

Text Generation • 34B • Updated Apr 25 • 339 • 78

mlx-community/granite-20b-code-instruct-4bit

Text Generation • Updated May 14, 2024 • 20

mlx-community/granite-20b-code-instruct-8bit

Text Generation • Updated May 14, 2024 • 12

mlx-community/granite-20b-code-base-4bit

Text Generation • Updated May 14, 2024 • 9