Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,198

Base only

Active filters: int8

nameistoken/Qwen3.6-27B-Quark-W8A8-INT8

Image-Text-to-Text • 27B • Updated 26 days ago • 5.06k • 4

SamLowe/roberta-base-go_emotions-onnx

Text Classification • Updated Sep 29, 2023 • 33.5k • 27

KidiXDev/wd-eva02-large-tagger-v3-quint8

Updated Oct 25, 2025 • 3 • 2

hudaiapa88/sherpa-stt-onnx

Automatic Speech Recognition • Updated Nov 7, 2025 • 2

vistralis/FLUX.2-klein-9b-INT8-transformer

Text-to-Image • Updated Feb 16 • 435 • 3

aufklarer/DeepFilterNet3-CoreML

Audio-to-Audio • Updated 11 days ago • 58.5k • 2

aufklarer/Qwen3.5-0.8B-Chat-MLX

Text Generation • Updated 11 days ago • 423 • 1

aufklarer/Kokoro-82M-CoreML-INT8

Text-to-Speech • Updated Apr 19 • 93 • 1

Minachist/Qwen3.6-27B-INT8-AutoRound

Image-Text-to-Text • 13B • Updated 20 days ago • 20.2k • 16

jpcurada/SmolLM2-1.7B-Scheduled-QAT-Linear-GGUF

Text Generation • 2B • Updated May 5 • 85 • 1

moe2382/dramabox-dit-int8

Text-to-Speech • Updated 23 days ago • 106 • 2

Reza2kn/supertonic-3-litert

Text-to-Speech • Updated 19 days ago • 217 • 5

ForeverBlue/Qwen3-VL-2B-GRACE-W8G128

Image-Text-to-Text • 2B • Updated 4 days ago • 64 • 1

geotessera/TESSERA-V-1.1

Updated 11 days ago • 4

Abiray/L2P-model-1k-merge-INT8

Text-to-Image • Updated 15 days ago • 12

CMSManhattan/JiRack_10b

Updated 3 days ago • 107 • 2

adeepv/Qwen3.6-27B-W8A16-Ascend310P

Text Generation • Updated 3 days ago • 43 • 1

smcleod/nemotron-3.5-asr-streaming-0.6b-int8

Automatic Speech Recognition • Updated about 18 hours ago • 1

Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-static-inc

Text Classification • Updated Jun 27, 2023 • 169 • 6

INC4AI/bert-base-uncased-mrpc-int8-qat-inc

Text Classification • Updated Mar 21, 2024 • 15 • 1

INC4AI/albert-base-v2-sst2-int8-static-inc

Text Classification • Updated Mar 22, 2024 • 13

INC4AI/bert-base-uncased-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 49

INC4AI/roberta-base-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 14

echarlaix/distilbert-sst2-inc-dynamic-quantization-magnitude-pruning-0.1

Text Classification • Updated Jun 13, 2023 • 64

echarlaix/t5-small-int8-dynamic

Translation • Updated Oct 26, 2023 • 9 • 4

echarlaix/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic

Text Classification • Updated Jun 13, 2023 • 564 • 1

INC4AI/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 23 • 1

Intel/distilbert-base-uncased-distilled-squad-int8-static-inc

Question Answering • Updated Mar 29, 2024 • 423 • 5

INC4AI/vit-base-patch16-224-int8-static-inc

Image Classification • Updated Sep 6, 2022 • 11 • 1

Intel/t5-small-xsum-int8-dynamic-inc

Updated Mar 21, 2024 • 434 • 1