New
Announcing Featherless' Realtime API Beta Learn more

Models

llama31-8b-16k
meta-llama/Meta-Llama-3.1-8B-Instruct
Warm
3,769
5,694,398
mistral-v02-7b-std-lc
mistralai/Mistral-7B-Instruct-v0.2
Warm
2,691
3,839,768
qwen25-32b-lc
deepseek-ai/DeepSeek-R1-Distill-Qwen-32B
Warm
1,289
1,808,744
qwen25-7b-lc
Qwen/Qwen2.5-7B-Instruct
Warm
587
1,676,237
llama31-8b-16k
deepseek-ai/DeepSeek-R1-Distill-Llama-8B
Warm
664
1,537,872
deepseek-v3-lc
deepseek-ai/DeepSeek-R1
Warm
11,606
1,523,396
qwen25-7b-lc
deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
Warm
566
1,310,744
llama31-70b-16k
meta-llama/Meta-Llama-3.1-70B-Instruct
Warm
800
1,126,405
llama3-8b-8k
meta-llama/Meta-Llama-3-8B-Instruct
Loading
3,876
1,084,089
llama31-8b-16k
meta-llama/Meta-Llama-3.1-8B
Warm
1,517
1,081,069
llama33-70b-16k
meta-llama/Llama-3.3-70B-Instruct
Warm
2,187
1,054,193
mistral-nemo-12b-lc
Nitral-AI/Captain-Eris_Violet-V0.420-12B
Warm
34
671,899
mistral-v02-7b-std-lc
HuggingFaceH4/zephyr-7b-beta
Warm
1,671
668,216
qwen25-14b-lc
deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
Warm
475
591,133
qwen25-32b-lc
Qwen/QwQ-32B
Warm
2,494
588,478
llama3-8b-8k
meta-llama/Meta-Llama-3-8B
Cold
6,098
522,789
qwen25-14b-lc
Qwen/Qwen2.5-14B-Instruct
Warm
212
513,969
qwen25-32b-lc
Qwen/Qwen2.5-32B-Instruct
Warm
240
490,779
llama31-8b-16k
unsloth/Meta-Llama-3.1-8B-Instruct
Warm
53
453,341
llama3-70b-8k
meta-llama/Meta-Llama-3-70B-Instruct
Warm
1,465
373,155