Skip to content
Open Source
347 Providers · 1,400+ Standardized Endpoints

Models Explorer & Performance Benchmarks

Explore live latency benchmarks, context windows, zero-cost free-tier quotas, and provider hosting options. Call any model through RouteNex with deterministic fallback.

Showing 198 ModelsDeterministic Auto-Routing Active

Gemini 3.7 Flash High (Thinking)

$0 FREEZDR
antigravity/gemini-3.7-flash-high
Input / Output$0.00 / M
Context1,000K
Speed220 tps

Gemini 3.7 Flash Medium (Balanced)

$0 FREEZDR
antigravity/gemini-3.7-flash-medium
Input / Output$0.00 / M
Context1,000K
Speed260 tps

Gemini 3.7 Flash Low (Instant)

$0 FREEZDR
antigravity/gemini-3.7-flash-low
Input / Output$0.00 / M
Context1,000K
Speed310 tps

Gemini 3.7 Flash Tiered Headroom

$0 FREEZDR
antigravity/gemini-3.7-flash-tiered
Input / Output$0.00 / M
Context1,000K
Speed240 tps

Gemini Pro Autonomous Agent

$0 FREEZDR
antigravity/gemini-pro-agent
Input / Output$0.00 / M
Context2,000K
Speed120 tps

Gemini 3.1 Pro Low

$0 FREEZDR
antigravity/gemini-3.1-pro-low
Input / Output$0.00 / M
Context1,000K
Speed190 tps

Gemini 3.1 Flash Lite

$0 FREEZDR
antigravity/gemini-3.1-flash-lite
Input / Output$0.00 / M
Context1,000K
Speed360 tps

Claude Opus 4.6 Thinking

$0 FREEZDR
antigravity/claude-opus-4-6-thinking
Input / Output$0.00 / M
Context200K
Speed85 tps

Claude Sonnet 4.6 Thinking

$0 FREEZDR
antigravity/claude-sonnet-4-6-thinking
Input / Output$0.00 / M
Context200K
Speed115 tps

GPT-OSS 120B Open Weights

$0 FREEZDR
antigravity/gpt-oss-120b
Input / Output$0.00 / M
Context128K
Speed140 tps

Gemini 3.8 Flash Tiered

$0 FREEZDR
antigravity/gemini-3.8-flash-tiered
Input / Output$0.00 / M
Context1,000K
Speed280 tps

Gemini 3 Flash Standard

$0 FREEZDR
antigravity/gemini-3-flash
Input / Output$0.00 / M
Context1,000K
Speed290 tps

Gemini 3.1 Pro High Compute

$0 FREEZDR
antigravity/gemini-3.1-pro-high
Input / Output$0.00 / M
Context2,000K
Speed160 tps

Gemini 3.6 Flash Tiered

$0 FREEZDR
antigravity/gemini-3.6-flash-tiered
Input / Output$0.00 / M
Context1,000K
Speed250 tps

Claude 3.7 Sonnet (Hybrid Thinking)

ZDR
anthropic/claude-3-7-sonnet
Input / Output$3.00 / M
Context200K
Speed65 tps

Claude 3.5 Sonnet

ZDR
anthropic/claude-3-5-sonnet
Input / Output$3.00 / M
Context200K
Speed75 tps

Claude 3.5 Haiku

ZDR
anthropic/claude-3-5-haiku
Input / Output$0.80 / M
Context200K
Speed160 tps

Claude 3 Opus

ZDR
anthropic/claude-3-opus
Input / Output$15.00 / M
Context200K
Speed40 tps

Claude 3 Sonnet

ZDR
anthropic/claude-3-sonnet
Input / Output$3.00 / M
Context200K
Speed70 tps

Claude 3 Haiku

ZDR
anthropic/claude-3-haiku
Input / Output$0.25 / M
Context200K
Speed175 tps

Claude 2.1

ZDR
anthropic/claude-2.1
Input / Output$8.00 / M
Context200K
Speed50 tps

Claude 2.0 Legacy

ZDR
anthropic/claude-2.0
Input / Output$8.00 / M
Context100K
Speed48 tps

Claude Instant 1.2

ZDR
anthropic/claude-instant-1.2
Input / Output$1.63 / M
Context100K
Speed120 tps

GPT-4o Omnimodal

ZDR
openai/gpt-4o
Input / Output$2.50 / M
Context128K
Speed90 tps

GPT-4o Mini

ZDR
openai/gpt-4o-mini
Input / Output$0.15 / M
Context128K
Speed140 tps

OpenAI o1 Reasoning

ZDR
openai/o1
Input / Output$15.00 / M
Context200K
Speed35 tps

OpenAI o1-mini Fast Reasoning

ZDR
openai/o1-mini
Input / Output$1.10 / M
Context128K
Speed65 tps

OpenAI o1-preview

ZDR
openai/o1-preview
Input / Output$15.00 / M
Context128K
Speed30 tps

OpenAI o3-mini Science/Code

ZDR
openai/o3-mini
Input / Output$1.10 / M
Context200K
Speed80 tps

GPT-4 Turbo Vision

ZDR
openai/gpt-4-turbo
Input / Output$10.00 / M
Context128K
Speed45 tps

GPT-4 Original

ZDR
openai/gpt-4
Input / Output$30.00 / M
Context8K
Speed25 tps

GPT-3.5 Turbo

ZDR
openai/gpt-3.5-turbo
Input / Output$0.50 / M
Context16K
Speed120 tps

ChatGPT-4o Latest Dynamic

ZDR
openai/chatgpt-4o-latest
Input / Output$5.00 / M
Context128K
Speed75 tps

Text Embedding 3 Small

ZDR
openai/text-embedding-3-small
Input / Output$0.02 / M
Context8K
Speed400 tps

Text Embedding 3 Large

ZDR
openai/text-embedding-3-large
Input / Output$0.13 / M
Context8K
Speed300 tps

Gemini 2.5 Pro Experimental

$0 FREEZDR
google/gemini-2.5-pro
Input / Output$1.25 / M
Context2,000K
Speed70 tps

Gemini 2.5 Flash

$0 FREEZDR
google/gemini-2.5-flash
Input / Output$0.00 / M
Context1,000K
Speed180 tps

Gemini 2.0 Flash GA

$0 FREEZDR
google/gemini-2.0-flash
Input / Output$0.10 / M
Context1,000K
Speed190 tps

Gemini 2.0 Flash Lite

$0 FREEZDR
google/gemini-2.0-flash-lite
Input / Output$0.075 / M
Context1,000K
Speed250 tps

Gemini 1.5 Pro

$0 FREEZDR
google/gemini-1.5-pro
Input / Output$1.25 / M
Context2,000K
Speed60 tps

Gemini 1.5 Flash 1M

$0 FREEZDR
google/gemini-1.5-flash
Input / Output$0.075 / M
Context1,000K
Speed160 tps

Gemini 1.5 Flash 8B

$0 FREEZDR
google/gemini-1.5-flash-8b
Input / Output$0.0375 / M
Context1,000K
Speed280 tps

Gemini 2.0 Pro Experimental

$0 FREEZDR
google/gemini-2.0-pro-exp
Input / Output$0.00 / M
Context2,000K
Speed75 tps

Gemini 1.0 Pro Legacy

$0 FREEZDR
google/gemini-1.0-pro
Input / Output$0.50 / M
Context32K
Speed100 tps

DeepSeek R1 Reasoning

deepseek/deepseek-r1
Input / Output$0.55 / M
Context64K
Speed45 tps

DeepSeek V3 671B MoE

deepseek/deepseek-v3
Input / Output$0.14 / M
Context64K
Speed65 tps

DeepSeek Chat (V3 Alias)

deepseek/deepseek-chat
Input / Output$0.14 / M
Context64K
Speed65 tps

DeepSeek Coder V2 236B

deepseek/deepseek-coder-v2
Input / Output$0.14 / M
Context128K
Speed60 tps

DeepSeek R1 Distill Llama 70B

$0 FREE
deepseek/deepseek-r1-distill-llama-70b
Input / Output$0.23 / M
Context128K
Speed120 tps

DeepSeek R1 Distill Qwen 32B

$0 FREE
deepseek/deepseek-r1-distill-qwen-32b
Input / Output$0.15 / M
Context128K
Speed140 tps

DeepSeek R1 Distill Qwen 14B

$0 FREE
deepseek/deepseek-r1-distill-qwen-14b
Input / Output$0.08 / M
Context64K
Speed190 tps

DeepSeek R1 Distill Llama 8B

$0 FREE
deepseek/deepseek-r1-distill-llama-8b
Input / Output$0.04 / M
Context128K
Speed280 tps

Llama 3.3 70B Versatile LPU

$0 FREE
groq/llama-3.3-70b-versatile
Input / Output$0.00 / M
Context128K
Speed380 tps

Llama 3.1 8B Instant

$0 FREE
groq/llama-3.1-8b-instant
Input / Output$0.00 / M
Context128K
Speed750 tps

DeepSeek R1 Distill 70B LPU

$0 FREE
groq/deepseek-r1-distill-llama-70b
Input / Output$0.00 / M
Context128K
Speed280 tps

Mixtral 8x7B 32K

$0 FREE
groq/mixtral-8x7b-32768
Input / Output$0.00 / M
Context32K
Speed480 tps

Gemma 2 9B Instruct

$0 FREE
groq/gemma2-9b-it
Input / Output$0.00 / M
Context8K
Speed600 tps

Llama 3.2 1B Micro

$0 FREE
groq/llama-3.2-1b-preview
Input / Output$0.00 / M
Context128K
Speed1,200 tps

Llama 3.2 3B Fast

$0 FREE
groq/llama-3.2-3b-preview
Input / Output$0.00 / M
Context128K
Speed950 tps

Llama 3.2 11B Vision

$0 FREE
groq/llama-3.2-11b-vision-preview
Input / Output$0.00 / M
Context128K
Speed420 tps

Llama 3.2 90B Vision Heavy

$0 FREE
groq/llama-3.2-90b-vision-preview
Input / Output$0.00 / M
Context128K
Speed250 tps

Llama 3.3 70B CS-3 Wafer

$0 FREE
cerebras/llama-3.3-70b
Input / Output$0.00 / M
Context8K
Speed2,100 tps

Llama 3.1 8B CS-3 Hyper

$0 FREE
cerebras/llama-3.1-8b
Input / Output$0.00 / M
Context8K
Speed2,600 tps

Llama 3.1 70B CS-3

$0 FREE
cerebras/llama-3.1-70b
Input / Output$0.00 / M
Context8K
Speed2,000 tps

Codestral 2501 (1B Free/mo)

$0 FREEZDR
mistral/codestral-2501
Input / Output$0.00 / M
Context256K
Speed140 tps

Mistral Large 2411 Flagship

ZDR
mistral/mistral-large-2411
Input / Output$2.00 / M
Context128K
Speed70 tps

Mistral Small 2409

ZDR
mistral/mistral-small-2409
Input / Output$0.20 / M
Context128K
Speed150 tps

Pixtral 12B Vision

$0 FREEZDR
mistral/pixtral-12b-2409
Input / Output$0.15 / M
Context128K
Speed120 tps

Ministral 8B Edge

$0 FREEZDR
mistral/ministral-8b-2410
Input / Output$0.10 / M
Context128K
Speed180 tps

Ministral 3B Ultra-Edge

$0 FREEZDR
mistral/ministral-3b-2410
Input / Output$0.04 / M
Context128K
Speed240 tps

Mistral NeMo 12B

$0 FREEZDR
mistral/mistral-nemo
Input / Output$0.15 / M
Context128K
Speed135 tps

Mistral Embeddings

ZDR
mistral/mistral-embed
Input / Output$0.10 / M
Context8K
Speed350 tps

Qwen 2.5 Coder 32B Instruct

qwen/qwen-2.5-coder-32b
Input / Output$0.07 / M
Context128K
Speed95 tps

Qwen 2.5 Coder 7B Compact

$0 FREE
qwen/qwen-2.5-coder-7b
Input / Output$0.03 / M
Context128K
Speed220 tps

Qwen 2.5 72B Instruct

qwen/qwen-2.5-72b-instruct
Input / Output$0.35 / M
Context128K
Speed80 tps

Qwen 2.5 32B Instruct

qwen/qwen-2.5-32b-instruct
Input / Output$0.12 / M
Context128K
Speed110 tps

Qwen 2.5 14B Instruct

$0 FREE
qwen/qwen-2.5-14b-instruct
Input / Output$0.06 / M
Context128K
Speed170 tps

Qwen 2.5 7B Instruct

$0 FREE
qwen/qwen-2.5-7b-instruct
Input / Output$0.03 / M
Context128K
Speed230 tps

QwQ 32B Reasoning Preview

qwen/qwq-32b-preview
Input / Output$0.15 / M
Context32K
Speed90 tps

Qwen 2.5 Max Frontier

qwen/qwen-2.5-max
Input / Output$1.60 / M
Context32K
Speed55 tps

DeepSeek R1 (SiliconFlow Free Tier)

$0 FREE
siliconflow/deepseek-ai/DeepSeek-R1
Input / Output$0.00 / M
Context64K
Speed60 tps

DeepSeek V3 (SiliconFlow Free Tier)

$0 FREE
siliconflow/deepseek-ai/DeepSeek-V3
Input / Output$0.00 / M
Context64K
Speed80 tps

Qwen 2.5 Coder 32B (SF Free Tier)

$0 FREE
siliconflow/Qwen/Qwen2.5-Coder-32B-Instruct
Input / Output$0.00 / M
Context128K
Speed95 tps

Qwen 2.5 72B (SF Free Tier)

$0 FREE
siliconflow/Qwen/Qwen2.5-72B-Instruct
Input / Output$0.00 / M
Context128K
Speed75 tps

Meta Llama 3.1 70B (SF Free Tier)

$0 FREE
siliconflow/meta-llama/Meta-Llama-3.1-70B-Instruct
Input / Output$0.00 / M
Context128K
Speed110 tps

Meta Llama 3.1 8B (SF Free Tier)

$0 FREE
siliconflow/meta-llama/Meta-Llama-3.1-8B-Instruct
Input / Output$0.00 / M
Context128K
Speed210 tps

BGE M3 Multilingual Embedding

$0 FREE
siliconflow/BAAI/bge-m3
Input / Output$0.00 / M
Context8K
Speed450 tps

DeepSeek R1 Pro Dedicated

siliconflow/Pro/deepseek-ai/DeepSeek-R1
Input / Output$1.00 / M
Context64K
Speed85 tps

Llama 3.3 70B Local Runtime

$0 FREEZDR
ollama/llama3.3:latest
Input / Output$0.00 / M
Context128K
Speed45 tps

DeepSeek R1 14B Local

$0 FREEZDR
ollama/deepseek-r1:14b
Input / Output$0.00 / M
Context64K
Speed65 tps

DeepSeek R1 32B Local

$0 FREEZDR
ollama/deepseek-r1:32b
Input / Output$0.00 / M
Context64K
Speed35 tps

DeepSeek R1 70B Local

$0 FREEZDR
ollama/deepseek-r1:70b
Input / Output$0.00 / M
Context128K
Speed18 tps

Qwen 2.5 Coder 14B Local

$0 FREEZDR
ollama/qwen2.5-coder:14b
Input / Output$0.00 / M
Context128K
Speed70 tps

Qwen 2.5 Coder 32B Local

$0 FREEZDR
ollama/qwen2.5-coder:32b
Input / Output$0.00 / M
Context128K
Speed38 tps

Mistral 7B Local

$0 FREEZDR
ollama/mistral:latest
Input / Output$0.00 / M
Context32K
Speed90 tps

Microsoft Phi-4 14B Local

$0 FREEZDR
ollama/phi4:latest
Input / Output$0.00 / M
Context16K
Speed75 tps

Google Gemma 2 9B Local

$0 FREEZDR
ollama/gemma2:9b
Input / Output$0.00 / M
Context8K
Speed85 tps

Nomic Embed Text Local

$0 FREEZDR
ollama/nomic-embed-text:latest
Input / Output$0.00 / M
Context8K
Speed300 tps

OpenRouter Auto Router

$0 FREE
openrouter/auto
Input / Output$0.00 / M
Context128K
Speed110 tps

Claude 3.7 Sonnet (OR Aggregated)

ZDR
openrouter/anthropic/claude-3.7-sonnet
Input / Output$3.00 / M
Context200K
Speed65 tps

DeepSeek R1 (OR Aggregated)

openrouter/deepseek/deepseek-r1
Input / Output$0.55 / M
Context64K
Speed50 tps

GPT-4o (OR Aggregated)

ZDR
openrouter/openai/gpt-4o
Input / Output$2.50 / M
Context128K
Speed85 tps

Gemini 2.5 Flash (OR Aggregated)

$0 FREEZDR
openrouter/google/gemini-2.5-flash
Input / Output$0.00 / M
Context1,000K
Speed170 tps

Llama 3.3 70B (OR Aggregated)

openrouter/meta-llama/llama-3.3-70b-instruct
Input / Output$0.12 / M
Context128K
Speed120 tps

Codestral 2501 (OR Aggregated)

ZDR
openrouter/mistralai/codestral-2501
Input / Output$0.30 / M
Context256K
Speed130 tps

Qwen 2.5 Coder 32B (OR Aggregated)

openrouter/qwen/qwen-2.5-coder-32b-instruct
Input / Output$0.07 / M
Context128K
Speed90 tps

Pollinations Anonymous OpenAI Proxy

$0 FREE
pollinations/openai
Input / Output$0.00 / M
Context128K
Speed85 tps

Pollinations Mistral Proxy

$0 FREE
pollinations/mistral
Input / Output$0.00 / M
Context32K
Speed95 tps

DuckDuckGo Anonymous GPT-4o Mini

$0 FREE
duckduckgo/gpt-4o-mini
Input / Output$0.00 / M
Context128K
Speed70 tps

DuckDuckGo Anonymous Claude 3 Haiku

$0 FREE
duckduckgo/claude-3-haiku
Input / Output$0.00 / M
Context128K
Speed80 tps

DuckDuckGo Anonymous Llama 3.3 70B

$0 FREE
duckduckgo/meta-llama/Llama-3.3-70B-Instruct
Input / Output$0.00 / M
Context128K
Speed65 tps

Llama 3.3 70B Turbo

together/meta-llama/Llama-3.3-70B-Instruct-Turbo
Input / Output$0.88 / M
Context128K
Speed125 tps

Llama 3.1 405B Frontier Turbo

together/meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo
Input / Output$3.50 / M
Context128K
Speed60 tps

DeepSeek R1 (Together Fast)

together/deepseek-ai/DeepSeek-R1
Input / Output$0.80 / M
Context64K
Speed70 tps

Qwen 2.5 Coder 32B Turbo

together/Qwen/Qwen2.5-Coder-32B-Instruct
Input / Output$0.80 / M
Context128K
Speed110 tps

Mistral Small 24B Instruct

together/mistralai/Mistral-Small-24B-Instruct-2501
Input / Output$0.30 / M
Context32K
Speed140 tps

Llama 3.1 8B Turbo

together/meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo
Input / Output$0.18 / M
Context128K
Speed210 tps

Google Gemma 2 27B IT

together/google/gemma-2-27b-it
Input / Output$0.80 / M
Context8K
Speed130 tps

BGE Large English Embedding

together/BAAI/bge-large-en-v1.5
Input / Output$0.10 / M
Context8K
Speed400 tps

Llama 3.3 70B Instruct Fast

fireworks/accounts/fireworks/models/llama-v3p3-70b-instruct
Input / Output$0.90 / M
Context128K
Speed140 tps

DeepSeek R1 Fireworks Serverless

fireworks/accounts/fireworks/models/deepseek-r1
Input / Output$0.90 / M
Context64K
Speed80 tps

DeepSeek V3 Fireworks Serverless

fireworks/accounts/fireworks/models/deepseek-v3
Input / Output$0.90 / M
Context64K
Speed90 tps

Qwen 2.5 Coder 32B Fireworks

fireworks/accounts/fireworks/models/qwen2p5-coder-32b-instruct
Input / Output$0.90 / M
Context128K
Speed120 tps

Llama 3.1 405B Instruct

fireworks/accounts/fireworks/models/llama-v3p1-405b-instruct
Input / Output$3.00 / M
Context128K
Speed65 tps

Llama 3.1 8B Instruct Fireworks

fireworks/accounts/fireworks/models/llama-v3p1-8b-instruct
Input / Output$0.20 / M
Context128K
Speed230 tps

Grok 2 1212 Frontier

xai/grok-2-1212
Input / Output$2.00 / M
Context128K
Speed70 tps

Grok 2 Vision 1212

xai/grok-2-vision-1212
Input / Output$2.00 / M
Context32K
Speed65 tps

Grok Beta Real-time Search

xai/grok-beta
Input / Output$5.00 / M
Context128K
Speed55 tps

Sonar Reasoning Pro (Deep Search)

perplexity/sonar-reasoning-pro
Input / Output$2.00 / M
Context128K
Speed40 tps

Sonar Reasoning Fast Search

perplexity/sonar-reasoning
Input / Output$1.00 / M
Context128K
Speed65 tps

Sonar Pro Frontier Search

perplexity/sonar-pro
Input / Output$3.00 / M
Context200K
Speed60 tps

Sonar Fast Search

perplexity/sonar
Input / Output$1.00 / M
Context128K
Speed95 tps

Command R+ 08-2024 Enterprise

ZDR
cohere/command-r-plus-08-2024
Input / Output$2.50 / M
Context128K
Speed55 tps

Command R 08-2024

ZDR
cohere/command-r-08-2024
Input / Output$0.15 / M
Context128K
Speed90 tps

Cohere Embed Multilingual V3

ZDR
cohere/embed-multilingual-v3.0
Input / Output$0.10 / M
Context512
Speed500 tps

Llama 3.3 70B Fast FP8 Edge

$0 FREEZDR
cloudflare/@cf/meta/llama-3.3-70b-instruct-fp8-fast
Input / Output$0.00 / M
Context128K
Speed110 tps

DeepSeek R1 Distill Qwen 32B Edge

$0 FREEZDR
cloudflare/@cf/deepseek-ai/deepseek-r1-distill-qwen-32b
Input / Output$0.00 / M
Context128K
Speed120 tps

Llama 3.1 8B Instruct Edge

$0 FREEZDR
cloudflare/@cf/meta/llama-3.1-8b-instruct
Input / Output$0.00 / M
Context128K
Speed220 tps

BGE Base English Edge Embeddings

$0 FREEZDR
cloudflare/@cf/baai/bge-base-en-v1.5
Input / Output$0.00 / M
Context512
Speed600 tps

GLM 4 Flash Ultra-Fast Free

$0 FREE
zhipu/glm-4-flash
Input / Output$0.00 / M
Context128K
Speed160 tps

GLM 4 Plus Frontier

zhipu/glm-4-plus
Input / Output$1.40 / M
Context128K
Speed75 tps

Llama 3.1 405B Frontier NIM

$0 FREEZDR
nvidia/llama-3.1-405b
Input / Output$0.00 / M
Context128K
Speed75 tps

Llama 3.3 70B Instruct (DeepInfra)

deepinfra/meta-llama/Llama-3.3-70B-Instruct
Input / Output$0.23 / M
Context128K
Speed120 tps

DeepSeek R1 (DeepInfra Serverless)

deepinfra/deepseek-ai/DeepSeek-R1
Input / Output$0.55 / M
Context64K
Speed65 tps

DeepSeek V3 (DeepInfra Serverless)

deepinfra/deepseek-ai/DeepSeek-V3
Input / Output$0.14 / M
Context64K
Speed80 tps

Qwen 2.5 Coder 32B (DeepInfra)

deepinfra/Qwen/Qwen2.5-Coder-32B-Instruct
Input / Output$0.15 / M
Context128K
Speed110 tps

Llama 3.1 8B Instruct (DeepInfra)

deepinfra/meta-llama/Meta-Llama-3.1-8B-Instruct
Input / Output$0.05 / M
Context128K
Speed230 tps

Mistral 7B Instruct v0.3 (DeepInfra)

deepinfra/mistralai/Mistral-7B-Instruct-v0.3
Input / Output$0.05 / M
Context32K
Speed200 tps

BGE M3 Embeddings (DeepInfra)

deepinfra/BAAI/bge-m3
Input / Output$0.02 / M
Context8K
Speed500 tps

BGE Reranker Large (DeepInfra)

deepinfra/BAAI/bge-reranker-large
Input / Output$0.02 / M
Context512
Speed400 tps

Llama 3.2 11B Vision (DeepInfra)

deepinfra/meta-llama/Llama-3.2-11B-Vision-Instruct
Input / Output$0.15 / M
Context128K
Speed130 tps

Qwen 2.5 72B Instruct (DeepInfra)

deepinfra/Qwen/Qwen2.5-72B-Instruct
Input / Output$0.35 / M
Context128K
Speed85 tps

Llama 3.3 70B SN40L Reconfigurable

$0 FREE
sambanova/Meta-Llama-3.3-70B-Instruct
Input / Output$0.00 / M
Context128K
Speed400 tps

DeepSeek R1 Distill 70B SambaNova

$0 FREE
sambanova/DeepSeek-R1-Distill-Llama-70B
Input / Output$0.00 / M
Context128K
Speed310 tps

Qwen 2.5 Coder 32B SambaNova Fast

$0 FREE
sambanova/Qwen2.5-Coder-32B-Instruct
Input / Output$0.00 / M
Context128K
Speed250 tps

Llama 3.1 405B SambaNova

$0 FREE
sambanova/Meta-Llama-3.1-405B-Instruct
Input / Output$0.00 / M
Context128K
Speed120 tps

Llama 3.1 8B SambaNova Hyper

$0 FREE
sambanova/Meta-Llama-3.1-8B-Instruct
Input / Output$0.00 / M
Context128K
Speed650 tps

Qwen 2.5 72B SambaNova

$0 FREE
sambanova/Qwen2.5-72B-Instruct
Input / Output$0.00 / M
Context128K
Speed220 tps

Llama 3.3 70B (Hyperbolic GPU Cloud)

hyperbolic/meta-llama/Llama-3.3-70B-Instruct
Input / Output$0.40 / M
Context128K
Speed130 tps

DeepSeek R1 (Hyperbolic Dedicated)

hyperbolic/deepseek-ai/DeepSeek-R1
Input / Output$0.60 / M
Context64K
Speed75 tps

DeepSeek V3 (Hyperbolic Dedicated)

hyperbolic/deepseek-ai/DeepSeek-V3
Input / Output$0.15 / M
Context64K
Speed85 tps

Qwen 2.5 Coder 32B Hyperbolic

hyperbolic/Qwen/Qwen2.5-Coder-32B-Instruct
Input / Output$0.15 / M
Context128K
Speed115 tps

Llama 3.1 405B Hyperbolic H100

hyperbolic/meta-llama/Meta-Llama-3.1-405B-Instruct
Input / Output$2.80 / M
Context128K
Speed65 tps

Llama 3.1 8B Hyperbolic Fast

hyperbolic/meta-llama/Meta-Llama-3.1-8B-Instruct
Input / Output$0.08 / M
Context128K
Speed240 tps

Llama 3.3 70B (Novita AI Cloud)

novita/meta-llama/llama-3.3-70b-instruct
Input / Output$0.39 / M
Context128K
Speed120 tps

DeepSeek R1 (Novita AI)

novita/deepseek/deepseek-r1
Input / Output$0.55 / M
Context64K
Speed70 tps

DeepSeek V3 (Novita AI)

novita/deepseek/deepseek-v3
Input / Output$0.14 / M
Context64K
Speed80 tps

Qwen 2.5 Coder 32B (Novita AI)

novita/qwen/qwen-2.5-coder-32b-instruct
Input / Output$0.15 / M
Context128K
Speed110 tps

Llama 3.1 8B (Novita AI)

novita/meta-llama/llama-3.1-8b-instruct
Input / Output$0.05 / M
Context128K
Speed230 tps

Mistral NeMo 12B (Novita AI)

novita/mistralai/mistral-nemo
Input / Output$0.15 / M
Context128K
Speed140 tps

BGE M3 (Novita AI Embeddings)

novita/baai/bge-m3
Input / Output$0.02 / M
Context8K
Speed450 tps

Qwen 2.5 72B (Novita AI)

novita/qwen/qwen-2.5-72b-instruct
Input / Output$0.35 / M
Context128K
Speed85 tps

Voyage 3 Large State of the Art Embedding

ZDR
voyage/voyage-3-large
Input / Output$0.12 / M
Context32K
Speed300 tps

Voyage Code 3 Dedicated Retrieval

ZDR
voyage/voyage-code-3
Input / Output$0.12 / M
Context32K
Speed320 tps

Voyage Rerank 2

ZDR
voyage/rerank-2
Input / Output$0.05 / M
Context16K
Speed400 tps

Solar Pro 22B Preview

upstage/solar-pro
Input / Output$0.25 / M
Context64K
Speed120 tps

Solar Mini 10.7B Fast

upstage/solar-mini
Input / Output$0.15 / M
Context32K
Speed180 tps

Solar Document Vision OCR

upstage/solar-docvision
Input / Output$0.30 / M
Context32K
Speed90 tps

Llama 2 70B Chat (Replicate)

replicate/meta/llama-2-70b-chat
Input / Output$0.65 / M
Context4K
Speed50 tps

Llama 3 70B Instruct (Replicate)

replicate/meta/meta-llama-3-70b-instruct
Input / Output$0.65 / M
Context8K
Speed80 tps

Mixtral 8x7B (Replicate)

replicate/mistralai/mixtral-8x7b-instruct-v0.1
Input / Output$0.30 / M
Context32K
Speed90 tps

Stable Diffusion XL Image Gen

replicate/stability-ai/sdxl
Input / Output$2.00 / M
Context1K
Speed25 tps

OpenAI Whisper Audio Transcription

replicate/openai/whisper
Input / Output$0.006 / M
Context1K
Speed100 tps

Llama 3.3 70B (Lepton Photon)

lepton/llama3-3-70b
Input / Output$0.80 / M
Context128K
Speed140 tps

DeepSeek R1 (Lepton Serverless)

lepton/deepseek-r1
Input / Output$0.60 / M
Context64K
Speed75 tps

Qwen 2.5 72B (Lepton Photon)

lepton/qwen2-5-72b
Input / Output$0.40 / M
Context128K
Speed110 tps

BGE Large English (Lepton)

lepton/bge-large-en
Input / Output$0.05 / M
Context8K
Speed500 tps

Whisper Large v3 (Lepton Voice)

lepton/whisper-large-v3
Input / Output$0.005 / M
Context1K
Speed120 tps

Llama 3.3 70B (Baseten Chain)

baseten/llama-3-3-70b-instruct
Input / Output$0.75 / M
Context128K
Speed135 tps

DeepSeek R1 (Baseten Truss)

baseten/deepseek-r1
Input / Output$0.75 / M
Context64K
Speed80 tps

Qwen 2.5 Coder 32B (Baseten)

baseten/qwen-2-5-coder-32b
Input / Output$0.20 / M
Context128K
Speed125 tps

Mistral Large 2 (Baseten)

baseten/mistral-large-2
Input / Output$2.00 / M
Context128K
Speed75 tps

Microsoft Phi-3 Medium 128K

baseten/phi-3-medium-128k
Input / Output$0.15 / M
Context128K
Speed160 tps

DBRX Instruct 132B MoE

ZDR
databricks/dbrx-instruct
Input / Output$0.75 / M
Context32K
Speed85 tps

DBRX Base Pretrained

ZDR
databricks/dbrx-base
Input / Output$0.75 / M
Context32K
Speed85 tps

Databricks BGE Large Embeddings

ZDR
databricks/bge-large-en
Input / Output$0.05 / M
Context8K
Speed450 tps

Llama 3.1 70B (Databricks Serving)

ZDR
databricks/meta-llama-3-1-70b-instruct
Input / Output$0.75 / M
Context128K
Speed120 tps

Llama 3.1 405B (Databricks Serving)

ZDR
databricks/meta-llama-3-1-405b-instruct
Input / Output$3.00 / M
Context128K
Speed60 tps