Skip to content
Open Source
Models/together/meta-llama-3.1-405b-instruct-turbo

Llama 3.1 405B Frontier Turbo

Active
together/meta-llama-3.1-405b-instruct-turbo
Input / Prompt$3.50 / M
Output / Completion$3.50 / M
Context Window128K
Throughput Speed60 tps
3 Providers Serving This ModelDeterministic Failover Active
ProviderInput /MOutput /MLatency (TTFT)Speed (TPS)UptimeQuantizationZDRAction
TOGETHERPrimary Upstream
$3.50 / M$3.50 / M0.12s60 tps99.98%FP16NoConnect / Configure Provider →
OpenRouter (Edge Router)Multi-Region Backup
$3.50 / M$3.50 / M0.24s110 tps99.92%FP8YesConnect / Configure Provider →
Cerebras Cloud LPUInference Accelerator
$0.00 / M$0.00 / M0.04s2,100 tps99.85%INT8NoConnect / Configure Provider →