Skip to content
Open Source
Models/cerebras/llama-3.1-70b

Llama 3.1 70B CS-3

Active
cerebras/llama-3.1-70b
Input / Prompt$0.00 / M
Output / Completion$0.00 / M
Context Window8K
Throughput Speed2,000 tps
3 Providers Serving This ModelDeterministic Failover Active
ProviderInput /MOutput /MLatency (TTFT)Speed (TPS)UptimeQuantizationZDRAction
CEREBRASPrimary Upstream
$0.00 / M$0.00 / M0.12s2,000 tps99.98%FP16NoConnect / Configure Provider →
OpenRouter (Edge Router)Multi-Region Backup
$0.00 / M$0.00 / M0.24s110 tps99.92%FP8YesConnect / Configure Provider →
Cerebras Cloud LPUInference Accelerator
$0.00 / M$0.00 / M0.04s2,100 tps99.85%INT8NoConnect / Configure Provider →