Skip to content
Open Source
Models/cerebras/llama-3.1-8b

Llama 3.1 8B CS-3 Hyper

Active
cerebras/llama-3.1-8b
Input / Prompt$0.00 / M
Output / Completion$0.00 / M
Context Window8K
Throughput Speed2,600 tps
3 Providers Serving This ModelDeterministic Failover Active
ProviderInput /MOutput /MLatency (TTFT)Speed (TPS)UptimeQuantizationZDRAction
CEREBRASPrimary Upstream
$0.00 / M$0.00 / M0.12s2,600 tps99.98%FP16NoConnect / Configure Provider →
OpenRouter (Edge Router)Multi-Region Backup
$0.00 / M$0.00 / M0.24s110 tps99.92%FP8YesConnect / Configure Provider →
Cerebras Cloud LPUInference Accelerator
$0.00 / M$0.00 / M0.04s2,100 tps99.85%INT8NoConnect / Configure Provider →