Llama 3.1 405B (Databricks Serving)
ActiveZDR Certifieddatabricks/meta-llama-3-1-405b-instructInput / Prompt$3.00 / M
Output / Completion$3.00 / M
Context Window128K
Throughput Speed60 tps
3 Providers Serving This ModelDeterministic Failover Active
| Provider | Input /M | Output /M | Latency (TTFT) | Speed (TPS) | Uptime | Quantization | ZDR | Action |
|---|---|---|---|---|---|---|---|---|
DATABRICKSPrimary Upstream | $3.00 / M | $3.00 / M | 0.12s | 60 tps | 99.98% | FP16 | Yes | Connect / Configure Provider → |
OpenRouter (Edge Router)Multi-Region Backup | $3.00 / M | $3.00 / M | 0.24s | 110 tps | 99.92% | FP8 | Yes | Connect / Configure Provider → |
Cerebras Cloud LPUInference Accelerator | $0.00 / M | $0.00 / M | 0.04s | 2,100 tps | 99.85% | INT8 | No | Connect / Configure Provider → |