
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient.
It has demonstrated strong performance compared to leading closed-source models in human evaluations.
To read more about the model release, click hereOpens in new tab. Usage of this model is subject to Meta's Acceptable Use PolicyOpens in new tab.
| $0.02 | $0.04 | -- | 0.73s | 14 tps | ||
| $0.02 | $0.05 | -- | 0.55s | 55 tps | ||
| $0.05 | $0.08 | $0.025 | 0.24s | 99 tps | ||
| $0.152 | $0.287 | -- | 0.42s | 13 tps | ||
| $0.22 | $0.22 | $0.22 | 0.25s | 103 tps |
P50, best across providers
P50, best provider
When an error occurs in an upstream provider, we can recover by routing to another healthy provider, if your request filters allow it. You can access per-provider uptime data programmatically through the Endpoints API. Learn more about our load balancing and customization options.