One of the highest performing and most popular fine-tunes of Llama 2 13B, with rich descriptions and roleplay. #merge
| $0.08 | $0.11 | 0.42s | 87 tps | ||
| $0.35 | $0.60 | 0.42s | 61 tps | ||
| $0.40 | $0.40 | 0.27s | 44 tps |
P50, best across providers
P50, best provider
When an error occurs in an upstream provider, we can recover by routing to another healthy provider, if your request filters allow it. You can access per-provider uptime data programmatically through the Endpoints API. Learn more about our load balancing and customization options.