Compare model prices
Input, output, cached and batch prices, every route and a month of tokens, side by side.
Llama 3.1 70B InstructA month of tokens
100M input and 20M output tokens, list price. Use your own numbers.
Side by side
| Llama 3.1 70B Instruct | |
|---|---|
| Input per 1M | $0.4 |
| Output per 1M | $0.4 |
| Cached input | n/a |
| Batch in / out | n/a |
| Blended (3:1) | $0.4 |
| Context | 131K |
| Routes | 2 |
| Released | Jul 23, 2024 |
| Leadersboard score | n/a |
On the price map
Size: context window, 8K to 2MEqual blended cost (3:1) 243 models, lower left is cheaper
Every route
Llama 3.1 70B Instruct
| Way to buy | Input | Output | In / out per 1M | Cached | Vs list |
|---|---|---|---|---|---|
 DeepInfraturbo, fp8 | $0.4 | $0.4 | $0.4 / $0.4Same as list | n/a | Same as list |
 AWS BedrockDefault region | $0.72 | $0.72 | $0.72 / $0.72+80% vs list | n/a | +80% vs list |
List prices from providers' pages on the date shown; your contract may differ. Logos via logo.dev; trademarks belong to their owners.