Compare model prices
Input, output, cached and batch prices, every route and a month of tokens, side by side.
A month of tokens
Llama 3.1 8B Instruct$2.80
100M input and 20M output tokens, list price. Use your own numbers.
Side by side
| Llama 3.1 8B Instruct | |
|---|---|
| Input per 1M | $0.02 |
| Output per 1M | $0.04 |
| Cached input | n/a |
| Batch in / out | n/a |
| Blended (3:1) | $0.025 |
| Context | 131K |
| Routes | 5 |
| Released | Jul 23, 2024 |
| Leadersboard score | n/a |
On the price map
Size: context window, 8K to 2MEqual blended cost (3:1) 243 models, lower left is cheaper
Every route
Llama 3.1 8B Instruct
| Way to buy | Input | Output | In / out per 1M | Cached | Vs list |
|---|---|---|---|---|---|
fp8 | $0.02 | $0.04 | $0.02 / $0.04Same as list | n/a | Same as list |
fp8 | $0.02 | $0.05 | $0.02 / $0.05+10% vs list | n/a | +10% vs list |
Default region · cached $0.025 | $0.05 | $0.08 | $0.05 / $0.08+130% vs list | $0.025 | +130% vs list |
fp8 | $0.152 | $0.287 | $0.152 / $0.287+643% vs list | n/a | +643% vs list |
bf16 · cached $0.22 | $0.22 | $0.22 | $0.22 / $0.22+780% vs list | $0.22 | +780% vs list |
List prices from providers' pages on the date shown; your contract may differ. Logos via logo.dev; trademarks belong to their owners.