Llama 2 Chat 70B vs Mistral 7B Instruct: Benchmarks, Pricing, and Context Window Comparison
Llama 2 Chat 70B vs Mistral 7B Instruct compares provider, context window, token pricing, benchmark performance, and release timeline in one side-by-side view. Use this page to quickly identify which model is a better fit for your production constraints, quality targets, and estimated cost per request.
Verdict
Mistral 7B Instruct has lower listed token pricing, while Llama 2 Chat 70B can still be preferable if benchmark results better match your workload.
Author: Mirai Minds Research Team
Last updated:
Compare
to
Overview
Llama 2 Chat 70B was released 2 months before Mistral 7B Instruct.
| Llama 2 Chat 70B | Mistral 7B Instruct | |
|---|---|---|
Provider The entity that provides this model. | Meta | Mistral |
Input Context Window The number of tokens supported by the input context window. | 4,096 tokens | 32K tokens |
Maximum Output Tokens The number of tokens that can be generated by the model in a single request. | 2,048 tokens | 8,192 tokens |
Release Date When the model was first released. | Jul 18, 2023 over 1 yearago 2023-07-18 | Sep 27, 2023 over 1 year 2023-09-27 |
Leaderboard
| Llama 2 Chat 70B | Mistral 7B Instruct | |
|---|---|---|
Rank | 41 | Unknown |
Arena Elo | 1088 | Not specified. |
95% CI | +3/-4 | Not specified. |
Votes | 38748 | Not specified. |
License | Llama 2 Community | Not specified. |
Knowledge Cutoff | 7/2023 7/2023 | Unknown |
Pricing
| Llama 2 Chat 70B | Mistral 7B Instruct | |
|---|---|---|
Input Cost of input data provided to the model. | $0.65 per million tokens | $0.25 per million tokens |
Output Cost of output tokens generated by the model. | $2.75 per million tokens | $0.25 per million tokens |
Benchmarks
Compare relevant benchmarks between Llama 2 Chat 70B and Mistral 7B Instruct Instruct.
| Llama 2 Chat 70B | Mistral 7B Instruct | |
|---|---|---|
MMLU Evaluating LLM knowledge acquisition in zero-shot and few-shot settings. | 68.9 (5-shot) | 60.1 (5-shot) |
MMMU A wide ranging multi-discipline and multimodal benchmark. | 30.1 | Benchmark not available. |
HellaSwag A challenging sentence completion benchmark. | Benchmark not available. | Benchmark not available. |