Chat Bison vs Claude 3 Opus: Benchmarks, Pricing, and Context Window Comparison
Chat Bison vs Claude 3 Opus compares provider, context window, token pricing, benchmark performance, and release timeline in one side-by-side view. Use this page to quickly identify which model is a better fit for your production constraints, quality targets, and estimated cost per request.
Verdict
Chat Bison has lower listed token pricing, while Claude 3 Opus can still be preferable if benchmark results better match your workload.
Author: Mirai Minds Research Team
Last updated:
Compare
to
Overview
Chat Bison was released 7 months before Claude 3 Opus.
| Chat Bison |  Claude 3 Opus | |
|---|---|---|
Provider The entity that provides this model. | Google | Anthropic |
Input Context Window The number of tokens supported by the input context window. | 8,192 tokens | 200K tokens |
Maximum Output Tokens The number of tokens that can be generated by the model in a single request. | 2,048 tokens | 4,096 tokens |
Release Date When the model was first released. | Jul 10, 2023 over 1 yearago 2023-07-10 | Mar 04, 2024 over 1 year 2024-03-04 |
Leaderboard
| Chat Bison | Claude 3 Opus | |
|---|---|---|
Rank | Unknown | 2 |
Arena Elo | Not specified. | 1251 |
95% CI | Not specified. | +3/-3 |
Votes | Not specified. | 75684 |
License | Not specified. | Proprietary |
Knowledge Cutoff | Unknown | 8/2023 8/2023 |
Pricing
| Chat Bison | Claude 3 Opus | |
|---|---|---|
Input Cost of input data provided to the model. | $0.25 per million tokens | $15.00 per million tokens |
Output Cost of output tokens generated by the model. | $0.50 per million tokens | $75.00 per million tokens |
Benchmarks
Compare relevant benchmarks between Chat Bison and Claude 3 Opus Instruct.
| Chat Bison | Claude 3 Opus | |
|---|---|---|
MMLU Evaluating LLM knowledge acquisition in zero-shot and few-shot settings. | 78.3 (5-shot) | 88.2 (5-shot) |
MMMU A wide ranging multi-discipline and multimodal benchmark. | Benchmark not available. | 59.4 |
HellaSwag A challenging sentence completion benchmark. | Benchmark not available. | 95.4 (10-shot) |
Ready to kick off?
sneh[at]miraiminds.coExplore
Industries
Comparison
Mirai Minds
Mirai Minds