Gemini 1.0 Pro vs GPT-4 Turbo 2024-04-09: Benchmarks, Pricing, and Context Window Comparison
Gemini 1.0 Pro vs GPT-4 Turbo 2024-04-09 compares provider, context window, token pricing, benchmark performance, and release timeline in one side-by-side view. Use this page to quickly identify which model is a better fit for your production constraints, quality targets, and estimated cost per request.
Verdict
GPT-4 Turbo 2024-04-09 has lower listed token pricing, while Gemini 1.0 Pro can still be preferable if benchmark results better match your workload.
Author: Mirai Minds Research Team
Last updated:
Compare
to
Overview
Gemini 1.0 Pro was released 3 months before GPT-4 Turbo 2024-04-09.
| Gemini 1.0 Pro |  GPT-4 Turbo 2024-04-09 | |
|---|---|---|
Provider The entity that provides this model. | Google | OpenAI |
Input Context Window The number of tokens supported by the input context window. | 32.8K tokens | 128K tokens |
Maximum Output Tokens The number of tokens that can be generated by the model in a single request. | 8,192 tokens | 4,096 tokens |
Release Date When the model was first released. | Dec 13, 2023 over 1 yearago 2023-12-13 | Apr 09, 2024 over 1 year 2024-04-09 |
Leaderboard
| Gemini 1.0 Pro | GPT-4 Turbo 2024-04-09 | |
|---|---|---|
Rank | 25 | 1 |
Arena Elo | 1115 | 1257 |
95% CI | +6/-6 | +4/-3 |
Votes | 6818 | 30562 |
License | Proprietary | Proprietary |
Knowledge Cutoff | 4/2023 4/2023 | 12/2023 12/2023 |
Pricing
| Gemini 1.0 Pro | GPT-4 Turbo 2024-04-09 | |
|---|---|---|
Input Cost of input data provided to the model. | $12.50 per million tokens | $10.00 per million tokens |
Output Cost of output tokens generated by the model. | $37.50 per million tokens | $30.00 per million tokens |
Benchmarks
Compare relevant benchmarks between Gemini 1.0 Pro and GPT-4 Turbo 2024-04-09 Instruct.
| Gemini 1.0 Pro | GPT-4 Turbo 2024-04-09 | |
|---|---|---|
MMLU Evaluating LLM knowledge acquisition in zero-shot and few-shot settings. | 71.8 (5-shot) | Benchmark not available. |
MMMU A wide ranging multi-discipline and multimodal benchmark. | 47.9 | Benchmark not available. |
HellaSwag A challenging sentence completion benchmark. | Benchmark not available. | Benchmark not available. |
Ready to kick off?
sneh[at]miraiminds.coExplore
Industries
Comparison
Mirai Minds
Mirai Minds