Gemini 2.5 Flash Preview vs GPT-4o mini: Benchmarks, Pricing, and Context Window Comparison
Gemini 2.5 Flash Preview vs GPT-4o mini compares provider, context window, token pricing, benchmark performance, and release timeline in one side-by-side view. Use this page to quickly identify which model is a better fit for your production constraints, quality targets, and estimated cost per request.
Verdict
GPT-4o mini has lower listed token pricing, while Gemini 2.5 Flash Preview can still be preferable if benchmark results better match your workload.
Author: Mirai Minds Research Team
Last updated:
Compare
to
Overview
Gemini 2.5 Flash Preview was released 9 months after GPT-4o mini.
GPT-4o mini | ||
|---|---|---|
Provider The entity that provides this model. | OpenAI | |
Input Context Window The number of tokens supported by the input context window. | 1,048,576 tokens | 128000 tokens |
Maximum Output Tokens The number of tokens that can be generated by the model in a single request. | 65,536 tokens | 16,384 tokens |
Release Date When the model was first released. | Apr 17, 2025 over 1 yearago 2025-04-17 | Jul 18, 2024 over 1 year 2024-07-18 |
Leaderboard
GPT-4o mini | ||
|---|---|---|
Rank | Unknown | Unknown |
Arena Elo | Not specified. | Not specified. |
95% CI | Not specified. | Not specified. |
Votes | Not specified. | Not specified. |
License | Not specified. | Not specified. |
Knowledge Cutoff | Unknown | Unknown |
Pricing
GPT-4o mini | ||
|---|---|---|
Input Cost of input data provided to the model. | $0.15 per million tokens | $0.15 per million tokens |
Output Cost of output tokens generated by the model. | $0.60 per million tokens | $0.60 per million tokens |
Benchmarks
Compare relevant benchmarks between Gemini 2.5 Flash Preview and GPT-4o mini Instruct.
GPT-4o mini | ||
|---|---|---|
MMLU Evaluating LLM knowledge acquisition in zero-shot and few-shot settings. | 88.4 (5-shot) | 82 (5-shot) |
MMMU A wide ranging multi-discipline and multimodal benchmark. | 76.7 | 59.4 |
HellaSwag A challenging sentence completion benchmark. | Benchmark not available. | Benchmark not available. |

GPT-4o mini