Gemma 2 27B vs GPT-3.5 Turbo 1106: Benchmarks, Pricing, and Context Window Comparison
Gemma 2 27B vs GPT-3.5 Turbo 1106 compares provider, context window, token pricing, benchmark performance, and release timeline in one side-by-side view. Use this page to quickly identify which model is a better fit for your production constraints, quality targets, and estimated cost per request.
Verdict
Gemma 2 27B has lower listed token pricing, while GPT-3.5 Turbo 1106 can still be preferable if benchmark results better match your workload.
Author: Mirai Minds Research Team
Last updated:
Compare
to
Overview
Gemma 2 27B was released 8 months after GPT-3.5 Turbo 1106.
| Gemma 2 27B |  GPT-3.5 Turbo 1106 | |
|---|---|---|
Provider The entity that provides this model. | Google | OpenAI |
Input Context Window The number of tokens supported by the input context window. | 8,192 tokens | 16.4K tokens |
Maximum Output Tokens The number of tokens that can be generated by the model in a single request. | Not specified. | 16.4K tokens |
Release Date When the model was first released. | Jun 27, 2024 over 1 yearago 2024-06-27 | Nov 06, 2023 over 1 year 2023-11-06 |
Leaderboard
| Gemma 2 27B | GPT-3.5 Turbo 1106 | |
|---|---|---|
Rank | Unknown | 46 |
Arena Elo | Not specified. | 1072 |
95% CI | Not specified. | +5/-4 |
Votes | Not specified. | 17819 |
License | Not specified. | Proprietary |
Knowledge Cutoff | Unknown | 9/2021 9/2021 |
Pricing
| Gemma 2 27B | GPT-3.5 Turbo 1106 | |
|---|---|---|
Input Cost of input data provided to the model. | $0.27 per million tokens | $1.00 per million tokens |
Output Cost of output tokens generated by the model. | $0.27 per million tokens | $2.00 per million tokens |
Benchmarks
Compare relevant benchmarks between Gemma 2 27B and GPT-3.5 Turbo 1106 Instruct.
| Gemma 2 27B | GPT-3.5 Turbo 1106 | |
|---|---|---|
MMLU Evaluating LLM knowledge acquisition in zero-shot and few-shot settings. | 75.2 (5-shot) | Benchmark not available. |
MMMU A wide ranging multi-discipline and multimodal benchmark. | Benchmark not available. | Benchmark not available. |
HellaSwag A challenging sentence completion benchmark. | 86.4 (10-shot) | Benchmark not available. |