Model Lab — Math results

🧮 Math benchmark — 1 questions × 3 models

2026-06-22T20:28:53 · difficulty: easy · AMC 8 / AJHSME · 📨 all-at-once (1 call/model) · all sessions →

💸 Spent on this benchmark: 0.81¢ across 3 answers (1 questions × 3 models)

Leaderboard (accuracy on graded answers)

Sort by: 🎯 Accuracy ⚡ Fastest 🐢 Slowest 💸 Cheapest 💰 Priciest

#	Model	Correct	Accuracy	Avg/Q	Total time	Cost	$/M out	Out tok	~Impl tok
🥇	`openrouter:meta-llama/llama-4-maverick`	1/1	100%	10.9s	10.9s	0.02¢	$0.65	305	337
🥈	`openrouter:openai/gpt-5.5`	1/1	100%	4.4s	4.4s	0.79¢	$30.00	225	264
🥉	`openrouter:~google/gemini-pro-latest`	1/1	100%	5.2s	5.2s	0.00¢	–	338	–

Accuracy by difficulty (all models): easy 100%

Out tok = actual output tokens (summed from each call's usage). ~Impl tok = cost ÷ output-price (what the spend implies if it were all output) — runs a touch above Out tok because input tokens fold in; tracks closely here since prompts are short.

Question × model matrix — each cell is the model's pick · 🟩 correct · 🟥 wrong

Model ↓ / Q →	Q1 ans C
`openrouter:meta-llama/llama-4-maverick`	C ✓
`openrouter:openai/gpt-5.5`	C ✓
`openrouter:~google/gemini-pro-latest`	C ✓
solved (models ✓)	3/3

Cell = the letter the model chose; 🟩 matches the correct answer, 🟥 wrong · ⏳ running · ⚠ error. Bottom row = how many models solved each question (🟩 all got it … 🟥 most missed it), so you can spot the questions the models struggled with.

Questions & model reasoning

Q1 · easy · AMC 8 2014 #5 — correct: C (160 miles.) · solved by 3/3 models

Margie's car can go 32 miles on a gallon of gas, and gas currently costs $4 per gallon. How many miles can Margie drive on $20 worth of gas?

Official approach: chain the rates: dollars → gallons → miles

Model Pick ✓/✗ Reasoning

Model	Pick	✓/✗	Reasoning
`openrouter:meta-llama/llama-4-maverick`	C	✓	show Problem 1: We are asked to determine how many miles Margie can drive on $20 worth of gas, given that her car can go 32 miles on a gallon of gas and gas costs $4 per gallon. First, let's find out how many gallons of gas Margie can buy with $20. To do this, we divide the amount of money she has ($20) by the cost per gallon ($4). $20 ÷ $4 = 5 gallons Now that we know Margie can buy 5 gallons of gas, we need to calculate how many miles she can drive on 5 gallons. Since her car can go 32 miles on a gallon, we multiply the number of gallons by the miles per gallon. 5 gallons × 32 miles/gallon = 160 miles Let's examine the choices: A. 64 miles: This is too low, as 64 miles would be equivalent to 2 gallons of gas ($8 worth). B. 128 miles: This is also too low, as 128 miles would be equivalent to 4 gallons of gas ($16 worth). C. 160 miles: This matches our calculation. D. 320 miles: This is too high, as 320 miles would be equivalent to 10 gallons of gas ($40 worth). E. 640 miles: This is even higher and equivalent to 20 gallons of gas ($80 worth). Therefore, the correct answer is the one that matches our calculation. ANSWER 1: C
`openrouter:openai/gpt-5.5`	C	✓	show Problem 1: Margie's car gets 32 miles per gallon, and gas costs $4 per gallon. We are asked: How many miles can Margie drive on $20 worth of gas? First find how many gallons of gas $20 buys: \[ 20 \div 4 = 5 \] So Margie can buy 5 gallons of gas. Now multiply by the number of miles per gallon: \[ 5 \times 32 = 160 \] So Margie can drive 160 miles. Checking the choices: - A. 64 is too small; that would be only 2 gallons of gas. - B. 128 is 4 gallons of gas, but $20 buys 5 gallons. - C. 160 matches the calculation. - D. 320 would require 10 gallons. - E. 640 would require 20 gallons. ANSWER 1: C
`openrouter:~google/gemini-pro-latest`	C	✓	show To solve this problem, we need to find out how many miles Margie can drive given a budget of $20 for gas. Step 1: Determine how many gallons of gas Margie can buy. We know that gas costs $4 per gallon. If Margie has $20 to spend, we can divide her total money by the cost per gallon: $20 ÷ $4/gallon = 5 gallons Step 2: Calculate the total distance she can drive. Margie's car gets 32 miles for every gallon of gas. Since she has 5 gallons of gas, we multiply the number of gallons by the miles her car can go per gallon: 5 gallons × 32 miles/gallon = 160 miles Margie can drive 160 miles on $20 worth of gas. ANSWER 1: C

openrouter:meta-llama/llama-4-maverick

✓

show

Problem 1:
We are asked to determine how many miles Margie can drive on $20 worth of gas, given that her car can go 32 miles on a gallon of gas and gas costs $4 per gallon.

First, let's find out how many gallons of gas Margie can buy with $20. To do this, we divide the amount of money she has ($20) by the cost per gallon ($4). 

$20 ÷ $4 = 5 gallons

Now that we know Margie can buy 5 gallons of gas, we need to calculate how many miles she can drive on 5 gallons. Since her car can go 32 miles on a gallon, we multiply the number of gallons by the miles per gallon.

5 gallons × 32 miles/gallon = 160 miles

Let's examine the choices:
A. 64 miles: This is too low, as 64 miles would be equivalent to 2 gallons of gas ($8 worth).
B. 128 miles: This is also too low, as 128 miles would be equivalent to 4 gallons of gas ($16 worth).
C. 160 miles: This matches our calculation.
D. 320 miles: This is too high, as 320 miles would be equivalent to 10 gallons of gas ($40 worth).
E. 640 miles: This is even higher and equivalent to 20 gallons of gas ($80 worth).

Therefore, the correct answer is the one that matches our calculation.

ANSWER 1: C

openrouter:openai/gpt-5.5

✓

show

Problem 1:

Margie's car gets **32 miles per gallon**, and gas costs **$4 per gallon**.

We are asked: **How many miles can Margie drive on $20 worth of gas?**

First find how many gallons of gas $20 buys:

\[
20 \div 4 = 5
\]

So Margie can buy **5 gallons** of gas.

Now multiply by the number of miles per gallon:

\[
5 \times 32 = 160
\]

So Margie can drive **160 miles**.

Checking the choices:

- A. 64 is too small; that would be only 2 gallons of gas.
- B. 128 is 4 gallons of gas, but $20 buys 5 gallons.
- C. 160 matches the calculation.
- D. 320 would require 10 gallons.
- E. 640 would require 20 gallons.

ANSWER 1: C

openrouter:~google/gemini-pro-latest

✓

show

To solve this problem, we need to find out how many miles Margie can drive given a budget of $20 for gas.

**Step 1: Determine how many gallons of gas Margie can buy.**
We know that gas costs $4 per gallon. If Margie has $20 to spend, we can divide her total money by the cost per gallon:
$20 ÷ $4/gallon = 5 gallons

**Step 2: Calculate the total distance she can drive.**
Margie's car gets 32 miles for every gallon of gas. Since she has 5 gallons of gas, we multiply the number of gallons by the miles her car can go per gallon:
5 gallons × 32 miles/gallon = 160 miles

Margie can drive 160 miles on $20 worth of gas.

ANSWER 1: C