🔬 Model Lab

New run Stored runs ⚖️ Judge verdicts 🧮 Math 📊 Math runs 📄 Benchmark paper 📄 3-model paper 📄 Meta: Will Muse Cause a Spark?

🧮 Math sessions (85)

💸 Total spend — Math benchmarks: 2288.98¢ · Article runs: 130.80¢ · Lab total: 2419.77¢ (≈ $24.20)

+ New benchmark

WhenDifficultyQsModelsCost🏆 Top
2026-09-03T15:38:54hard 106 38.63¢ openrouter:google/gemini-3.8-flash 100% view
2026-09-03T15:35:44medium 106 31.61¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T15:33:43easy 106 20.57¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T15:30:33stretch 106 44.98¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T15:27:23hard 106 39.66¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T15:25:43medium 106 28.79¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T15:24:33easy 106 23.32¢ openrouter:anthropic/claude-opus-5 100% view
2026-09-03T15:21:23stretch 106 50.91¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T15:18:43hard 106 41.64¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T15:16:03medium 106 24.30¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T15:15:13easy 106 20.41¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T15:12:03stretch 106 46.79¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T15:09:03hard 106 42.76¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T15:05:53medium 106 34.08¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T15:04:23easy 106 18.26¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T15:03:03stretch 106 39.80¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T14:59:53hard 106 30.85¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T14:58:43medium 106 25.90¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T14:55:33easy 106 20.76¢ openrouter:anthropic/claude-opus-5 100% view
2026-09-03T14:53:13stretch 106 40.88¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T14:50:08hard 106 33.60¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T14:47:08medium 106 27.75¢ openrouter:google/gemini-3.8-flash 100% view
2026-09-03T14:45:58easy 106 21.13¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T14:42:44stretch 106 45.33¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T14:39:40hard 106 21.82¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T14:36:30medium 106 29.63¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T14:33:20easy 106 24.16¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T14:30:14stretch 106 54.24¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T14:27:34hard 106 28.48¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T14:25:44medium 107 31.02¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T14:24:54easy 107 19.67¢ openrouter:meta/muse-spark-1.3 100% view
2026-09-03T14:24:00easy 27 0.00¢ openrouter:meta/muse-spark-1.3 100% view
2026-06-22T21:03:56stretch 123 17.78¢ openrouter:openai/gpt-5.5 100% view
2026-06-22T21:00:11stretch 123 24.38¢ openrouter:openai/gpt-5.5 100% view
2026-06-22T20:57:26stretch 123 17.50¢ openrouter:openai/gpt-5.5 100% view
2026-06-22T20:54:56hard 123 20.23¢ openrouter:openai/gpt-5.5 100% view
2026-06-22T20:51:41hard 123 16.49¢ openrouter:openai/gpt-5.5 100% view
2026-06-22T20:49:26hard 123 10.83¢ openrouter:meta-llama/llama-4-maverick 100% view
2026-06-22T20:47:26medium 123 12.97¢ openrouter:openai/gpt-5.5 100% view
2026-06-22T20:39:00medium 123 13.88¢ openrouter:openai/gpt-5.5 100% view
2026-06-22T20:35:59medium 123 10.30¢ openrouter:openai/gpt-5.5 100% view
2026-06-22T20:34:44easy 123 9.37¢ openrouter:meta-llama/llama-4-maverick 100% view
2026-06-22T20:31:58easy 123 9.86¢ openrouter:meta-llama/llama-4-maverick 100% view
2026-06-22T20:29:58easy 123 8.09¢ openrouter:meta-llama/llama-4-maverick 100% view
2026-06-22T20:28:53easy 13 0.81¢ openrouter:meta-llama/llama-4-maverick 100% view
2026-05-31T14:15:38stretch 1216 27.19¢ openrouter:deepseek/deepseek-v4-pro 100% view
2026-05-31T14:08:38hard 1216 33.88¢ anthropic:claude-haiku-4-5-20251001 100% view
2026-05-31T14:03:53medium 1216 21.31¢ anthropic:claude-haiku-4-5-20251001 100% view
2026-05-31T14:00:38easy 1216 14.13¢ openrouter:openai/gpt-5.4-mini 100% view
2026-05-31T13:51:38stretch 1216 50.24¢ openrouter:openai/gpt-5.4-mini 100% view
2026-05-31T13:36:37hard 1216 34.20¢ openrouter:deepseek/deepseek-v4-pro 100% view
2026-05-31T13:32:07medium 1216 19.95¢ openrouter:openai/gpt-5.4-mini 100% view
2026-05-31T13:28:37easy 1216 25.92¢ openrouter:bytedance-seed/seed-2.0-lite 100% view
2026-05-31T13:26:32easy 1214 14.37¢ openrouter:meta-llama/llama-4-maverick 100% view
2026-05-31T13:17:32stretch 1214 31.73¢ openrouter:deepseek/deepseek-v4-pro 100% view
2026-05-31T13:12:17hard 1214 20.05¢ openrouter:meta-llama/llama-4-maverick 100% view
2026-05-31T13:06:47medium 1214 33.61¢ openrouter:deepseek/deepseek-v4-pro 100% view
2026-05-31T13:02:31easy 1214 10.20¢ anthropic:claude-haiku-4-5-20251001 100% view
2026-05-31T12:51:01stretch 1214 30.69¢ openrouter:deepseek/deepseek-v4-pro 100% view
2026-05-31T12:35:46hard 1214 21.45¢ openrouter:x-ai/grok-4.3 100% view
2026-05-31T12:31:16medium 1214 16.92¢ openrouter:openai/gpt-5.4-mini 100% view
2026-05-31T12:26:45easy 1214 11.17¢ anthropic:claude-haiku-4-5-20251001 100% view
2026-05-31T12:14:15stretch 1214 41.69¢ openrouter:deepseek/deepseek-v4-pro 100% view
2026-05-31T12:05:30hard 1214 29.98¢ openrouter:qwen/qwen3.7-max 100% view
2026-05-31T12:00:59medium 1214 12.11¢ anthropic:claude-haiku-4-5-20251001 100% view
2026-05-31T11:57:59easy 1214 9.40¢ anthropic:claude-haiku-4-5-20251001 100% view
2026-05-31T11:51:29stretch 1214 31.51¢ openrouter:deepseek/deepseek-v4-pro 100% view
2026-05-31T11:45:14hard 1214 30.54¢ anthropic:claude-haiku-4-5-20251001 100% view
2026-05-31T11:41:14medium 1214 15.88¢ anthropic:claude-haiku-4-5-20251001 100% view
2026-05-31T11:37:14easy 1214 12.46¢ openrouter:bytedance-seed/seed-2.0-lite 100% view
2026-05-31T11:30:29stretch 1214 27.88¢ openrouter:deepseek/deepseek-v4-pro 100% view
2026-05-31T11:23:28hard 1214 22.47¢ openrouter:deepseek/deepseek-v4-pro 100% view
2026-05-31T11:06:55medium 1214 30.45¢ openrouter:z-ai/glm-5.1 100% view
2026-05-31T10:50:54easy 1214 11.92¢ openrouter:openai/gpt-5.4-mini 100% view
2026-05-31T09:28:15easy 1014 10.30¢ anthropic:claude-haiku-4-5-20251001 100% view
2026-05-31T09:21:31medium 1014 19.13¢ anthropic:claude-haiku-4-5-20251001 100% view
2026-05-30T22:20:35hard 1014 9.25¢ anthropic:claude-haiku-4-5-20251001 100% view
2026-05-30T22:16:21stretch 1014 16.63¢ openrouter:openai/gpt-5.4-nano 100% view
2026-05-30T22:12:39easy 1018 24.53¢ anthropic:claude-haiku-4-5-20251001 100% view
2026-05-30T22:06:33hard 1018 45.27¢ anthropic:claude-opus-4-8 100% view
2026-05-30T21:47:52hard 1020 19.69¢ anthropic:claude-haiku-4-5-20251001 100% view
2026-05-30T17:31:46stretch 1017 21.44¢ openrouter:openai/gpt-5.4-nano 100% view
2026-05-30T17:08:35stretch 1020 129.31¢ anthropic:claude-sonnet-4-6 100% view
2026-05-30T16:48:15hard 1015 62.26¢ anthropic:claude-haiku-4-5-20251001 100% view
2026-05-30T16:33:43stretch 517 63.63¢ anthropic:claude-sonnet-4-6 100% view