Model breakdown
GPT / OpenAIopenai/gpt-5.1-codex
Profile
OpenAI: GPT-5.1-CodexOpenAI
Release
Not provided by OpenRouterAvailable on OpenRouter
Specs
Not provided by OpenRouter400,000 tokens
Capabilities
Text + ImageNot provided by OpenRouter
Training
Not provided by OpenRouterOpenAI
Rank#34
-838.6alignment score
73.4%crowd match
Mean gap26.6%
Human match73.4%
Best fitBacon Lettuce Tomato
Average vote68.3%
68.3%model yes
62.8%human yes
Workload2K evals
2Kevals
100iterations
1.5Mtokens
Photo-by-photo

Model Results

Breaking down how close the model answered each question, compared to humans.

Dodge Van
Photo 02Dodge Van
GPT / OpenAIopenai/gpt-5.1-codex
0.0% yes100.0% no
Gap7.0%
Model readLeans no
Sub Sandwich
Photo 03Sub Sandwich
GPT / OpenAIopenai/gpt-5.1-codex
100.0% yes0.0% no
Gap5.5%
Model readLeans yes
GPT / OpenAIopenai/gpt-5.1-codex
0.0% yes100.0% no
Gap40.9%
Model readLeans no
GPT / OpenAIopenai/gpt-5.1-codex
100.0% yes0.0% no
Gap4.4%
Model readLeans yes
GPT / OpenAIopenai/gpt-5.1-codex
0.0% yes100.0% no
Gap54.2%
Model readLeans no
Hamburger
Photo 08Hamburger
GPT / OpenAIopenai/gpt-5.1-codex
100.0% yes0.0% no
Gap27.0%
Model readLeans yes
GPT / OpenAIopenai/gpt-5.1-codex
100.0% yes0.0% no
Gap40.6%
Model readLeans yes
Hot Dog
Photo 10Hot Dog
GPT / OpenAIopenai/gpt-5.1-codex
35.0% yes65.0% no
Gap4.8%
Model readLeans no
GPT / OpenAIopenai/gpt-5.1-codex
15.0% yes85.0% no
Gap50.6%
Model readLeans no
Avocado Tea
Photo 12Avocado Tea
GPT / OpenAIopenai/gpt-5.1-codex
100.0% yes0.0% no
Gap7.2%
Model readLeans yes
Panini
Photo 13Panini
GPT / OpenAIopenai/gpt-5.1-codex
100.0% yes0.0% no
Gap7.6%
Model readLeans yes
Cookie PB
Photo 14Cookie PB
GPT / OpenAIopenai/gpt-5.1-codex
97.0% yes3.0% no
Gap45.5%
Model readLeans yes
Chicken Wrap
Photo 15Chicken Wrap
GPT / OpenAIopenai/gpt-5.1-codex
93.0% yes7.0% no
Gap70.4%
Model readLeans yes
GPT / OpenAIopenai/gpt-5.1-codex
100.0% yes0.0% no
Gap33.7%
Model readLeans yes
Sloppy Joe
Photo 17Sloppy Joe
GPT / OpenAIopenai/gpt-5.1-codex
100.0% yes0.0% no
Gap20.6%
Model readLeans yes
GPT / OpenAIopenai/gpt-5.1-codex
69.0% yes31.0% no
Gap39.2%
Model readLeans yes
GPT / OpenAIopenai/gpt-5.1-codex
3.0% yes97.0% no
Gap52.7%
Model readLeans no
Bagel PB&J
Photo 20Bagel PB&J
GPT / OpenAIopenai/gpt-5.1-codex
55.0% yes45.0% no
Gap8.4%
Model readLeans yes
PhotoVote SplitHuman responseGapRead
GPT / OpenAIopenai/gpt-5.1-codex
100.0% yes0.0% no
3.7%absolute gap
Leans yesPeople mostly said yes
Dodge Van
Photo 02Dodge Van
GPT / OpenAIopenai/gpt-5.1-codex
0.0% yes100.0% no
7.0%absolute gap
Leans noPeople mostly said no
Sub Sandwich
Photo 03Sub Sandwich
GPT / OpenAIopenai/gpt-5.1-codex
100.0% yes0.0% no
5.5%absolute gap
Leans yesPeople mostly said yes
GPT / OpenAIopenai/gpt-5.1-codex
0.0% yes100.0% no
40.9%absolute gap
Leans noHuman knife-edge
GPT / OpenAIopenai/gpt-5.1-codex
100.0% yes0.0% no
4.4%absolute gap
Leans yesPeople mostly said yes
GPT / OpenAIopenai/gpt-5.1-codex
100.0% yes0.0% no
8.3%absolute gap
Leans yesPeople mostly said yes
GPT / OpenAIopenai/gpt-5.1-codex
0.0% yes100.0% no
54.2%absolute gap
Leans noHuman knife-edge
Hamburger
Photo 08Hamburger
GPT / OpenAIopenai/gpt-5.1-codex
100.0% yes0.0% no
27.0%absolute gap
Leans yesSplit concept
GPT / OpenAIopenai/gpt-5.1-codex
100.0% yes0.0% no
40.6%absolute gap
Leans yesHuman knife-edge
Hot Dog
Photo 10Hot Dog
GPT / OpenAIopenai/gpt-5.1-codex
35.0% yes65.0% no
4.8%absolute gap
Leans noSplit concept
GPT / OpenAIopenai/gpt-5.1-codex
15.0% yes85.0% no
50.6%absolute gap
Leans noSplit concept
Avocado Tea
Photo 12Avocado Tea
GPT / OpenAIopenai/gpt-5.1-codex
100.0% yes0.0% no
7.2%absolute gap
Leans yesPeople mostly said yes
Panini
Photo 13Panini
GPT / OpenAIopenai/gpt-5.1-codex
100.0% yes0.0% no
7.6%absolute gap
Leans yesPeople mostly said yes
Cookie PB
Photo 14Cookie PB
GPT / OpenAIopenai/gpt-5.1-codex
97.0% yes3.0% no
45.5%absolute gap
Leans yesHuman knife-edge
Chicken Wrap
Photo 15Chicken Wrap
GPT / OpenAIopenai/gpt-5.1-codex
93.0% yes7.0% no
70.4%absolute gap
Leans yesSplit concept
GPT / OpenAIopenai/gpt-5.1-codex
100.0% yes0.0% no
33.7%absolute gap
Leans yesSplit concept
Sloppy Joe
Photo 17Sloppy Joe
GPT / OpenAIopenai/gpt-5.1-codex
100.0% yes0.0% no
20.6%absolute gap
Leans yesSplit concept
GPT / OpenAIopenai/gpt-5.1-codex
69.0% yes31.0% no
39.2%absolute gap
Leans yesSplit concept
GPT / OpenAIopenai/gpt-5.1-codex
3.0% yes97.0% no
52.7%absolute gap
Leans noHuman knife-edge
Bagel PB&J
Photo 20Bagel PB&J
GPT / OpenAIopenai/gpt-5.1-codex
55.0% yes45.0% no
8.4%absolute gap
Leans yesHuman knife-edge
openai/gpt-5.1-codex Sandwich Benchmark Breakdown | opensandwich.ai