opensandwich.ai
Model breakdown
GPT / OpenAIopenai/gpt-4o-2024-11-20
Profile
GPT-4o 2024-11-20OpenAI
Release
2024-11-20Available on OpenRouter
Specs
Not publicly disclosed128,000 tokens
Capabilities
Text + Image + FileSnapshot of GPT-4o for stable multimodal production use
Training
October 01, 2023OpenAI
Links
Lab pageModel page

Under development: this benchmark and its published results are provisional, not final.

Back To ModelsOpen Best FitOpen Biggest Miss
Rank#60
-1174.4alignment score
74.0%crowd match
Mean gap26.0%
Human match74.0%
Best fitBacon Lettuce Tomato
Average vote61.4%
61.4%model yes
62.8%human yes
Workload3.1K evals
3.1Kevals
154iterations
2.6Mtokens
Best fit3.7%
Bacon Lettuce Tomato

Bacon Lettuce Tomato

100.0%model yes
96.3%human yes
Biggest miss65.6%
Pickle Sandwich

Pickle Sandwich

0.0%model yes
65.6%human yes
Photo-by-photo

Model Results

Breaking down how close the model answered each question, compared to humans.

Dodge Van
Photo 02Dodge Van
GPT / OpenAIopenai/gpt-4o-2024-11-20
0.0% yes100.0% no
Gap7.0%
Model readLeans no
Sub Sandwich
Photo 03Sub Sandwich
GPT / OpenAIopenai/gpt-4o-2024-11-20
100.0% yes0.0% no
Gap5.5%
Model readLeans yes
Sandwich Costume
Photo 04Sandwich Costume
GPT / OpenAIopenai/gpt-4o-2024-11-20
0.0% yes100.0% no
Gap40.9%
Model readLeans no
Grilled Cheese
Photo 05Grilled Cheese
GPT / OpenAIopenai/gpt-4o-2024-11-20
100.0% yes0.0% no
Gap4.4%
Model readLeans yes
Kitten in Bread
Photo 07Kitten in Bread
GPT / OpenAIopenai/gpt-4o-2024-11-20
0.0% yes100.0% no
Gap54.2%
Model readLeans no
Hamburger
Photo 08Hamburger
GPT / OpenAIopenai/gpt-4o-2024-11-20
100.0% yes0.0% no
Gap27.0%
Model readLeans yes
Hashbrown Sandwich
Photo 09Hashbrown Sandwich
GPT / OpenAIopenai/gpt-4o-2024-11-20
89.6% yes10.4% no
Gap30.2%
Model readLeans yes
Hot Dog
Photo 10Hot Dog
GPT / OpenAIopenai/gpt-4o-2024-11-20
100.0% yes0.0% no
Gap60.2%
Model readLeans yes
Pickle Sandwich
Photo 11Pickle Sandwich
GPT / OpenAIopenai/gpt-4o-2024-11-20
0.0% yes100.0% no
Gap65.6%
Model readLeans no
Avocado Tea
Photo 12Avocado Tea
GPT / OpenAIopenai/gpt-4o-2024-11-20
100.0% yes0.0% no
Gap7.2%
Model readLeans yes
Panini
Photo 13Panini
GPT / OpenAIopenai/gpt-4o-2024-11-20
100.0% yes0.0% no
Gap7.6%
Model readLeans yes
Cookie PB
Photo 14Cookie PB
GPT / OpenAIopenai/gpt-4o-2024-11-20
14.3% yes85.7% no
Gap37.2%
Model readLeans no
Chicken Wrap
Photo 15Chicken Wrap
GPT / OpenAIopenai/gpt-4o-2024-11-20
0.0% yes100.0% no
Gap22.6%
Model readLeans no
Waffle Ice Cream
Photo 16Waffle Ice Cream
GPT / OpenAIopenai/gpt-4o-2024-11-20
98.0% yes1.9% no
Gap31.8%
Model readLeans yes
Sloppy Joe
Photo 17Sloppy Joe
GPT / OpenAIopenai/gpt-4o-2024-11-20
100.0% yes0.0% no
Gap20.6%
Model readLeans yes
Cigarette Sandwich
Photo 18Cigarette Sandwich
GPT / OpenAIopenai/gpt-4o-2024-11-20
14.3% yes85.7% no
Gap15.5%
Model readLeans no
KFC Double Down
Photo 19KFC Double Down
GPT / OpenAIopenai/gpt-4o-2024-11-20
25.3% yes74.7% no
Gap30.4%
Model readLeans no
Bagel PB&J
Photo 20Bagel PB&J
GPT / OpenAIopenai/gpt-4o-2024-11-20
86.4% yes13.6% no
Gap39.7%
Model readLeans yes
PhotoVote SplitHuman responseGapRead
Bacon Lettuce Tomato
Photo 01Bacon Lettuce Tomato
GPT / OpenAIopenai/gpt-4o-2024-11-20
100.0% yes0.0% no
3.7%absolute gap
Leans yesPeople mostly said yes
Dodge Van
Photo 02Dodge Van
GPT / OpenAIopenai/gpt-4o-2024-11-20
0.0% yes100.0% no
7.0%absolute gap
Leans noPeople mostly said no
Sub Sandwich
Photo 03Sub Sandwich
GPT / OpenAIopenai/gpt-4o-2024-11-20
100.0% yes0.0% no
5.5%absolute gap
Leans yesPeople mostly said yes
Sandwich Costume
Photo 04Sandwich Costume
GPT / OpenAIopenai/gpt-4o-2024-11-20
0.0% yes100.0% no
40.9%absolute gap
Leans noHuman knife-edge
Grilled Cheese
Photo 05Grilled Cheese
GPT / OpenAIopenai/gpt-4o-2024-11-20
100.0% yes0.0% no
4.4%absolute gap
Leans yesPeople mostly said yes
Grilled Cheese Pineapple
Photo 06Grilled Cheese Pineapple
GPT / OpenAIopenai/gpt-4o-2024-11-20
100.0% yes0.0% no
8.3%absolute gap
Leans yesPeople mostly said yes
Kitten in Bread
Photo 07Kitten in Bread
GPT / OpenAIopenai/gpt-4o-2024-11-20
0.0% yes100.0% no
54.2%absolute gap
Leans noHuman knife-edge
Hamburger
Photo 08Hamburger
GPT / OpenAIopenai/gpt-4o-2024-11-20
100.0% yes0.0% no
27.0%absolute gap
Leans yesSplit concept
Hashbrown Sandwich
Photo 09Hashbrown Sandwich
GPT / OpenAIopenai/gpt-4o-2024-11-20
89.6% yes10.4% no
30.2%absolute gap
Leans yesHuman knife-edge
Hot Dog
Photo 10Hot Dog
GPT / OpenAIopenai/gpt-4o-2024-11-20
100.0% yes0.0% no
60.2%absolute gap
Leans yesSplit concept
Pickle Sandwich
Photo 11Pickle Sandwich
GPT / OpenAIopenai/gpt-4o-2024-11-20
0.0% yes100.0% no
65.6%absolute gap
Leans noSplit concept
Avocado Tea
Photo 12Avocado Tea
GPT / OpenAIopenai/gpt-4o-2024-11-20
100.0% yes0.0% no
7.2%absolute gap
Leans yesPeople mostly said yes
Panini
Photo 13Panini
GPT / OpenAIopenai/gpt-4o-2024-11-20
100.0% yes0.0% no
7.6%absolute gap
Leans yesPeople mostly said yes
Cookie PB
Photo 14Cookie PB
GPT / OpenAIopenai/gpt-4o-2024-11-20
14.3% yes85.7% no
37.2%absolute gap
Leans noHuman knife-edge
Chicken Wrap
Photo 15Chicken Wrap
GPT / OpenAIopenai/gpt-4o-2024-11-20
0.0% yes100.0% no
22.6%absolute gap
Leans noSplit concept
Waffle Ice Cream
Photo 16Waffle Ice Cream
GPT / OpenAIopenai/gpt-4o-2024-11-20
98.0% yes1.9% no
31.8%absolute gap
Leans yesSplit concept
Sloppy Joe
Photo 17Sloppy Joe
GPT / OpenAIopenai/gpt-4o-2024-11-20
100.0% yes0.0% no
20.6%absolute gap
Leans yesSplit concept
Cigarette Sandwich
Photo 18Cigarette Sandwich
GPT / OpenAIopenai/gpt-4o-2024-11-20
14.3% yes85.7% no
15.5%absolute gap
Leans noSplit concept
KFC Double Down
Photo 19KFC Double Down
GPT / OpenAIopenai/gpt-4o-2024-11-20
25.3% yes74.7% no
30.4%absolute gap
Leans noHuman knife-edge
Bagel PB&J
Photo 20Bagel PB&J
GPT / OpenAIopenai/gpt-4o-2024-11-20
86.4% yes13.6% no
39.7%absolute gap
Leans yesHuman knife-edge
openai/gpt-4o-2024-11-20 Sandwich Benchmark Breakdown | opensandwich.ai