opensandwich.ai
Previous photoGrilled CheeseNext photoKitten in Bread
Grilled cheese sandwich with pineapple
GCPPeople mostly said yes
Benchmark image 06

Grilled Cheese Pineapple

Grilled pineapple, ham & cheese "Sandwich"

Ham, cheese, and pineapple are trapped between toasted bread in a move that feels both culinarily legal and socially destabilizing. The sandwich question is easy; the real benchmark is whether your priors can survive the pineapple.

Under development: this benchmark and its published results are provisional, not final.

Human
91.7% yes8.3% no
Model average
99.5% yes0.5% no
At a glance

How this photo split the room

Human distribution
91.7% yes, 8.3% no over 653 explicit votes.
Model average distribution
99.5% yes, 0.5% no across the current model set.
Closest current model
94.0% yes.

nvidia/nemotron-nano-12b-v2-vl

Least aligned model
12.7 point gap.

meta-llama/llama-3.2-11b-vision-instruct

Legacy GPT-4o baseline
100.0% yes with a 8.3 point gap against humans.
Biggest model gap
12.7 percentage points on this image.
Current classification
People mostly said yes
Benchmark context
Current classification
People mostly said yes
Models compared
67 current runs
Biggest model gap
12.7 percentage points on this image.
Closest model output
94.0% yes.
Model spread

How Models Align with Human Responses

This compares each model against human responses to show how closely it aligns with people.Human rate marker

GPT / OpenAIopenai/o1

0.0% no100.0% yes

Human gap8.3%

Rank #2

GPT / OpenAIopenai/o3

0.0% no100.0% yes

Human gap8.3%

Rank #57

Selected human comments

  • No, it is a photo of a sandwich.
  • WTF is this?? Pineapple slices are weird.
  • Who the fuck puts pineapple on a sandwich

nvidia/nemotron-nano-12b-v2-vl comments

  • Bread with ham, cheese, and pineapple between slices meets the definition of a sandwich.
  • Bread with fillings (ham, pineapple, cheese, lettuce) fits the sandwich definition.

meta-llama/llama-3.2-11b-vision-instruct comments

  • The key characteristics of a sandwich are: 1) Two slices of bread with fillings in between. 2) The fillings are traditionally savory. 3) The fillings are not liquidy.
  • This appears to be a grilled cheese with pineapple and ham. While it contains two slices of bread with a filling, it also contains a fruit, which is not typically found in a sandwich. Additionally, the use of a single piece of fruit as a filling, rather than a spread or sauce, is not consistent with the traditional definition of a sandwich. Therefore, I do not consider this to be a sandwich.
Vote card

Generated summary for this photo

Vote card for Grilled Cheese Pineapple
Is Grilled Cheese Pineapple a Sandwich? Human vs AI Results | opensandwich.ai