opensandwich.ai
Next photoDodge Van
BLT
BLTPeople mostly said yes
Benchmark image 01

Bacon Lettuce Tomato

BLT "Sandwich"

A perfectly legible BLT sits on toasted bread, the kind of canonical positive example that makes even the worst eval look solved. If your model misses this one, it does not need fine-tuning; it needs adult supervision.

Under development: this benchmark and its published results are provisional, not final.

Human
96.3% yes3.7% no
Model average
99.8% yes0.2% no
At a glance

How this photo split the room

Human distribution
96.3% yes, 3.7% no over 656 explicit votes.
Model average distribution
99.8% yes, 0.2% no across the current model set.
Closest current model
98.0% yes.

allenai/molmo-2-8b

Least aligned model
6.3 point gap.

meta-llama/llama-3.2-11b-vision-instruct

Legacy GPT-4o baseline
100.0% yes with a 3.7 point gap against humans.
Biggest model gap
6.3 percentage points on this image.
Current classification
People mostly said yes
Benchmark context
Current classification
People mostly said yes
Models compared
67 current runs
Biggest model gap
6.3 percentage points on this image.
Closest model output
98.0% yes.
Model spread

How Models Align with Human Responses

This compares each model against human responses to show how closely it aligns with people.Human rate marker

GPT / OpenAIopenai/o1

0.0% no100.0% yes

Human gap3.7%

Rank #2

GPT / OpenAIopenai/o3

0.0% no100.0% yes

Human gap3.7%

Rank #57

Selected human comments

  • It is a photo of a sandwich.
  • personally, i wouldn't eat the tomatoes, but other people like them
  • Needs more bacon!

allenai/molmo-2-8b comments

  • This image clearly shows a classic BLT sandwich on a plate. It meets the typical criteria of a sandwich: two slices of bread enclosing fillings (bacon, lettuce, tomato). The composition and presentation are consistent with conventional sandwich definitions.
  • This appears to be a classic BLT sandwich (bacon, lettuce, and tomato) on toasted bread. It fits the typical definition of a sandwich consisting of two slices of bread with fillings in between.

meta-llama/llama-3.2-11b-vision-instruct comments

  • The image shows a typical sandwich with two slices of bread and various fillings in between, including lettuce, tomato, and possibly bacon or ham, along with a yellow spread.
  • A sandwich is a food item consisting of two or more slices of bread, often with fillings such as meats, cheeses, vegetables, and condiments. A sandwich can be made with any type of bread, and can be cut into halves or quarters. Examples of sandwiches include BLTs, club sandwiches, and paninis.
Vote card

Generated summary for this photo

Vote card for Bacon Lettuce Tomato
Is Bacon Lettuce Tomato a Sandwich? Human vs AI Results | opensandwich.ai