qwen/qwen3-vl-30b-a3b-thinking Sandwich Benchmark Breakdown

Photo-by-photo

Model Results

Breaking down how close the model answered each question, compared to humans.

Photo 01Bacon Lettuce Tomato

qwen/qwen3-vl-30b-a3b-thinking

100.0% yes0.0% no

Gap3.7%

Model readLeans yes

Photo 02Dodge Van

qwen/qwen3-vl-30b-a3b-thinking

0.0% yes100.0% no

Gap7.0%

Model readLeans no

Photo 03Sub Sandwich

qwen/qwen3-vl-30b-a3b-thinking

100.0% yes0.0% no

Gap5.5%

Model readLeans yes

Photo 04Sandwich Costume

qwen/qwen3-vl-30b-a3b-thinking

0.0% yes100.0% no

Gap40.9%

Model readLeans no

Photo 05Grilled Cheese

qwen/qwen3-vl-30b-a3b-thinking

100.0% yes0.0% no

Gap4.4%

Model readLeans yes

Photo 06Grilled Cheese Pineapple

qwen/qwen3-vl-30b-a3b-thinking

100.0% yes0.0% no

Gap8.3%

Model readLeans yes

Photo 07Kitten in Bread

qwen/qwen3-vl-30b-a3b-thinking

0.0% yes100.0% no

Gap54.2%

Model readLeans no

Photo 08Hamburger

qwen/qwen3-vl-30b-a3b-thinking

100.0% yes0.0% no

Gap27.0%

Model readLeans yes

Photo 09Hashbrown Sandwich

qwen/qwen3-vl-30b-a3b-thinking

22.0% yes78.0% no

Gap37.4%

Model readLeans no

Photo 10Hot Dog

qwen/qwen3-vl-30b-a3b-thinking

9.0% yes91.0% no

Gap30.8%

Model readLeans no

Photo 11Pickle Sandwich

qwen/qwen3-vl-30b-a3b-thinking

3.0% yes97.0% no

Gap62.6%

Model readLeans no

Photo 12Avocado Tea

qwen/qwen3-vl-30b-a3b-thinking

100.0% yes0.0% no

Gap7.2%

Model readLeans yes

Photo 13Panini

qwen/qwen3-vl-30b-a3b-thinking

100.0% yes0.0% no

Gap7.6%

Model readLeans yes

Photo 14Cookie PB

qwen/qwen3-vl-30b-a3b-thinking

1.0% yes99.0% no

Gap50.5%

Model readLeans no

Photo 15Chicken Wrap

qwen/qwen3-vl-30b-a3b-thinking

3.0% yes97.0% no

Gap19.6%

Model readLeans no

Photo 16Waffle Ice Cream

qwen/qwen3-vl-30b-a3b-thinking

75.0% yes25.0% no

Gap8.7%

Model readLeans yes

Photo 17Sloppy Joe

qwen/qwen3-vl-30b-a3b-thinking

100.0% yes0.0% no

Gap20.6%

Model readLeans yes

Photo 18Cigarette Sandwich

qwen/qwen3-vl-30b-a3b-thinking

0.0% yes100.0% no

Gap29.8%

Model readLeans no

Photo 19KFC Double Down

qwen/qwen3-vl-30b-a3b-thinking

98.0% yes2.0% no

Gap42.3%

Model readLeans yes

Photo 20Bagel PB&J

qwen/qwen3-vl-30b-a3b-thinking

67.0% yes33.0% no

Gap20.4%

Model readLeans yes

Photo	Vote SplitHuman response	Gap	Read
Photo 01Bacon Lettuce Tomato	qwen/qwen3-vl-30b-a3b-thinking 100.0% yes0.0% no	3.7%absolute gap	Leans yesPeople mostly said yes
Photo 02Dodge Van	qwen/qwen3-vl-30b-a3b-thinking 0.0% yes100.0% no	7.0%absolute gap	Leans noPeople mostly said no
Photo 03Sub Sandwich	qwen/qwen3-vl-30b-a3b-thinking 100.0% yes0.0% no	5.5%absolute gap	Leans yesPeople mostly said yes
Photo 04Sandwich Costume	qwen/qwen3-vl-30b-a3b-thinking 0.0% yes100.0% no	40.9%absolute gap	Leans noHuman knife-edge
Photo 05Grilled Cheese	qwen/qwen3-vl-30b-a3b-thinking 100.0% yes0.0% no	4.4%absolute gap	Leans yesPeople mostly said yes
Photo 06Grilled Cheese Pineapple	qwen/qwen3-vl-30b-a3b-thinking 100.0% yes0.0% no	8.3%absolute gap	Leans yesPeople mostly said yes
Photo 07Kitten in Bread	qwen/qwen3-vl-30b-a3b-thinking 0.0% yes100.0% no	54.2%absolute gap	Leans noHuman knife-edge
Photo 08Hamburger	qwen/qwen3-vl-30b-a3b-thinking 100.0% yes0.0% no	27.0%absolute gap	Leans yesSplit concept
Photo 09Hashbrown Sandwich	qwen/qwen3-vl-30b-a3b-thinking 22.0% yes78.0% no	37.4%absolute gap	Leans noHuman knife-edge
Photo 10Hot Dog	qwen/qwen3-vl-30b-a3b-thinking 9.0% yes91.0% no	30.8%absolute gap	Leans noSplit concept
Photo 11Pickle Sandwich	qwen/qwen3-vl-30b-a3b-thinking 3.0% yes97.0% no	62.6%absolute gap	Leans noSplit concept
Photo 12Avocado Tea	qwen/qwen3-vl-30b-a3b-thinking 100.0% yes0.0% no	7.2%absolute gap	Leans yesPeople mostly said yes
Photo 13Panini	qwen/qwen3-vl-30b-a3b-thinking 100.0% yes0.0% no	7.6%absolute gap	Leans yesPeople mostly said yes
Photo 14Cookie PB	qwen/qwen3-vl-30b-a3b-thinking 1.0% yes99.0% no	50.5%absolute gap	Leans noHuman knife-edge
Photo 15Chicken Wrap	qwen/qwen3-vl-30b-a3b-thinking 3.0% yes97.0% no	19.6%absolute gap	Leans noSplit concept
Photo 16Waffle Ice Cream	qwen/qwen3-vl-30b-a3b-thinking 75.0% yes25.0% no	8.7%absolute gap	Leans yesSplit concept
Photo 17Sloppy Joe	qwen/qwen3-vl-30b-a3b-thinking 100.0% yes0.0% no	20.6%absolute gap	Leans yesSplit concept
Photo 18Cigarette Sandwich	qwen/qwen3-vl-30b-a3b-thinking 0.0% yes100.0% no	29.8%absolute gap	Leans noSplit concept
Photo 19KFC Double Down	qwen/qwen3-vl-30b-a3b-thinking 98.0% yes2.0% no	42.3%absolute gap	Leans yesHuman knife-edge
Photo 20Bagel PB&J	qwen/qwen3-vl-30b-a3b-thinking 67.0% yes33.0% no	20.4%absolute gap	Leans yesHuman knife-edge