baidu/ernie-4.5-vl-28b-a3b Sandwich Benchmark Breakdown

Photo-by-photo

Model Results

Breaking down how close the model answered each question, compared to humans.

Photo 01Bacon Lettuce Tomato

baidu/ernie-4.5-vl-28b-a3b

100.0% yes0.0% no

Gap3.7%

Model readLeans yes

Photo 02Dodge Van

baidu/ernie-4.5-vl-28b-a3b

0.0% yes100.0% no

Gap7.0%

Model readLeans no

Photo 03Sub Sandwich

baidu/ernie-4.5-vl-28b-a3b

100.0% yes0.0% no

Gap5.5%

Model readLeans yes

Photo 04Sandwich Costume

baidu/ernie-4.5-vl-28b-a3b

0.0% yes100.0% no

Gap40.9%

Model readLeans no

Photo 05Grilled Cheese

baidu/ernie-4.5-vl-28b-a3b

100.0% yes0.0% no

Gap4.4%

Model readLeans yes

Photo 06Grilled Cheese Pineapple

baidu/ernie-4.5-vl-28b-a3b

100.0% yes0.0% no

Gap8.3%

Model readLeans yes

Photo 07Kitten in Bread

baidu/ernie-4.5-vl-28b-a3b

1.0% yes99.0% no

Gap53.2%

Model readLeans no

Photo 08Hamburger

baidu/ernie-4.5-vl-28b-a3b

0.0% yes100.0% no

Gap73.0%

Model readLeans no

Photo 09Hashbrown Sandwich

baidu/ernie-4.5-vl-28b-a3b

100.0% yes0.0% no

Gap40.6%

Model readLeans yes

Photo 10Hot Dog

baidu/ernie-4.5-vl-28b-a3b

0.0% yes100.0% no

Gap39.8%

Model readLeans no

Photo 11Pickle Sandwich

baidu/ernie-4.5-vl-28b-a3b

0.0% yes100.0% no

Gap65.6%

Model readLeans no

Photo 12Avocado Tea

baidu/ernie-4.5-vl-28b-a3b

100.0% yes0.0% no

Gap7.2%

Model readLeans yes

Photo 13Panini

baidu/ernie-4.5-vl-28b-a3b

100.0% yes0.0% no

Gap7.6%

Model readLeans yes

Photo 14Cookie PB

baidu/ernie-4.5-vl-28b-a3b

0.0% yes100.0% no

Gap51.5%

Model readLeans no

Photo 15Chicken Wrap

baidu/ernie-4.5-vl-28b-a3b

0.0% yes100.0% no

Gap22.6%

Model readLeans no

Photo 16Waffle Ice Cream

baidu/ernie-4.5-vl-28b-a3b

0.0% yes100.0% no

Gap66.3%

Model readLeans no

Photo 17Sloppy Joe

baidu/ernie-4.5-vl-28b-a3b

99.0% yes1.0% no

Gap19.6%

Model readLeans yes

Photo 18Cigarette Sandwich

baidu/ernie-4.5-vl-28b-a3b

0.0% yes100.0% no

Gap29.8%

Model readLeans no

Photo 19KFC Double Down

baidu/ernie-4.5-vl-28b-a3b

0.0% yes100.0% no

Gap55.7%

Model readLeans no

Photo 20Bagel PB&J

baidu/ernie-4.5-vl-28b-a3b

0.0% yes100.0% no

Gap46.6%

Model readLeans no

Photo	Vote SplitHuman response	Gap	Read
Photo 01Bacon Lettuce Tomato	baidu/ernie-4.5-vl-28b-a3b 100.0% yes0.0% no	3.7%absolute gap	Leans yesPeople mostly said yes
Photo 02Dodge Van	baidu/ernie-4.5-vl-28b-a3b 0.0% yes100.0% no	7.0%absolute gap	Leans noPeople mostly said no
Photo 03Sub Sandwich	baidu/ernie-4.5-vl-28b-a3b 100.0% yes0.0% no	5.5%absolute gap	Leans yesPeople mostly said yes
Photo 04Sandwich Costume	baidu/ernie-4.5-vl-28b-a3b 0.0% yes100.0% no	40.9%absolute gap	Leans noHuman knife-edge
Photo 05Grilled Cheese	baidu/ernie-4.5-vl-28b-a3b 100.0% yes0.0% no	4.4%absolute gap	Leans yesPeople mostly said yes
Photo 06Grilled Cheese Pineapple	baidu/ernie-4.5-vl-28b-a3b 100.0% yes0.0% no	8.3%absolute gap	Leans yesPeople mostly said yes
Photo 07Kitten in Bread	baidu/ernie-4.5-vl-28b-a3b 1.0% yes99.0% no	53.2%absolute gap	Leans noHuman knife-edge
Photo 08Hamburger	baidu/ernie-4.5-vl-28b-a3b 0.0% yes100.0% no	73.0%absolute gap	Leans noSplit concept
Photo 09Hashbrown Sandwich	baidu/ernie-4.5-vl-28b-a3b 100.0% yes0.0% no	40.6%absolute gap	Leans yesHuman knife-edge
Photo 10Hot Dog	baidu/ernie-4.5-vl-28b-a3b 0.0% yes100.0% no	39.8%absolute gap	Leans noSplit concept
Photo 11Pickle Sandwich	baidu/ernie-4.5-vl-28b-a3b 0.0% yes100.0% no	65.6%absolute gap	Leans noSplit concept
Photo 12Avocado Tea	baidu/ernie-4.5-vl-28b-a3b 100.0% yes0.0% no	7.2%absolute gap	Leans yesPeople mostly said yes
Photo 13Panini	baidu/ernie-4.5-vl-28b-a3b 100.0% yes0.0% no	7.6%absolute gap	Leans yesPeople mostly said yes
Photo 14Cookie PB	baidu/ernie-4.5-vl-28b-a3b 0.0% yes100.0% no	51.5%absolute gap	Leans noHuman knife-edge
Photo 15Chicken Wrap	baidu/ernie-4.5-vl-28b-a3b 0.0% yes100.0% no	22.6%absolute gap	Leans noSplit concept
Photo 16Waffle Ice Cream	baidu/ernie-4.5-vl-28b-a3b 0.0% yes100.0% no	66.3%absolute gap	Leans noSplit concept
Photo 17Sloppy Joe	baidu/ernie-4.5-vl-28b-a3b 99.0% yes1.0% no	19.6%absolute gap	Leans yesSplit concept
Photo 18Cigarette Sandwich	baidu/ernie-4.5-vl-28b-a3b 0.0% yes100.0% no	29.8%absolute gap	Leans noSplit concept
Photo 19KFC Double Down	baidu/ernie-4.5-vl-28b-a3b 0.0% yes100.0% no	55.7%absolute gap	Leans noHuman knife-edge
Photo 20Bagel PB&J	baidu/ernie-4.5-vl-28b-a3b 0.0% yes100.0% no	46.6%absolute gap	Leans noHuman knife-edge