Rank#31
-816.7alignment score
74.2%crowd match
Model breakdown
qwen/qwen3.5-397b-a17b
qwen/qwen3.5-397b-a17bMean gap25.8%
Human match74.2%
Best fitBacon Lettuce Tomato
Average vote75.5%
75.5%model yes
62.8%human yes
Workload2K evals
2Kevals
100iterations
3Mtokens
Photo-by-photo
Model Results
Breaking down how close the model answered each question, compared to humans.
Photo 01Bacon Lettuce Tomato
qwen/qwen3.5-397b-a17b100.0% yes0.0% no
Gap3.7%
Model readLeans yes
Photo 02Dodge Van
qwen/qwen3.5-397b-a17b0.0% yes100.0% no
Gap7.0%
Model readLeans no
Photo 03Sub Sandwich
qwen/qwen3.5-397b-a17b100.0% yes0.0% no
Gap5.5%
Model readLeans yes
Photo 04Sandwich Costume
qwen/qwen3.5-397b-a17b4.0% yes96.0% no
Gap36.9%
Model readLeans no
Photo 05Grilled Cheese
qwen/qwen3.5-397b-a17b100.0% yes0.0% no
Gap4.4%
Model readLeans yes
Photo 06Grilled Cheese Pineapple
qwen/qwen3.5-397b-a17b100.0% yes0.0% no
Gap8.3%
Model readLeans yes
Photo 07Kitten in Bread
qwen/qwen3.5-397b-a17b5.0% yes95.0% no
Gap49.2%
Model readLeans no
Photo 08Hamburger
qwen/qwen3.5-397b-a17b100.0% yes0.0% no
Gap27.0%
Model readLeans yes
Photo 09Hashbrown Sandwich
qwen/qwen3.5-397b-a17b100.0% yes0.0% no
Gap40.6%
Model readLeans yes
Photo 10Hot Dog
qwen/qwen3.5-397b-a17b99.0% yes1.0% no
Gap59.2%
Model readLeans yes
Photo 11Pickle Sandwich
qwen/qwen3.5-397b-a17b80.0% yes20.0% no
Gap14.4%
Model readLeans yes
Photo 12Avocado Tea
qwen/qwen3.5-397b-a17b100.0% yes0.0% no
Gap7.2%
Model readLeans yes
Photo 13Panini
qwen/qwen3.5-397b-a17b100.0% yes0.0% no
Gap7.6%
Model readLeans yes
Photo 14Cookie PB
qwen/qwen3.5-397b-a17b40.0% yes60.0% no
Gap11.5%
Model readLeans no
Photo 15Chicken Wrap
qwen/qwen3.5-397b-a17b99.0% yes1.0% no
Gap76.4%
Model readLeans yes
Photo 16Waffle Ice Cream
qwen/qwen3.5-397b-a17b99.0% yes1.0% no
Gap32.7%
Model readLeans yes
Photo 17Sloppy Joe
qwen/qwen3.5-397b-a17b100.0% yes0.0% no
Gap20.6%
Model readLeans yes
Photo 18Cigarette Sandwich
qwen/qwen3.5-397b-a17b4.0% yes96.0% no
Gap25.8%
Model readLeans no
Photo 19KFC Double Down
qwen/qwen3.5-397b-a17b81.0% yes19.0% no
Gap25.3%
Model readLeans yes
Photo 20Bagel PB&J
qwen/qwen3.5-397b-a17b100.0% yes0.0% no
Gap53.4%
Model readLeans yes
| Photo | Vote SplitHuman response | Gap | Read |
|---|---|---|---|
Photo 01Bacon Lettuce Tomato | qwen/qwen3.5-397b-a17b 100.0% yes0.0% no | 3.7%absolute gap | Leans yesPeople mostly said yes |
Photo 02Dodge Van | qwen/qwen3.5-397b-a17b 0.0% yes100.0% no | 7.0%absolute gap | Leans noPeople mostly said no |
Photo 03Sub Sandwich | qwen/qwen3.5-397b-a17b 100.0% yes0.0% no | 5.5%absolute gap | Leans yesPeople mostly said yes |
Photo 04Sandwich Costume | qwen/qwen3.5-397b-a17b 4.0% yes96.0% no | 36.9%absolute gap | Leans noHuman knife-edge |
Photo 05Grilled Cheese | qwen/qwen3.5-397b-a17b 100.0% yes0.0% no | 4.4%absolute gap | Leans yesPeople mostly said yes |
Photo 06Grilled Cheese Pineapple | qwen/qwen3.5-397b-a17b 100.0% yes0.0% no | 8.3%absolute gap | Leans yesPeople mostly said yes |
Photo 07Kitten in Bread | qwen/qwen3.5-397b-a17b 5.0% yes95.0% no | 49.2%absolute gap | Leans noHuman knife-edge |
Photo 08Hamburger | qwen/qwen3.5-397b-a17b 100.0% yes0.0% no | 27.0%absolute gap | Leans yesSplit concept |
Photo 09Hashbrown Sandwich | qwen/qwen3.5-397b-a17b 100.0% yes0.0% no | 40.6%absolute gap | Leans yesHuman knife-edge |
Photo 10Hot Dog | qwen/qwen3.5-397b-a17b 99.0% yes1.0% no | 59.2%absolute gap | Leans yesSplit concept |
Photo 11Pickle Sandwich | qwen/qwen3.5-397b-a17b 80.0% yes20.0% no | 14.4%absolute gap | Leans yesSplit concept |
Photo 12Avocado Tea | qwen/qwen3.5-397b-a17b 100.0% yes0.0% no | 7.2%absolute gap | Leans yesPeople mostly said yes |
Photo 13Panini | qwen/qwen3.5-397b-a17b 100.0% yes0.0% no | 7.6%absolute gap | Leans yesPeople mostly said yes |
Photo 14Cookie PB | qwen/qwen3.5-397b-a17b 40.0% yes60.0% no | 11.5%absolute gap | Leans noHuman knife-edge |
Photo 15Chicken Wrap | qwen/qwen3.5-397b-a17b 99.0% yes1.0% no | 76.4%absolute gap | Leans yesSplit concept |
Photo 16Waffle Ice Cream | qwen/qwen3.5-397b-a17b 99.0% yes1.0% no | 32.7%absolute gap | Leans yesSplit concept |
Photo 17Sloppy Joe | qwen/qwen3.5-397b-a17b 100.0% yes0.0% no | 20.6%absolute gap | Leans yesSplit concept |
Photo 18Cigarette Sandwich | qwen/qwen3.5-397b-a17b 4.0% yes96.0% no | 25.8%absolute gap | Leans noSplit concept |
Photo 19KFC Double Down | qwen/qwen3.5-397b-a17b 81.0% yes19.0% no | 25.3%absolute gap | Leans yesHuman knife-edge |
Photo 20Bagel PB&J | qwen/qwen3.5-397b-a17b 100.0% yes0.0% no | 53.4%absolute gap | Leans yesHuman knife-edge |