Rank#66
-1468.6alignment score
71.6%crowd match
Model breakdown
amazon/nova-pro-v1
amazon/nova-pro-v1Mean gap28.4%
Human match71.6%
Best fitPickle Sandwich
Average vote63.6%
63.6%model yes
62.8%human yes
Workload3.1K evals
3.1Kevals
154iterations
5.3Mtokens
Photo-by-photo
Model Results
Breaking down how close the model answered each question, compared to humans.
Photo 01Bacon Lettuce Tomato
amazon/nova-pro-v1100.0% yes0.0% no
Gap3.7%
Model readLeans yes
Photo 02Dodge Van
amazon/nova-pro-v10.0% yes100.0% no
Gap7.0%
Model readLeans no
Photo 03Sub Sandwich
amazon/nova-pro-v1100.0% yes0.0% no
Gap5.5%
Model readLeans yes
Photo 04Sandwich Costume
amazon/nova-pro-v10.0% yes100.0% no
Gap40.9%
Model readLeans no
Photo 05Grilled Cheese
amazon/nova-pro-v1100.0% yes0.0% no
Gap4.4%
Model readLeans yes
Photo 06Grilled Cheese Pineapple
amazon/nova-pro-v1100.0% yes0.0% no
Gap8.3%
Model readLeans yes
Photo 07Kitten in Bread
amazon/nova-pro-v13.9% yes96.1% no
Gap50.3%
Model readLeans no
Photo 08Hamburger
amazon/nova-pro-v1100.0% yes0.0% no
Gap27.0%
Model readLeans yes
Photo 09Hashbrown Sandwich
amazon/nova-pro-v194.2% yes5.8% no
Gap34.8%
Model readLeans yes
Photo 10Hot Dog
amazon/nova-pro-v19.7% yes90.3% no
Gap30.1%
Model readLeans no
Photo 11Pickle Sandwich
amazon/nova-pro-v163.6% yes36.4% no
Gap1.9%
Model readLeans yes
Photo 12Avocado Tea
amazon/nova-pro-v1100.0% yes0.0% no
Gap7.2%
Model readLeans yes
Photo 13Panini
amazon/nova-pro-v1100.0% yes0.0% no
Gap7.6%
Model readLeans yes
Photo 14Cookie PB
amazon/nova-pro-v11.9% yes98.0% no
Gap49.6%
Model readLeans no
Photo 15Chicken Wrap
amazon/nova-pro-v198.0% yes1.9% no
Gap75.5%
Model readLeans yes
Photo 16Waffle Ice Cream
amazon/nova-pro-v10.0% yes100.0% no
Gap66.3%
Model readLeans no
Photo 17Sloppy Joe
amazon/nova-pro-v1100.0% yes0.0% no
Gap20.6%
Model readLeans yes
Photo 18Cigarette Sandwich
amazon/nova-pro-v10.0% yes100.0% no
Gap29.8%
Model readLeans no
Photo 19KFC Double Down
amazon/nova-pro-v1100.0% yes0.0% no
Gap44.3%
Model readLeans yes
Photo 20Bagel PB&J
amazon/nova-pro-v1100.0% yes0.0% no
Gap53.4%
Model readLeans yes
| Photo | Vote SplitHuman response | Gap | Read |
|---|---|---|---|
Photo 01Bacon Lettuce Tomato | amazon/nova-pro-v1 100.0% yes0.0% no | 3.7%absolute gap | Leans yesPeople mostly said yes |
Photo 02Dodge Van | amazon/nova-pro-v1 0.0% yes100.0% no | 7.0%absolute gap | Leans noPeople mostly said no |
Photo 03Sub Sandwich | amazon/nova-pro-v1 100.0% yes0.0% no | 5.5%absolute gap | Leans yesPeople mostly said yes |
Photo 04Sandwich Costume | amazon/nova-pro-v1 0.0% yes100.0% no | 40.9%absolute gap | Leans noHuman knife-edge |
Photo 05Grilled Cheese | amazon/nova-pro-v1 100.0% yes0.0% no | 4.4%absolute gap | Leans yesPeople mostly said yes |
Photo 06Grilled Cheese Pineapple | amazon/nova-pro-v1 100.0% yes0.0% no | 8.3%absolute gap | Leans yesPeople mostly said yes |
Photo 07Kitten in Bread | amazon/nova-pro-v1 3.9% yes96.1% no | 50.3%absolute gap | Leans noHuman knife-edge |
Photo 08Hamburger | amazon/nova-pro-v1 100.0% yes0.0% no | 27.0%absolute gap | Leans yesSplit concept |
Photo 09Hashbrown Sandwich | amazon/nova-pro-v1 94.2% yes5.8% no | 34.8%absolute gap | Leans yesHuman knife-edge |
Photo 10Hot Dog | amazon/nova-pro-v1 9.7% yes90.3% no | 30.1%absolute gap | Leans noSplit concept |
Photo 11Pickle Sandwich | amazon/nova-pro-v1 63.6% yes36.4% no | 1.9%absolute gap | Leans yesSplit concept |
Photo 12Avocado Tea | amazon/nova-pro-v1 100.0% yes0.0% no | 7.2%absolute gap | Leans yesPeople mostly said yes |
Photo 13Panini | amazon/nova-pro-v1 100.0% yes0.0% no | 7.6%absolute gap | Leans yesPeople mostly said yes |
Photo 14Cookie PB | amazon/nova-pro-v1 1.9% yes98.0% no | 49.6%absolute gap | Leans noHuman knife-edge |
Photo 15Chicken Wrap | amazon/nova-pro-v1 98.0% yes1.9% no | 75.5%absolute gap | Leans yesSplit concept |
Photo 16Waffle Ice Cream | amazon/nova-pro-v1 0.0% yes100.0% no | 66.3%absolute gap | Leans noSplit concept |
Photo 17Sloppy Joe | amazon/nova-pro-v1 100.0% yes0.0% no | 20.6%absolute gap | Leans yesSplit concept |
Photo 18Cigarette Sandwich | amazon/nova-pro-v1 0.0% yes100.0% no | 29.8%absolute gap | Leans noSplit concept |
Photo 19KFC Double Down | amazon/nova-pro-v1 100.0% yes0.0% no | 44.3%absolute gap | Leans yesHuman knife-edge |
Photo 20Bagel PB&J | amazon/nova-pro-v1 100.0% yes0.0% no | 53.4%absolute gap | Leans yesHuman knife-edge |