Rank#29
-777.7alignment score
74.3%crowd match
Model breakdown
perplexity/sonar-pro-search
perplexity/sonar-pro-searchMean gap25.7%
Human match74.3%
Best fitBacon Lettuce Tomato
Average vote68.0%
68.0%model yes
62.8%human yes
Workload2K evals
2Kevals
100iterations
335.8Ktokens
Photo-by-photo
Model Results
Breaking down how close the model answered each question, compared to humans.
Photo 01Bacon Lettuce Tomato
perplexity/sonar-pro-search100.0% yes0.0% no
Gap3.7%
Model readLeans yes
Photo 02Dodge Van
perplexity/sonar-pro-search0.0% yes100.0% no
Gap7.0%
Model readLeans no
Photo 03Sub Sandwich
perplexity/sonar-pro-search100.0% yes0.0% no
Gap5.5%
Model readLeans yes
Photo 04Sandwich Costume
perplexity/sonar-pro-search0.0% yes100.0% no
Gap40.9%
Model readLeans no
Photo 05Grilled Cheese
perplexity/sonar-pro-search100.0% yes0.0% no
Gap4.4%
Model readLeans yes
Photo 06Grilled Cheese Pineapple
perplexity/sonar-pro-search100.0% yes0.0% no
Gap8.3%
Model readLeans yes
Photo 07Kitten in Bread
perplexity/sonar-pro-search0.0% yes100.0% no
Gap54.2%
Model readLeans no
Photo 08Hamburger
perplexity/sonar-pro-search100.0% yes0.0% no
Gap27.0%
Model readLeans yes
Photo 09Hashbrown Sandwich
perplexity/sonar-pro-search100.0% yes0.0% no
Gap40.6%
Model readLeans yes
Photo 10Hot Dog
perplexity/sonar-pro-search19.0% yes81.0% no
Gap20.8%
Model readLeans no
Photo 11Pickle Sandwich
perplexity/sonar-pro-search99.0% yes1.0% no
Gap33.4%
Model readLeans yes
Photo 12Avocado Tea
perplexity/sonar-pro-search100.0% yes0.0% no
Gap7.2%
Model readLeans yes
Photo 13Panini
perplexity/sonar-pro-search100.0% yes0.0% no
Gap7.6%
Model readLeans yes
Photo 14Cookie PB
perplexity/sonar-pro-search0.0% yes100.0% no
Gap51.5%
Model readLeans no
Photo 15Chicken Wrap
perplexity/sonar-pro-search80.0% yes20.0% no
Gap57.4%
Model readLeans yes
Photo 16Waffle Ice Cream
perplexity/sonar-pro-search82.0% yes18.0% no
Gap15.7%
Model readLeans yes
Photo 17Sloppy Joe
perplexity/sonar-pro-search100.0% yes0.0% no
Gap20.6%
Model readLeans yes
Photo 18Cigarette Sandwich
perplexity/sonar-pro-search0.0% yes100.0% no
Gap29.8%
Model readLeans no
Photo 19KFC Double Down
perplexity/sonar-pro-search100.0% yes0.0% no
Gap44.3%
Model readLeans yes
Photo 20Bagel PB&J
perplexity/sonar-pro-search80.0% yes20.0% no
Gap33.4%
Model readLeans yes
| Photo | Vote SplitHuman response | Gap | Read |
|---|---|---|---|
Photo 01Bacon Lettuce Tomato | perplexity/sonar-pro-search 100.0% yes0.0% no | 3.7%absolute gap | Leans yesPeople mostly said yes |
Photo 02Dodge Van | perplexity/sonar-pro-search 0.0% yes100.0% no | 7.0%absolute gap | Leans noPeople mostly said no |
Photo 03Sub Sandwich | perplexity/sonar-pro-search 100.0% yes0.0% no | 5.5%absolute gap | Leans yesPeople mostly said yes |
Photo 04Sandwich Costume | perplexity/sonar-pro-search 0.0% yes100.0% no | 40.9%absolute gap | Leans noHuman knife-edge |
Photo 05Grilled Cheese | perplexity/sonar-pro-search 100.0% yes0.0% no | 4.4%absolute gap | Leans yesPeople mostly said yes |
Photo 06Grilled Cheese Pineapple | perplexity/sonar-pro-search 100.0% yes0.0% no | 8.3%absolute gap | Leans yesPeople mostly said yes |
Photo 07Kitten in Bread | perplexity/sonar-pro-search 0.0% yes100.0% no | 54.2%absolute gap | Leans noHuman knife-edge |
Photo 08Hamburger | perplexity/sonar-pro-search 100.0% yes0.0% no | 27.0%absolute gap | Leans yesSplit concept |
Photo 09Hashbrown Sandwich | perplexity/sonar-pro-search 100.0% yes0.0% no | 40.6%absolute gap | Leans yesHuman knife-edge |
Photo 10Hot Dog | perplexity/sonar-pro-search 19.0% yes81.0% no | 20.8%absolute gap | Leans noSplit concept |
Photo 11Pickle Sandwich | perplexity/sonar-pro-search 99.0% yes1.0% no | 33.4%absolute gap | Leans yesSplit concept |
Photo 12Avocado Tea | perplexity/sonar-pro-search 100.0% yes0.0% no | 7.2%absolute gap | Leans yesPeople mostly said yes |
Photo 13Panini | perplexity/sonar-pro-search 100.0% yes0.0% no | 7.6%absolute gap | Leans yesPeople mostly said yes |
Photo 14Cookie PB | perplexity/sonar-pro-search 0.0% yes100.0% no | 51.5%absolute gap | Leans noHuman knife-edge |
Photo 15Chicken Wrap | perplexity/sonar-pro-search 80.0% yes20.0% no | 57.4%absolute gap | Leans yesSplit concept |
Photo 16Waffle Ice Cream | perplexity/sonar-pro-search 82.0% yes18.0% no | 15.7%absolute gap | Leans yesSplit concept |
Photo 17Sloppy Joe | perplexity/sonar-pro-search 100.0% yes0.0% no | 20.6%absolute gap | Leans yesSplit concept |
Photo 18Cigarette Sandwich | perplexity/sonar-pro-search 0.0% yes100.0% no | 29.8%absolute gap | Leans noSplit concept |
Photo 19KFC Double Down | perplexity/sonar-pro-search 100.0% yes0.0% no | 44.3%absolute gap | Leans yesHuman knife-edge |
Photo 20Bagel PB&J | perplexity/sonar-pro-search 80.0% yes20.0% no | 33.4%absolute gap | Leans yesHuman knife-edge |