opensandwich.ai
Model breakdown
NVIDIAnvidia/nemotron-nano-12b-v2-vl
Profile
Nemotron Nano 12B v2 VLNVIDIA
Release
Not provided by OpenRouterAvailable on OpenRouter
Specs
Not provided by OpenRouter131,072 tokens
Capabilities
Image + Text + VideoNot provided by OpenRouter
Training
Not provided by OpenRouterNVIDIA
Links
Lab pageModel page

Under development: this benchmark and its published results are provisional, not final.

Back To ModelsOpen Best FitOpen Biggest Miss
Rank#7
-494.7alignment score
78.0%crowd match
Mean gap22.0%
Human match78.0%
Best fitGrilled Cheese Pineapple
Average vote68.8%
68.8%model yes
62.8%human yes
Workload2K evals
2Kevals
100iterations
4.3Mtokens
Best fit2.3%
Grilled Cheese Pineapple

Grilled Cheese Pineapple

94.0%model yes
91.7%human yes
Biggest miss52.4%
Bagel PB&J

Bagel PB&J

99.0%model yes
46.6%human yes
Photo-by-photo

Model Results

Breaking down how close the model answered each question, compared to humans.

Bacon Lettuce Tomato
Photo 01Bacon Lettuce Tomato
NVIDIAnvidia/nemotron-nano-12b-v2-vl
100.0% yes0.0% no
Gap3.7%
Model readLeans yes
Dodge Van
Photo 02Dodge Van
NVIDIAnvidia/nemotron-nano-12b-v2-vl
0.0% yes100.0% no
Gap7.0%
Model readLeans no
Sub Sandwich
Photo 03Sub Sandwich
NVIDIAnvidia/nemotron-nano-12b-v2-vl
100.0% yes0.0% no
Gap5.5%
Model readLeans yes
Sandwich Costume
Photo 04Sandwich Costume
NVIDIAnvidia/nemotron-nano-12b-v2-vl
3.0% yes97.0% no
Gap37.9%
Model readLeans no
Grilled Cheese
Photo 05Grilled Cheese
NVIDIAnvidia/nemotron-nano-12b-v2-vl
100.0% yes0.0% no
Gap4.4%
Model readLeans yes
Kitten in Bread
Photo 07Kitten in Bread
NVIDIAnvidia/nemotron-nano-12b-v2-vl
8.0% yes92.0% no
Gap46.2%
Model readLeans no
Hamburger
Photo 08Hamburger
NVIDIAnvidia/nemotron-nano-12b-v2-vl
100.0% yes0.0% no
Gap27.0%
Model readLeans yes
Hashbrown Sandwich
Photo 09Hashbrown Sandwich
NVIDIAnvidia/nemotron-nano-12b-v2-vl
89.0% yes11.0% no
Gap29.6%
Model readLeans yes
Hot Dog
Photo 10Hot Dog
NVIDIAnvidia/nemotron-nano-12b-v2-vl
76.0% yes24.0% no
Gap36.2%
Model readLeans yes
Pickle Sandwich
Photo 11Pickle Sandwich
NVIDIAnvidia/nemotron-nano-12b-v2-vl
73.0% yes27.0% no
Gap7.4%
Model readLeans yes
Avocado Tea
Photo 12Avocado Tea
NVIDIAnvidia/nemotron-nano-12b-v2-vl
78.0% yes22.0% no
Gap14.8%
Model readLeans yes
Panini
Photo 13Panini
NVIDIAnvidia/nemotron-nano-12b-v2-vl
99.0% yes1.0% no
Gap6.6%
Model readLeans yes
Cookie PB
Photo 14Cookie PB
NVIDIAnvidia/nemotron-nano-12b-v2-vl
25.0% yes75.0% no
Gap26.5%
Model readLeans no
Chicken Wrap
Photo 15Chicken Wrap
NVIDIAnvidia/nemotron-nano-12b-v2-vl
63.0% yes37.0% no
Gap40.4%
Model readLeans yes
Waffle Ice Cream
Photo 16Waffle Ice Cream
NVIDIAnvidia/nemotron-nano-12b-v2-vl
97.0% yes3.0% no
Gap30.7%
Model readLeans yes
Sloppy Joe
Photo 17Sloppy Joe
NVIDIAnvidia/nemotron-nano-12b-v2-vl
97.0% yes3.0% no
Gap17.6%
Model readLeans yes
Cigarette Sandwich
Photo 18Cigarette Sandwich
NVIDIAnvidia/nemotron-nano-12b-v2-vl
3.0% yes97.0% no
Gap26.8%
Model readLeans no
KFC Double Down
Photo 19KFC Double Down
NVIDIAnvidia/nemotron-nano-12b-v2-vl
73.0% yes27.0% no
Gap17.3%
Model readLeans yes
Bagel PB&J
Photo 20Bagel PB&J
NVIDIAnvidia/nemotron-nano-12b-v2-vl
99.0% yes1.0% no
Gap52.4%
Model readLeans yes
PhotoVote SplitHuman responseGapRead
Bacon Lettuce Tomato
Photo 01Bacon Lettuce Tomato
NVIDIAnvidia/nemotron-nano-12b-v2-vl
100.0% yes0.0% no
3.7%absolute gap
Leans yesPeople mostly said yes
Dodge Van
Photo 02Dodge Van
NVIDIAnvidia/nemotron-nano-12b-v2-vl
0.0% yes100.0% no
7.0%absolute gap
Leans noPeople mostly said no
Sub Sandwich
Photo 03Sub Sandwich
NVIDIAnvidia/nemotron-nano-12b-v2-vl
100.0% yes0.0% no
5.5%absolute gap
Leans yesPeople mostly said yes
Sandwich Costume
Photo 04Sandwich Costume
NVIDIAnvidia/nemotron-nano-12b-v2-vl
3.0% yes97.0% no
37.9%absolute gap
Leans noHuman knife-edge
Grilled Cheese
Photo 05Grilled Cheese
NVIDIAnvidia/nemotron-nano-12b-v2-vl
100.0% yes0.0% no
4.4%absolute gap
Leans yesPeople mostly said yes
Grilled Cheese Pineapple
Photo 06Grilled Cheese Pineapple
NVIDIAnvidia/nemotron-nano-12b-v2-vl
94.0% yes6.0% no
2.3%absolute gap
Leans yesPeople mostly said yes
Kitten in Bread
Photo 07Kitten in Bread
NVIDIAnvidia/nemotron-nano-12b-v2-vl
8.0% yes92.0% no
46.2%absolute gap
Leans noHuman knife-edge
Hamburger
Photo 08Hamburger
NVIDIAnvidia/nemotron-nano-12b-v2-vl
100.0% yes0.0% no
27.0%absolute gap
Leans yesSplit concept
Hashbrown Sandwich
Photo 09Hashbrown Sandwich
NVIDIAnvidia/nemotron-nano-12b-v2-vl
89.0% yes11.0% no
29.6%absolute gap
Leans yesHuman knife-edge
Hot Dog
Photo 10Hot Dog
NVIDIAnvidia/nemotron-nano-12b-v2-vl
76.0% yes24.0% no
36.2%absolute gap
Leans yesSplit concept
Pickle Sandwich
Photo 11Pickle Sandwich
NVIDIAnvidia/nemotron-nano-12b-v2-vl
73.0% yes27.0% no
7.4%absolute gap
Leans yesSplit concept
Avocado Tea
Photo 12Avocado Tea
NVIDIAnvidia/nemotron-nano-12b-v2-vl
78.0% yes22.0% no
14.8%absolute gap
Leans yesPeople mostly said yes
Panini
Photo 13Panini
NVIDIAnvidia/nemotron-nano-12b-v2-vl
99.0% yes1.0% no
6.6%absolute gap
Leans yesPeople mostly said yes
Cookie PB
Photo 14Cookie PB
NVIDIAnvidia/nemotron-nano-12b-v2-vl
25.0% yes75.0% no
26.5%absolute gap
Leans noHuman knife-edge
Chicken Wrap
Photo 15Chicken Wrap
NVIDIAnvidia/nemotron-nano-12b-v2-vl
63.0% yes37.0% no
40.4%absolute gap
Leans yesSplit concept
Waffle Ice Cream
Photo 16Waffle Ice Cream
NVIDIAnvidia/nemotron-nano-12b-v2-vl
97.0% yes3.0% no
30.7%absolute gap
Leans yesSplit concept
Sloppy Joe
Photo 17Sloppy Joe
NVIDIAnvidia/nemotron-nano-12b-v2-vl
97.0% yes3.0% no
17.6%absolute gap
Leans yesSplit concept
Cigarette Sandwich
Photo 18Cigarette Sandwich
NVIDIAnvidia/nemotron-nano-12b-v2-vl
3.0% yes97.0% no
26.8%absolute gap
Leans noSplit concept
KFC Double Down
Photo 19KFC Double Down
NVIDIAnvidia/nemotron-nano-12b-v2-vl
73.0% yes27.0% no
17.3%absolute gap
Leans yesHuman knife-edge
Bagel PB&J
Photo 20Bagel PB&J
NVIDIAnvidia/nemotron-nano-12b-v2-vl
99.0% yes1.0% no
52.4%absolute gap
Leans yesHuman knife-edge
nvidia/nemotron-nano-12b-v2-vl Sandwich Benchmark Breakdown | opensandwich.ai