Model breakdown
Googlegoogle/gemma-3-27b-it
Profile
Gemma 3 27B ITGoogle
Release
2025-03-12Available on OpenRouter
Specs
27B128,000 tokens
Capabilities
Text + ImageLargest Gemma 3 open multimodal model for single-accelerator work
Training
Not publicly disclosedGoogle DeepMind
Rank#41
-940.6alignment score
71.4%crowd match
Mean gap28.6%
Human match71.4%
Best fitBacon Lettuce Tomato
Average vote68.2%
68.2%model yes
62.8%human yes
Workload2K evals
2Kevals
100iterations
863.7Ktokens
Photo-by-photo

Model Results

Breaking down how close the model answered each question, compared to humans.

Dodge Van
Photo 02Dodge Van
Googlegoogle/gemma-3-27b-it
0.0% yes100.0% no
Gap7.0%
Model readLeans no
Sub Sandwich
Photo 03Sub Sandwich
Googlegoogle/gemma-3-27b-it
100.0% yes0.0% no
Gap5.5%
Model readLeans yes
Googlegoogle/gemma-3-27b-it
0.0% yes100.0% no
Gap40.9%
Model readLeans no
Googlegoogle/gemma-3-27b-it
100.0% yes0.0% no
Gap4.4%
Model readLeans yes
Googlegoogle/gemma-3-27b-it
0.0% yes100.0% no
Gap54.2%
Model readLeans no
Hamburger
Photo 08Hamburger
Googlegoogle/gemma-3-27b-it
100.0% yes0.0% no
Gap27.0%
Model readLeans yes
Googlegoogle/gemma-3-27b-it
100.0% yes0.0% no
Gap40.6%
Model readLeans yes
Hot Dog
Photo 10Hot Dog
Googlegoogle/gemma-3-27b-it
100.0% yes0.0% no
Gap60.2%
Model readLeans yes
Googlegoogle/gemma-3-27b-it
99.0% yes1.0% no
Gap33.4%
Model readLeans yes
Avocado Tea
Photo 12Avocado Tea
Googlegoogle/gemma-3-27b-it
100.0% yes0.0% no
Gap7.2%
Model readLeans yes
Panini
Photo 13Panini
Googlegoogle/gemma-3-27b-it
100.0% yes0.0% no
Gap7.6%
Model readLeans yes
Cookie PB
Photo 14Cookie PB
Googlegoogle/gemma-3-27b-it
18.0% yes82.0% no
Gap33.5%
Model readLeans no
Chicken Wrap
Photo 15Chicken Wrap
Googlegoogle/gemma-3-27b-it
53.0% yes47.0% no
Gap30.4%
Model readLeans yes
Googlegoogle/gemma-3-27b-it
0.0% yes100.0% no
Gap66.3%
Model readLeans no
Sloppy Joe
Photo 17Sloppy Joe
Googlegoogle/gemma-3-27b-it
100.0% yes0.0% no
Gap20.6%
Model readLeans yes
Googlegoogle/gemma-3-27b-it
0.0% yes100.0% no
Gap29.8%
Model readLeans no
Googlegoogle/gemma-3-27b-it
100.0% yes0.0% no
Gap44.3%
Model readLeans yes
Bagel PB&J
Photo 20Bagel PB&J
Googlegoogle/gemma-3-27b-it
94.0% yes6.0% no
Gap47.4%
Model readLeans yes
PhotoVote SplitHuman responseGapRead
Googlegoogle/gemma-3-27b-it
100.0% yes0.0% no
3.7%absolute gap
Leans yesPeople mostly said yes
Dodge Van
Photo 02Dodge Van
Googlegoogle/gemma-3-27b-it
0.0% yes100.0% no
7.0%absolute gap
Leans noPeople mostly said no
Sub Sandwich
Photo 03Sub Sandwich
Googlegoogle/gemma-3-27b-it
100.0% yes0.0% no
5.5%absolute gap
Leans yesPeople mostly said yes
Googlegoogle/gemma-3-27b-it
0.0% yes100.0% no
40.9%absolute gap
Leans noHuman knife-edge
Googlegoogle/gemma-3-27b-it
100.0% yes0.0% no
4.4%absolute gap
Leans yesPeople mostly said yes
Googlegoogle/gemma-3-27b-it
100.0% yes0.0% no
8.3%absolute gap
Leans yesPeople mostly said yes
Googlegoogle/gemma-3-27b-it
0.0% yes100.0% no
54.2%absolute gap
Leans noHuman knife-edge
Hamburger
Photo 08Hamburger
Googlegoogle/gemma-3-27b-it
100.0% yes0.0% no
27.0%absolute gap
Leans yesSplit concept
Googlegoogle/gemma-3-27b-it
100.0% yes0.0% no
40.6%absolute gap
Leans yesHuman knife-edge
Hot Dog
Photo 10Hot Dog
Googlegoogle/gemma-3-27b-it
100.0% yes0.0% no
60.2%absolute gap
Leans yesSplit concept
Googlegoogle/gemma-3-27b-it
99.0% yes1.0% no
33.4%absolute gap
Leans yesSplit concept
Avocado Tea
Photo 12Avocado Tea
Googlegoogle/gemma-3-27b-it
100.0% yes0.0% no
7.2%absolute gap
Leans yesPeople mostly said yes
Panini
Photo 13Panini
Googlegoogle/gemma-3-27b-it
100.0% yes0.0% no
7.6%absolute gap
Leans yesPeople mostly said yes
Cookie PB
Photo 14Cookie PB
Googlegoogle/gemma-3-27b-it
18.0% yes82.0% no
33.5%absolute gap
Leans noHuman knife-edge
Chicken Wrap
Photo 15Chicken Wrap
Googlegoogle/gemma-3-27b-it
53.0% yes47.0% no
30.4%absolute gap
Leans yesSplit concept
Googlegoogle/gemma-3-27b-it
0.0% yes100.0% no
66.3%absolute gap
Leans noSplit concept
Sloppy Joe
Photo 17Sloppy Joe
Googlegoogle/gemma-3-27b-it
100.0% yes0.0% no
20.6%absolute gap
Leans yesSplit concept
Googlegoogle/gemma-3-27b-it
0.0% yes100.0% no
29.8%absolute gap
Leans noSplit concept
Googlegoogle/gemma-3-27b-it
100.0% yes0.0% no
44.3%absolute gap
Leans yesHuman knife-edge
Bagel PB&J
Photo 20Bagel PB&J
Googlegoogle/gemma-3-27b-it
94.0% yes6.0% no
47.4%absolute gap
Leans yesHuman knife-edge
google/gemma-3-27b-it Sandwich Benchmark Breakdown | opensandwich.ai