Do you have a question for Dr. Vinny? Ask it here...
Dear Dr. Vinny,
You’ve written that for Wine Spectator blind tastings, the wines are organized into flights by varietal, appellation and/or region, and that the ratings reflect “How highly our taster regards each wine relative to other wines.” My question is, does the rating reflect each wine relative to other wines for each flight? If yes, how do you compare wines from different flights related to the same appellation or region?
Good question. Let me take a step back and make sure you can picture the tasting process in its entirety.
Each reviewer has his or her own "tasting beats," or wine categories, like Bordeaux, or New Zealand, or Port. That gives our tasters a chance to develop expertise in their regions. When they sit down to a flight of wines that the tasting coordinators have arranged, they're bringing all of their experience with that category to the table.
The wines are tasted in what is called a single-blind tasting, in which the reviewer knows the varietal, vintage and/or appellation of the wine, but not the producer or the price. We stand behind this process because we believe that the very best wines reflect where they’re from. The wines are disguised in bags, to keep this process as fair and objective as possible. I like to say it’s a very democratic way of reviewing wine, where everyone has an equal chance at a great score.
But we go a step further. Two, actually. First, each flight begins with a benchmark wine, which has already been reviewed. That’s the only wine that’s not bagged, and the score the wine had been given is marked clearly on the bottle. That’s a really helpful reference tool for the taster to use throughout the flight as a way to calibrate.
Finally, each flight also has at least one ringer somewhere in there. A previously rated wine is hidden among all the others, and the taster doesn’t know which wine it is until all of the scores are locked in and the bags are removed. They can check and make sure they are on track with how they previously rated something. It’s a helpful tool to make sure we are being consistent with our scores from flight to flight.
Learn from the experts and get the most out of each sip. Take one of our online courses or take them all—from the ABCs of Tasting to in-depth seminars on Food Pairing, California Cabernet, Bordeaux, Tuscany, Sensory Evaluation and more.