How do sportswriters vote for the year's best goalie? I bet they'll tell you they evaluate lots of different things, like how good he is at stopping the puck, how good he is at controlling rebounds, his mental toughness, how much he helps his team win and a bunch of other criteria that sound pretty good. They'll watch lots of hockey and check out a lot of different goalies, enough that they should be in a pretty good position to be able to evaluate them. And then who do they often end up picking? The goalie on the best team, or at least the best defensive team. That's what they've been doing for years.
If you asked sportswriters the same question back in the 1960s they'd probably give you a similar rundown, describing in detail some technical aspects of Jacques Plante that made him great, or how competitive Terry Sawchuk was in the clutch, or how much Glenn Hall helped his teams win. Some of them no doubt simply copied down the wins leaders, but I bet that a majority of the journalists sat down every year with their detailed opinions and jot notes and went through their memories of the games they had watched and tried to evaluate a dozen different subjective things. They then mailed off their ballots to league headquarters, certain that they had taken everything into account and identified the league's best goaltender.
Were they sincere? I think they were. Yet give me a random stat sheet from one of the seasons back then, with the names of the goalies blacked out, and from that alone I can predict with over 80% accuracy who the voters thought was the best goalie that season. If it wasn't for one particular outlying goalie it would be almost a sure bet.
From 1935 to 1970, there is a very simple algorithm to determine the First Team All-Star goalie. Look at all the goalies who played in at least 75% of their team's games, rank them by goals against average, and take the guy at the top of the list. That's the First Team All-Star. That solution worked in 30 out of 36 seasons, all of them except for 1957, 1958, 1960, 1964, 1968 and 1969. Here are the goalies who were named First Team All-Star ahead of the high-minutes GAA leader in those seasons:
1957: Glenn Hall
1958: Glenn Hall
1960: Glenn Hall
1964: Glenn Hall
1968: Gump Worsley**
1969: Glenn Hall
**-Led the league in GAA by a wide margin but did not play in 75% of his team's games during a season where all of the top 4 guys in GAA were in platoon situations.
Glenn Hall was quite obviously the exception to the rule. That he was the only guy to get named the league's best goalie without playing on one of the league's top defensive teams reflects well on him, and it's even more impressive that he did it 5 times. That shows that he was considered a difference-maker and is evidence of why he is considered one of the best goalies to ever play the game.
Other than Hall, though, it was pretty much a succession of GAA leaders that were named the season's best. Whether or not the voters made a conscious, stat-based decision to rely on GAA in their rankings or whether their subjective views were impacted by the fact that the goalies they watched were less likely to allow goals than everyone else is unclear, I'd guess it was a combination of the two but in the end the result is the same.
That certainly does not mean that the voters never got it right, of course. There were some seasons, perhaps even quite a few seasons, when the best goalie played on the best team or where strong goaltending made the difference between a good and a great defensive team. It remains quite obvious to anyone with a reasonable view of a goalie's role within a hockey team that the best goalie does not always allow the fewest goals against.
The voters were no less predictable in the 1970s, but what had changed was that it became common to platoon goalies. As a result, very few goalies played in 75% or more of the team's games. The voters still, whether consciously or subconscously, voted in the GAA leaders. In every season from 1971 to 1979 the same goalie won the Vezina (which under the old definition went to the starting goalie on the team that allowed the fewest goals) and was named the First Team All-Star.
I'd say the voting has improved at least somewhat in recent years, perhaps partly due to the introduction of the modern Vezina Trophy that allowed GMs to vote on the year's best goalie as well as the sportswriters. Yet even the game's insiders are not immune, as the starting goalie on the team with the fewest goals against is still overrepresented in both recent All-Star and Vezina voting. If you are the starting goalie on the team with the fewest goals against and you play in at least 50 games, you're still almost guaranteed to be named First or Second All-Star at the end of the season. The only post-expansion exceptions to that rule both came in the last decade (Ed Belfour in '99 and Roman Cechmanek in '03, although Cechmanek shared the Jennings with First Team All-Star Martin Brodeur so it's debatable whether that one should even count as an oversight). These results suggest that the bias towards goalies on strong defensive teams is still alive and well.
Some people will tell you that all goalie statistics are flawed because the rest of the team affects them, which means that the best way to evaluate goalies is to watch them play. It is true that a goalie's statistics are affected by his teammates, but what they are failing to take into account is that the rest of the team also affects how a goalie is viewed. This is especially true in the NHL where the margins between goaltenders are so narrow. I'd bet for many sportswriters and most hockey fans this effect is considerably more significant than any team-to-team differences in shot quality. A goalie on a good team that doesn't let in many goals and makes a lot of saves with his team in the lead usually looks better than a goalie on a bad team who faces more shots, allows more goals, and spends more time with his team trailing.
I think that at the NHL level there is some value to goalie scouting, but that there is likely more value in numerical analysis. That's especially true if fans or teams are not able to watch and grade the goalie in every game, which means they will end up seeing certain guys good and certain guys bad. There are other issues with evaluating goalies by watching them, such as the impact of a goalie's style and whether a viewer can accurately assess the importance of various goalie skills (I'd suggest things like rebound control and puckhandling tend to get overrated since they are more obvious and easier to grade than skills like positioning, post play, a goalie's ability to block screened or close-in shots, etc.).
If I was forced to pick only one of the two methods of evaluation (stats vs. watching), I'd prefer to take the numbers. Of course I'd rather watch a guy as well to see if there are any nuances that can be added to what the statistical record is telling me, but the moral of the story is this: Always be aware that your eyes can lie.
Subscribe to:
Post Comments (Atom)
10 comments:
Cheap title to grab readers.
Great post as always CG, its kinda disturbing how retarded the voters are.
I think what would be even more interesting is see how many teams with the lowest goals against or bottom 3 produces a first team all star goalie.
I think you're being too harsh on the voters, especially the ones from the '50s and '60s. I was actually a bit impressed that they always seemed to pick the GAA leader over the wins leader, which would probably almost always be a bigger mistake (although in the unbalanced Original Six era the best team was often the best defensive team as well).
One of the reasons they likely overemphasized GAA was that was the best stat they had available to them back then. This was before official save percentages were kept, after all.
I'm not trying to call sportswriters stupid with this post, I'm just trying to point out that subjective evaluation has biases of its own and that goaltending is simply difficult to evaluate. Most people don't do it well. There could have been some writers who were very good at picking out the best goalies regardless of team, but it's not surprising to me that they would be in the minority.
I know from experience you have to really dig down into the numbers to get a sense of who is good and who isn't, especially in years with no parity and dynasty teams going up against expansion teams. Even then there are lots of shades of grey. It's awfully tough to separate the goalie from the team in that environment, and to do that if you don't even know their save percentages is way tougher. I have tried to see if I could tell who was the best between Bill Durnan, Turk Broda and Frank Brimsek, for example, all of whom played in an era for which we have no save percentage data, and I have to admit that I still don't know.
In short, it's kind of understandable to me why the results came out the way they did, and again I think the writers were mostly being sincere when they did it. If you really want to rip them, rip them for being ignorant not for being stupid, but part of that was because they didn't have the available data that we have now. So I don't really see it as their fault, necessarily, even though I do view all pre-1982 First Team All-Star voting as next to worthless, other than if you want to make some argument in favour of Glenn Hall.
And in answer to your question, the only time I'm aware since WWII that a bottom-3 team in goals against had the First Team All-Star was Chicago in 1958 with Glenn Hall, although ranking 3rd last out of 6 teams is a lot different than ranking 3rd last out of 30. In 1969, Chicago and Hall ranked 8th in a 12 team league. Other than that, I don't think anybody has been a First Team All-Star without being on a team in the top half of the league in goals against.
That's not really evidence of bias, though, as I think it would be exceedingly rare for a deserving Vezina winner's team to finish in the bottom 3 in goals against. They would need to face a ton of shots and have awful backups for that to happen. Florida with Luongo in 2003-04 was 22nd in goals against, for example, despite allowing the most shots against. A great goalie does make a difference.
Anonymous thought this was an Eagles blog.
CG,
Still even if they went to GAA, the fact is this is supposed to be intelligent hockey people. Yes your eyes can decieve, but you would think after watching thousands of gams over their lives, they could understand that the best tenders don't always stop the most shots or allow the least goals or win the most games.
I know sportswriters annually show ignorance, but that doesn't let them off the hook in my opinion.
If you only saw a goalie a handful of times, you should obstain from the vote.
And on the question, you got mt mixed up CG, I meany on teams with the lowest goals allowed, thereby signifying at least somewhat good defense. Wasn't referring to GAA and I was referring to top teams in the GA category.
I know sportswriters annually show ignorance, but that doesn't let them off the hook in my opinion.
I guess that's a fair point. I just think that evaluating and understanding goaltending is very different than evaluating and understanding skaters, and one can be very knowledgeable about one and not the other. I think the voters have generally been pretty good about evaluating skaters. There are a lot more skaters than goalies out there, and the ratio of people who are good at evaluating skaters compared to those who are evaluating goalies is probably similar.
If someone has never played goalie and hasn't ever really studied it and just goes based on the conventional hockey wisdom, they aren't really going to know what they are talking about a lot of the time. That's just the way it is. So yeah, I guess you can blame them for not knowing better, I'm just saying I'm not particularly surprised by it.
Wasn't referring to GAA and I was referring to top teams in the GA category.
Sorry, I misunderstood you. Most of them of course were from the top teams, if the goalies ranked #1 in GAA. Up until the mid-'60s, the same goalie played all or almost all of the team's games, so the GAA leader was on the team with the GA lead almost all the time.
In the last 64 years, every goalie who played at least 50 games on the team that allowed the fewest goals against was named to the First or Second All-Star teams, other than the two exceptions I mentioned in the post (Belfour in '99, Cechmanek in '03).
Glenn Hall played for STL in '69, not Chicago. That was a big reason Chicago was 8th of 12 in GA.
STL allowed by far the fewest goals (157) in '69.
Thanks for the correction, the 1968-69 Blues did of course have Glenn Hall as well as Jacques Plante in net. That's quite the tandem, and with the Blues playing in the expansion teams division it's no wonder they finished top of the league in GA.
I have to admit that it is quite biased but at least they supposed to take under consideration a lot of things that you don't see some of them.
Post a Comment