tag:blogger.com,1999:blog-81484612244732206942024-03-18T05:15:00.124-04:00Brodeur is a FraudMoved to contrariangoaltender.blogspot.comThe Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.comBlogger368125tag:blogger.com,1999:blog-8148461224473220694.post-63888440222598638442013-11-25T13:34:00.000-05:002013-11-25T13:34:07.822-05:00New AddressThe new blog is up and running over at <a href="http://contrariangoaltender.blogspot.com/">contrariangoaltender.blogspot.com</a>.The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com87tag:blogger.com,1999:blog-8148461224473220694.post-35837082720661962802013-10-17T15:55:00.000-04:002013-10-17T15:55:24.700-04:00Back in the Blogging Business (But With a Change of Address)It's been quite a while since I posted in this space, and the main reason for that is that I was one of the fans who saw their interest in professional hockey really fade in response to the lockout last fall. That disinterest persisted for some time, I didn't end up watching a lot of games for much of the season and the chaotic, shortened 48-game schedule made it pretty tough to figure out whether we were seeing meaningful results or variance, especially with a lot of the top-tier goalies having down years (the list of guys who came in with save percentages below league average in 2012-13 includes Quick, Rinne, Luongo, Price, Ward, and Backstrom).<br />
<div>
<br /></div>
Despite all that, I happen to be a Montreal Canadiens fan, and the chance to watch a surprisingly good team on the upswing was mainly what pulled me back in. Unfortunately, it was more or less just in time to suffer through one of the most comprehensively frustrating playoff series I've ever witnessed, but c'est la vie, and at least my work here has made me as aware as anyone of just how fickle goaltending results can be over small sample sizes.<br />
<br />
Anyway, in the interim I have been working on a few other things, one of which was joining in on the <a href="http://hfboards.hockeysfuture.com/showthread.php?t=1270035">HFBoards' History of Hockey Top 40 Goaltenders</a> project, a fun exercise that helped me fill in some of the historical knowledge I wasn't quite up to speed on and dig into a bunch of new numbers. Here's the link to my <a href="http://hfboards.hockeysfuture.com/showthread.php?t=1343493">final voting record</a>. You might notice that #7 happens to be the namesake of this blog, which brings us to the next order of business: Moving over to <a href="http://contrariangoaltender.blogspot.com/">contrariangoaltender.blogspot.com</a>.<br />
<br />
There are several reasons for this:<br />
<div>
<br /></div>
<div>
1. Martin Brodeur is one of the greatest goaltenders of all-time. He may be a overrated in some circles, particularly among members of the mainstream media, but he is certainly not a fraud.</div>
<div>
<br /></div>
2. It was far more interesting to put a microscope on the abilities of a 34-year old Vezina winner than a 41-year old whose best days are clearly behind him.<br />
<br />
3. I suspect the trade-off in terms of clickbait vs. perceived loss of credibility has changed to the point where I'd rather not keep it. Plus I killed my audience by taking a year off anyway so what's the downside?<br />
<br />
In short, if you haven't read the entire record of my mini-obsession with Martin Brodeur to trace the evolving perspective of his career in this space, there is good reason to believe that a basic save percentage analysis underrates him to the point that he does deserve to considered one of the top 6-8 goalies ever. This is because Brodeur adds value in terms of non-save skills (I believe primarily through puckhandling and keeping the play going to reduce faceoffs in his own zone), and because his home town scorekeeper cost him several points on his save percentage through undercounting shots relative to other rinks around the league. Goaltending is about finding small edges that add up over time, and once those two things are factored in, Brodeur's initially good-but-not-necessarily-elite save percentage record looks a lot more impressive.<br />
<br />
There's also the fact that starting with the month I started blogging here in January 2007, Brodeur managed to record up a .917 save percentage on his next ~7000 shots against, beating league average by .008 while playing for a team that was still well-disciplined and effective defensively but no longer the completely airtight lockdown unit it had been during the Cup years. And that's not even taking into account the probability that number was actually understated because of shot prevention and the stingy scorer in New Jersey. As far as counterarguments go, that was a pretty strong one. And to round it off, all this came in Brodeur's age 34-37 seasons, at a time when his career should have been expected to be on a downswing, yet he still managed to actually beat league average by a higher margin than he did from ages 26-33 (.911, +.005 vs. league average).<br />
<br />
I think there is still some uncertainty as to the exact nature of EV shot quality effects on the Devils throughout Brodeur's career, particularly given his statistical drop-off in the early '00s during a more open team style of play and the numbers that some of the team's mediocre backups were able to record (albeit usually in small sample sizes against weak opposition). It's also very difficult to tease out exactly how much value the best puckhandling goalies contribute relative to their peers. Despite the extensive focus on his statistical record here and in other places, I think Brodeur remains an interesting and unusual analytics puzzle. For now, though, as he enters what could be his last NHL season at the age of 41 with his heir apparent already on the Devils roster, I simply have to give the guy his due.<br />
<br />
My archive will still be up here, and I'm hoping to revisit some of my favourite old posts with updated numbers to reflect more recent seasons. Thanks to everybody who has read my writing here or at <a href="http://www.hockeyprospectus.com/">Hockey Prospectus</a>, and if there's anyone still hanging around I hope you will consider checking me out at the new address.The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com187tag:blogger.com,1999:blog-8148461224473220694.post-70318649488344664222012-07-06T13:10:00.000-04:002012-07-06T13:10:10.669-04:00The Value of Subjective EvaluationI've written many times about how I do not put a high degree of emphasis on subjective evaluations of goaltenders because there are extraneous and often subconscious factors that can impact how a performance is judged. Even on the individual game level, where the task should presumably be at its very easiest, <span style="background-color: white;">luck and the performance of the goalie's teammates still have a big impact on how they are rated.</span><br />
<br />
TSN analyst and former NHL goaltender Jamie McLennan scored <a href="http://www.tsn.ca/nhl/feature/?id=9391">every goaltending performance</a> in the 2012 Stanley Cup playoffs based on a subjective scale from 1-5, which gives an interesting point of comparison between what the numbers show in terms of saves and goals against and what an informed expert concludes from their individual judgment. I do not question McLennan's scouting ability or his knowledge of goaltending, but the data set he has provided has some interesting properties that force me to question how much value his analysis actually adds.<br />
<ul>
<li><span style="background-color: white;">In 86 playoff games, McLennan never gave the losing goalie a better score than the winning goalie. He gave the two the same score only 6 times, meaning that 93% of the time the goalie on the winning team was judged to have played a better game. Eleven times the two goalies had a save percentage within .005, suggesting there was likely very little difference in their play, yet the winning goalie routinely received a higher degree of recognition. When you factor in score effects that typically end up inflating the winning goalie's numbers slightly, it is likely that the losing goalie often managed to match or outperform the winner, yet they never got a better score and only rarely were even graded on the same level as their counterpart</span></li>
<li><span style="background-color: white;">The correlation between a goalie's average game score and his overall save percentage was 0.924, which is an extremely high degree of correlation</span></li>
<li><span style="background-color: white;">Goalies received a 5 every single time they had a save percentage of .970 or better, regardless of how many shots they faced</span></li>
<li><span style="background-color: white;">If you compare the save percentage rankings with the game score rankings, only 4 out of the 17 goalies with at least 3 games played in the 2012 playoffs have a ranking differential of more than two (Niemi, Howard, Brodeur and Holtby)</span></li>
<li><span style="background-color: white;">Using regression, each goalie's average game score can be predicted from their overall save percentage. Every goalie's predicted average score was within 0.25 of their actual average game score, with the exception of Jon Quick, who was 0.37 higher, and Antti Niemi, who came in a whopping 0.67 lower</span></li>
</ul>
<span style="background-color: white;">In summary, McLennan's rankings did not seem to add much information. He really liked Jon Quick, but he was hardly unique in that viewpoint; the Conn Smythe Trophy is proof enough that most observers liked what they saw from the Kings' goalie. McLennan really wasn't a fan of Niemi's playoffs, giving him scores of 2 for games of .906 and .923, both very unusual for his ranking system (there were only two other games total where a goalie got a 2 for a .900+ save percentage outing). Perhaps we can conclude from this that the numbers flattered the Sharks' netminder a bit relative to his actual performance. However, it is also at least possible that McLennan has some sort of bias against Niemi, who had strong numbers at even strength (.940) but was ventilated on the penalty kill (.806), a unit that has been a point of serious weakness for San Jose over the past two seasons.</span><span style="background-color: white;"><br /></span><br /><span style="background-color: white;">Beyond those two, comparing the save numbers to the game scores indicates that McLennan thought that Marc-Andre Fleury, Cory Schneider, Jimmy Howard and Martin Brodeur were all a bit better than their numbers suggest, while Tim Thomas, Jose Theodore and Corey Crawford were all a bit worse. That makes sense for Fleury, awful performances do tend to disproportionately drag down a goalie's overall averages, as well as Brodeur who is noted for his non-save skills (although McLennan also openly admitted to giving the veteran a few sympathy marks for his play in the Stanley Cup Finals).</span><span style="background-color: white;"><br /></span><br />
<span style="background-color: white;">I would subjectively agree that Thomas and Crawford may both have been a bit worse than their numbers suggest, particularly if you factor in situational leverage and their impact on win probability. A previous post of mine looked at <a href="http://brodeurisafraud.blogspot.ca/2012/04/two-of-closest-series-ever.html">save percentage by game score</a>, and Thomas and Crawford were certainly outplayed by their opposite numbers when the game was close. How much of that is randomness and how much of that was each goalie's fault is an open question, but I'm not surprised that someone subjectively rating goalies would take their situational performance into account to some extent. Still, if I turn the analysis around to predict save percentage based on game score, McLennan was subjectively downgrading both goalies by only about .006-.008, not a very significant change at all for a 150-200 shot sample.</span><br />
<br />
<span style="background-color: white;">Imagine two individuals, one who didn't watch a second of playoff hockey but was armed with detailed stat sheets showing the save efficiency of every goalie, and one who also didn't watch a second of playoff hockey but still somehow faithfully tuned in every night to hear Jamie McLennan's Post2Post segment on TSN. Which one would be in better position to rate the goaltenders in the 2012 playoffs? I think it probably would be the McLennan fan, but their advantage would be very slight as the two would still agree on almost everything.</span><span style="background-color: white;"><br /></span><br />
<span style="background-color: white;">Over and over, analysis tends to show that the subjective factors often hyped by broadcasters and hockey insiders (shot quality, clutch saves, etc.) really do not have that much of an impact at the end of the day. That's not always the most intuitive finding for us narrative-obsessed sports fans, but it's hard to argue with the evidence. I think we should be careful to completely dismiss potential factors that over time could have a significant impact, particularly at the career level, but given that nearly every observer seems to vastly overrate the value of goaltending contributions that are not encapsulated in save percentage I think it reinforces the idea that a goalie's save rate should remain the primary and most trusted method of evaluation. Subjective opinions from people who know what they are talking about should not be disregarded, but they should at least be treated with some level of skepticism and compared with the statistical record to test their validity before given much weighting in the final evaluation.</span>The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com24tag:blogger.com,1999:blog-8148461224473220694.post-54874003051116780832012-06-28T11:39:00.000-04:002012-06-28T11:39:16.071-04:00Why Couldn't Mats Sundin Score on the Power Play?Mats Sundin was named to the Hall of Fame in his first year of eligibility, creating some controversy as many thought he was not fully deserving of that honour. Some observers seemed especially miffed that Sundin was inducted ahead of Brendan Shanahan.<br />
<br />
I don't really see the injustice there to be honest as I think Sundin is fully deserving of the Hall. If you gave me the choice of Sundin or Shanahan I would have taken Sundin at virtually any point during their careers. Sundin's record of consistent production is pretty strong, and I don't particularly care about his lack of team success or failure to win any major trophies. His international scoring record, in particular, <span style="background-color: white;">is fantastic (18 goals, 21 assists for 39 points in 30 games played in best-on-best tournaments, plus 18-26-44 in 35 games in his world championships career).<br /><br />
Many have wondered why Sundin was unable to duplicate the same excellent results in the NHL, particularly in the playoffs. North American observers are sometimes quick to resort to the traditional explanation that European players are more motivated to perform well in international tournaments than in Stanley Cup postseason games, but I'm </span><a href="http://drivingplay.blogspot.com/2011/08/on-whether-or-not-europeans-disappear.html" style="background-color: white;">pretty skeptical</a><span style="background-color: white;"> of that being a major factor. I think a better explanation is that Mats Sundin was one of the best 5 on 5 forwards in the world and was playing with better linemates for Tre Kronor than he was in Toronto.<br /><br />
Sundin has a very impressive record of even strength scoring. From 1996-97 to 2001-02, he finished in the top 20 in the league in even strength scoring in six consecutive seasons while amassing 338 points at even strength over that span, the second-best total in the league behind only Jaromir Jagr. When you take into account Sundin's usual lack of top linemates and coach Pat Quinn's favoured strategy of rolling four lines that had the byproduct of reducing the available ice time for his #1 centre relative to other stars around the league, Sundin's scoring rates are even more impressive.<br /><br />
Here are the even strength and power play scoring rates during the regular season and playoffs for 8 of the top centers in the league from 1997-98 to 2003-04 (plus Brendan Shanahan, given all the recent discussion of whether he was more deserving than Sundin):</span><br /><br />
<table><tbody>
<tr><td>Player</td><td>RS EV</td><td>RS PP</td><td>PO EV</td><td>PO PP</td></tr>
<tr><td>Forsberg</td><td>2.94</td><td>6.36</td><td>3.11</td><td>5.43</td></tr>
<tr><td>Sundin</td><td>2.66</td><td>4.04</td><td>2.35</td><td>3.23</td></tr>
<tr><td>Sakic</td><td>2.64</td><td>5.46</td><td>1.94</td><td>5.20</td></tr>
<tr><td>Lindros</td><td>2.59</td><td>4.27</td><td>1.72</td><td>1.72</td></tr>
<tr><td>Turgeon</td><td>2.53</td><td>4.96</td><td>2.24</td><td>4.94</td></tr>
<tr><td>Modano</td><td>2.36</td><td>4.98</td><td>2.05</td><td>4.95</td></tr>
<tr><td>Yashin</td><td>2.28</td><td>4.75</td><td>0.99</td><td>3.59</td></tr>
<tr><td>Yzerman</td><td>2.26</td><td>4.98</td><td>1.99</td><td>5.08</td></tr>
<tr><td>Shanahan</td><td>2.23</td><td>5.24</td><td>1.95</td><td>3.88</td></tr>
</tbody></table>
<span style="background-color: white;">
<br />Sundin ranks second to only Forsberg in both the regular season and the playoffs in his rate of even strength point production. Sundin also had the best even strength goalscoring rate in the regular season as well as the fourth-best pace in the playoffs. </span><span style="background-color: white;">However, the former Leaf captain ranks dead last in power play scoring in the regular season, and only Lindros (who had all of 7 playoff games played during this period) ranks below him in playoff power play scoring.<br /><br />
I checked the participation rates for the centers (percentage of team goals while a player was on the ice on which they recorded either a goal or an assist) to see if there were any major discrepancies:<br /><br />Forsberg: 86.4% EV, 69.8% PP<br />Sundin: 83.9% EV, 64.4% PP<br />Sakic: 87.1% EV, 66.1% PP<br />
Lindros: 81.5% EV, 64.4% PP<br />
Turgeon: 85.7% EV, 70.0% PP<br />
Modano: 83.8% EV, 64.7% PP<br />
Yashin: 83.3% EV, 74.7% PP<br />
Yzerman: 78.5% EV, 59.3% PP<br />
</span><br />
<div>
<span style="background-color: white;"><span style="background-color: white;">Sundin's rates are pretty typical in both game situations. His power play rate is slightly below the group average, but is identical to that of Lindros and very close to Modano's. Yzerman's PP number is interesting, given that it is much lower than the others. To add to that, Brendan Shanahan's participation rate in the same unit was 61.4%. These numbers suggest that the Red Wings' dominant power play unit was more of a team effort than, say, the Colorado Avalanche power play which was very dependent on Sakic and Forsberg.<br /><br />
Was Mats Sundin a poor performer on the power play, or was he merely a victim of a poor special teams unit in Toronto? It's probably at least a bit of both. Sundin apparently wasn't good enough to singlehandedly lift his team's unit above average, but he did score 47 points with the man advantage with Quebec in 1992-93 as a member of a standout PP lineup also consisting of Sakic and Steve Duchesne. Sundin also saw his rate jump in 2002-03 to 5.1 PPP/60 after several seasons in a row in the 3s or low 4s. Over the remainder of his career Sundin never again dropped below 5.2. </span></span><span style="background-color: white;"><span style="background-color: white;">Maybe he finally figured out how to score </span></span><span style="background-color: white;">as a 31-year old, or maybe adding teammates like Nolan, Mogilny and Nieuwendyk had an impact and helped boost Sundin's scoring statistics.</span><span style="background-color: white;"><br /></span><br />
<span style="background-color: white;">It is interesting to compare the power play numbers for Sundin's Maple Leafs with Brendan Shanahan's Detroit Red Wings during the same period (1998 to 2004). Putting the top 10 in power play goals for each team side by side really illustrates the difference in quality, and does seem to suggest that Sundin would have most likely been able to rack up a lot more points if he had better teammates to share the load with the man advantage.</span><br />
<span style="background-color: white;"><span style="background-color: white;">
<br />
<span style="background-color: white;">Detroit Red Wings, Power Play Goals ('98-04):</span><br />
<span style="background-color: white;"></span><br />
1. Brendan Shanahan, 81<br />
2. Steve Yzerman, 52<br />
3. Nicklas Lidstrom, 46<br />
4. Sergei Fedorov, 46<br />
5. Tomas Holmstrom, 43<br />
6. Brett Hull, 29<br />
7. Martin Lapointe, 25<br />
8. Igor Larionov, 21<br />
9. Vyacheslav Kozlov, 20<br />
10. Luc Robitaille, 16<br />
<br />
Toronto Maple Leafs, <span style="background-color: white;">Power Play Goals ('98-04):</span><br /><br />
1. Mats Sundin, 69<br />
2. Gary Roberts, 28<br />
3. Sergei Berezin, 27<br />
4. Bryan McCabe, 22<br />
5. Steve Thomas, 21<br />
6. Darcy Tucker, 21<br />
7. Jonas Hoglund, 17<br />
8. Igor Korolev, 14<br />
8. Alexander Mogilny, 14<br />
10. Mikael Renberg, 13<br />
<br />I think Sundin was disadvantaged by team factors, particularly from 1997 to 2002, which also happens to be his peak period of even strength scoring. As the team's best player he should shoulder some of the blame for Toronto being so mediocre with the man advantage, but results from earlier and later in his career show that when Sundin did have the good fortune to play together with star linemates then he was able to post better power play scoring numbers. Pumping up his PP scoring stats could have moved Sundin from the 75-85 point range to a consistent 90+, which would have made him a more significant factor in the overall scoring race and in turn would have seen him viewed in a much more positive light today.</span></span><br />
<span style="background-color: white;"><br /></span><span style="background-color: white;">One final stat to compare Sundin and Shanahan: In the 18 seasons where both of them played in the NHL, Shanahan scored more even strength points than Sundin only twice. I'd take Sundin over Shanny every single time, and I think he's a deserving first ballot Hall of Famer.</span></div>
<span style="background-color: white;">
</span>The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com34tag:blogger.com,1999:blog-8148461224473220694.post-67799767053310958622012-06-06T15:24:00.000-04:002012-06-06T15:24:02.442-04:00Darryl Sutter and Goaltending<div>
Darryl Sutter is getting a lot of credit for his impact on the Los Angeles Kings this season, which is perhaps not too surprising given that the team was 15-14-4 prior to his hire and 40-15-11 since, playoffs included. Jon Quick is all over the headlines for his ridiculous postseason numbers, and certainly much of that is deserved, but there is also some historical evidence that suggests Sutter may be in the class of coaches that have a positive impact on the statistics of their goaltenders.<br />
<br />
Throughout his career, Sutter's goaltenders have routinely been above average. Sutter-led teams have only posted a below-average save percentage in two out of his dozen seasons as an NHL coach, and in every one of the remaining ten his team was at least .006 above the league benchmark in save rate:</div>
<div>
<br /></div>
1992-93: .901 in Chicago (.885 avg)<br />
<div>
1993-94: .902 in Chicago (.895 avg)</div>
<div>
1994-95: .907 in Chicago (.901 avg)</div>
<div>
1997-98: .896 in San Jose (.906 avg)</div>
<div>
1998-99: .915 in San Jose (.908 avg)</div>
<div>
1999-00: .911 in San Jose (.904 avg)</div>
<div>
2000-01: .914 in San Jose (.903 avg)</div>
<div>
2001-02: .918 in San Jose (.908 avg)</div>
<div>
2002-03: .897 in San Jose/Calgary (.909 avg)</div>
<div>
2003-04: .919 in Calgary (.911 avg)</div>
<div>
2005-06: .917 in Calgary (.901 avg)</div>
<div>
2011-12: .930 in Los Angeles (.914 avg)</div>
<div>
<br /></div>
<div>
Overall: .910 under Sutter, .903 league average</div>
<div>
<br /></div>
<div>
Sutter had Belfour for three seasons, Kiprusoff for two and Quick this past year, so he was partially lucky to benefit from some good goaltending. However, the numbers before and after he arrived in the different towns seem to suggest that there was a consistent save percentage effect as a result of Sutter's hiring. I looked at the full season prior to Sutter being hired and the full season after he was fired, with partial in-season results before he was hired/after he was fired also included in the before and after sample:</div>
<div>
<br /></div>
<div>
Chicago (before & after): 4352 SA, .898 save %, .893 average, +.005</div>
<div>
Chicago under Sutter: 5940 SA, .903 save %, .892 average, +.011</div>
<div>
<br /></div>
<div>
San Jose (before & after): 6434 SA, .906 save %, .908 average, -.002</div>
<div>
San Jose under Sutter: 11781 SA, .910 save %, .906 average, +.004</div>
<div>
<br /></div>
<div>
Calgary (before & after): 5738 SA, .909 save %, .907 average, +.002</div>
<div>
Calgary under Sutter: 5545 SA, .914 save %, .906 average, +.008</div>
<div>
<br /></div>
<div>
Los Angeles (before): 3258 SA, .917 save %, .913 average, +.004</div>
<div>
Los Angeles under Sutter: 1271 SA, .930 save %, .914 average, +.016</div>
<div>
<br /></div>
<div>
That's a consistent bump of .006 at each of Sutter's first three stops, with his L.A. numbers looking even better so far.<br />
<br />
I should point out however that selection bias probably has an impact here, given that teams with low save percentages would be more likely to fire coaches and hire replacements.<br />
<br />
Combined before sample: .901 save percentage, .905 league average, -.004<br />
Combined sample with Sutter: .910 save percentage, .903 league average, +.007<br />
Combined after sample: .914 save percentage, .906 league average, +.008<br />
<br />
Looking at it this way gives a potentially much less charitable interpretation of Sutter's true impact: Maybe he simply coached some good goalies and was the beneficiary of teams bouncing back from poor seasons. On the other hand, it does seem reasonable that the impact of a coach would continue in at least some fashion even after they leave town. If Sutter played a key role in developing young players or established a style of play that the team continued to use under his successor then he could be partially credited for some of those continuing effects.<br />
<br />
It is always important to take regression to the mean into account when evaluating coaches, or else guys hired by underachieving teams will look like heroes nearly every time as the team's results gradually change to more closely match their overall level of talent. Sutter is not a miracle worker, and I think that Jack Johnson for Jeff Carter trade had a larger impact on the Kings' amazing transformation into a playoff juggernaut than their mid-season coaching change. On the other hand, Los Angeles is certainly doing a great job of protecting their goaltender through great defensive play at the moment, and that reflects well on their head coach.<br />
<br />
In the competitive world of the NHL, slight edges can sometimes end up being important, and Sutter's coaching may just be providing Jonathan Quick the defensive advantage needed to help the Kings' goaltender complete his memorable season with a great postseason run that currently has him holding the highest official playoff save percentage of all-time among goalies that participated in more than one playoff round.</div>The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com24tag:blogger.com,1999:blog-8148461224473220694.post-15714126295567329262012-05-28T17:32:00.001-04:002012-05-28T17:32:23.936-04:00Shootout Records Don't Predict Playoff Success<div>
There was an interesting statistical pattern this year in the first round of the playoffs: Only one of the goalies on a winning team had a better shootout win/loss record this year than his counterpart on the losing team.</div>
<div>
<br /></div>
Rangers vs. Ottawa: Lundqvist 4-3, Anderson 6-1, Rangers win<br />
<div>
Boston vs. Washington: Thomas 7-1, Holtby 0-1, Caps win</div>
<div>
Florida vs. New Jersey: Theodore 4-7, Brodeur 7-2, Devils win</div>
<div>
Pittsburgh vs. Philadelphia: Fleury 9-2, Bryzgalov 3-5, Flyers win</div>
<div>
<br /></div>
<div>
Vancouver vs. Los Angeles: Luongo 6-6 (Schneider 2-1), Quick 6-8, Kings win</div>
<div>
St. Louis vs. San Jose: Halak 3-7 (Eliott 1-3), Niemi 8-4, Blues win</div>
<div>
Phoenix vs. Chicago: Smith 6-8, Crawford 6-4, Coyotes win</div>
<div>
Nashville vs. Detroit: Rinne 4-5, Howard 7-2, Predators win</div>
<div>
<br /></div>
<div>
Combined totals:</div>
<div>
Winning goalies: 34-42 in shootouts this year</div>
<div>
Losing goalies: 55-28 in shootouts this year<br />
<br />
This result was surely largely influenced by randomness, especially given that the trend somewhat reversed itself in subsequent rounds with Brodeur and the Devils continuing to win. However, some matchups probably looked closer than they were in the standings because the weaker team had the benefit of a regular season shootout edge. The Flyers, for example, would have had a better record than the Penguins if all shootouts were counted as ties (although the Penguins' goal differential advantage indicates that Pittsburgh probably still should have been a slight favourite in that series).<br />
<br />
The shootout looks like it is here to stay in the NHL, but it does still seem unfair that it has an impact on the regular season standings that are used to determine playoff seedings. When comparing two teams to make predictions for a playoff series, shootout results should obviously be disregarded. That said, regular season records aren't even the best way to predict which playoff teams to bet on anyway (as the Kings and Devils are currently demonstrating), with metrics such as score-tied Fenwick and goal differential showing more predictive power anyway.</div>The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com15tag:blogger.com,1999:blog-8148461224473220694.post-82644557707386543562012-05-22T11:08:00.000-04:002012-05-22T11:08:12.839-04:00Mike Smith: Good Season or Good Goalie?<b>Case A: 2011-12 Was A Fluke Season</b><br />
<br />
The fact that goalie results are heavily influenced by randomness and have a lot of variance from year-to-year has been clearly established by statistical analysis. It would be very unlikely for an ordinary starting goalie to hit .930 just by luck, but it is not beyond the realm of possibility. If the goalie is perhaps slightly above-average and aided by some relevant team factors then that explanation becomes a lot more compelling. The sudden massive improvement in numbers for Mike Smith makes it reasonable to question where his true talent lies. After all, it is not very often that a 30-year old goalie is able to bump up his career save percentage by .008 in the course of a single season.<br />
<br />
The most commonly advanced argument by those seeking to downgrade Mike Smith is the team argument that claims that Dave Tippett is a defensive genius that helps all goaltenders succeed in Phoenix. It's generally a good idea to be skeptical of shot quality arguments, but on the other hand there are three goalies now that have superior numbers under Tippett then they managed everywhere else since the lockout (regular season and playoffs combined):<br />
<br />
Ilya Bryzgalov:<br />
Without Tippett: 7517 SA, .911<br />
With Tippett: 4481 SA, .919<br />
<br />
Jason LaBarbera:<br />
Without Tippett: 2703 SA, .905<br />
With Tippett: 1474 SA, .916<br />
<br />
Mike Smith:<br />
Without Tippett: 4430 SA, .907<br />
With Tippett: 2617 SA, .934<br />
<br />
It is probably also worth noting that Smith played in the Pacific Division, a division that had a <a href="http://brodeurisafraud.blogspot.ca/2012/04/why-lundqvist-should-win-vezina.html">higher average save percentage than any other division</a> in the league. Part of that is surely because the Pacific has some great, top-flight goalies, but the league-leading number was also likely influenced at least to some degree by the tight style of play that is more typical for teams on the West Coast.<br />
<br />
In the playoffs and regular season combined this year, Smith has faced just 15% of his shots against on the penalty kill. Throughout the rest of his career his average was 19% (although part of the decrease was because penalties were down in 2011-12). Smith also posted a .909 save percentage on the PK, which vastly surpasses his previous career PK rate of .874. This year was only the second time in his career that Smith's PK rate even went above .880.<br />
<br />
If Smith had faced 19% of his shots against on the PK with a PK save percentage of .880, his seasonal save percentage would have dropped .006 to .924. Assuming that Phoenix has some additional shot quality effect at even strength relative to the rest of the league, he may only have played at a level of around .920 in a neutral team situation. Obviously Smith had a terrific campaign, but perhaps those potential team factors caused some skeptical GMs around the league to drop him out of the top three in Vezina voting, even though his numbers suggest he probably deserved that ranking (Smith led the league in <a href="http://hockeyprospectus.com/sortable/">GVT</a>, a measure that historically <a href="http://brodeurisafraud.blogspot.com/2012/01/vezina-trends.html">tracks very well with Vezina winners</a>).<br />
<br />
One large negative indicator for Mike Smith heading into this season is that he had an extreme home/road split. Prior to this year he had a career save percentage of .918 at home compared to just .896 on the road. That's usually not a good sign, given that road save percentages are subject to less potential scorer bias since they are spread across a number of different arenas. This year, Smith's degree of improvement on the road (+.030 to .926) was almost twice as much as the increase in his home save percentage (+.016 to .934). It is perhaps interesting to note that both LaBarbera (.922 on the road) and Bryzgalov (.921) have excellent road numbers under Tippett in Phoenix (both actually did better away from home than they did in Glendale). Phoenix has also finished in the top eight in road record in each of the past three seasons, despite finishing 16th in points at home this season for the second year in a row.<br />
<br />
To summarize, Smith's track record doesn't support anything close to a season of 67 GP at .930, and there is evidence that suggests Phoenix may be a place that helps its goalies out a bit. As a result, Smith is probably headed for a major regression in his numbers for 2012-13.<br />
<b><br /></b><br />
<b>Case B: Mike Smith Is A Good Goalie</b><br />
<br />
Smith has been very impressive in the playoffs, causing some to argue that his game has developed and he is in the process of joining the game's goaltending elite. The caveat is that subjective arguments are affected by all kinds of observer biases, and sometimes it is hard to differentiate between a good goalie and a lucky goalie or a hot goalie, but Smith's numbers have been so outstanding that it is likely they do represent a significant improvement, even taking into account some of the other factors that may be in play.<br />
<br />
One of the biggest question marks in evaluating Mike Smith is determining how much of an impact the concussion he suffered late in 2008 had on his career development. It's certainly possible to make the numbers fit a narrative that portrays Smith as a promising goalie early in his career before he was brought low by a concussion, and that it shouldn't be that surprising that Smith has blossomed into a quality NHL starter now that he has fully recovered.<br />
<br />
Smith was concussed in <a href="http://www.tampabay.com/sports/hockey/lightning/article974938.ece">December 2008</a>. His career save percentage as of December 31, 2008 was .913, which is very strong taking into account the league average of .907 from 2007 to 2009. Smith's 2008-09 season on a really bad Tampa team looks quite impressive in retrospect. The Lightning fired Barry Melrose in mid-season, ended up second last overall, and went 10-22-9 with a 3.62 GAA with their backup goalies in the net (Smith himself was 14-18-9 and 2.62). Unfortunately Smith's campaign was cut short by his concussion symptoms.<br />
<br />
How much did the effects of his head injury affect Smith in 2009-10 and 2010-11? It's difficult to tell, particularly because he faced a relatively small sample size of 1600 shots. In 2010-11 he would likely have been much closer to full recovery, but rarely played in a backup role behind Dwayne Roloson. Smith's combined numbers for those two seasons, together with January 2009 when he was playing with concussion symptoms before getting shut down for the year, come to .899 on 2096 SA, which is well below where he was prior to the injury.<br />
<br />
Smith have simply have been somewhat lucky early in his career and then unlucky later on, we've seen that happen many times over a couple of 2000 shot samples. However, it is also entirely possible that his injury had a major impact on his results and that he has had above-average talent since the start of his career.<br />
<br />
It has been widely reported that Phoenix goalie coach Sean Burke wanted to bring in Mike Smith because Burke saw potential there. Maybe Burke was correct that Smith was a star in waiting, although a cautionary note is that those are the types of things that are easy to say in hindsight if you want to make a specific talent evaluator or coach look great, mainly because they don't account for any of the misses (if Smith didn't work out then nobody would be writing stories about how Sean Burke got it wrong).<br />
<br />
Smith's two-year, $4 million deal doesn't exactly suggest that Phoenix thought they were going to be getting Vezina-calibre goaltending, but at the same time with LaBarbera in the backup role and no real other options on the farm the Coyotes were clearly betting their season on Smith. If they didn't think he was going to be at least average it is questionable whether they would have made that move. Goalies don't always follow linear career paths, and maybe the change of scenery combined with coaching and his personal development helped Smith make the jump and join the games' elite.<br />
<br />
<div>
<b>Conclusion</b></div>
<div>
<br /></div>
<div>
It seems to be an absolute rock-solid bet that Mike Smith's numbers are going to regress next season, and that his true talent level doesn't quite measure up to the level of performance he has displayed this year. On the other hand, it seems clear that Smith's concussion had a negative impact on his career, and as a result his career numbers are at least somewhat understated.<br />
<br />
There is a chance that Smith is now one of the game's best goalies, and there is a chance that this was his career season. The most likely case is that Smith is not an elite goalie who can be counted on to remain near the top of the league year after year, but he may be an above-average starter who still has a number of useful years ahead of him. Smith is probably still a good candidate to put up another season of around .920 or maybe even a little better next year, given Phoenix's team discipline and the fact that he outperformed league average by .006 over a three season stretch earlier in his career when he was likely not as good as he is right now.</div>The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com33tag:blogger.com,1999:blog-8148461224473220694.post-38359321957370942162012-05-10T18:07:00.001-04:002012-05-10T18:07:56.231-04:00Understanding When to Make A Save"Goaltending in the playoffs so much is about when you give up goals, giving your team a chance to stay in a game when the momentum's going against you or when you've had it. Brian Elliott simply didn't do that...Conversely, Jonathan Quick, he was timely, he was strong on his game. The St Louis Blues scored six goals in this series on Jonathan Quick, largely due in part to him not only being a talented goaltender, but to being dialed in to the time of the game and understanding that a save needed to be made, he was there all the way through the series." (Craig Button, <a href="http://www.blogger.com/www.tsn.ca">TSN panel</a>)<br />
<br />
I'm pretty sure that Jonathan Quick probably does understand when a save needs to be made a lot better than Craig Button does. If any goalie is in a position to realize the importance of every goal against, it is the backstop for a Los Angeles team that ranked 29th in the league in scoring and played in nine 1-0 games this season. Even with the Kings' improved playoff offence, it seems very unlikely that Quick was taking anything for granted. Obviously any goalie who allows just six goals against in four games is making a lot of saves, not just a lot of "timely" saves, and Quick has been great so far in these playoffs because he has stopped nearly everything that has been thrown at him.<br />
<br />
If you had to make a case for anything about the Kings being timely, it would be their scoring and possession game more so than their goaltending. Against St. Louis Quick was pretty great regardless of score, posting a save percentage of .947 or better during each of the key score differentials (down by 1, tied, leading by 1). The Kings' offence scored 1/4 (25%) while trailing by one, 6/33 (18.2%) while tied, and 3/35 (8.6%) when leading by one.<br />
<br />
Los Angeles was also dominant on the shot clock over the Blues with the score tied. In game one shots were 16-16 and goals were 1-1 with the game tied, and a strong effort from Quick was a big factor in the result. In games two through four, however, the Kings outshot St. Louis 17-6 and outscored them 5-0 with the score tied. To score almost as many goals as shots allowed is amazing. In addition, the average distance on those half-dozen shots against was 42.2 feet and probably only a couple of them could even be marked down as scoring chances.<br />
<br />
The biggest problem with Button's logic, though, is the implication that there is choice involved in goaltending. His absurd premise is that any goaltender can choose to stop any puck, if only they have the necessary clutchness or understanding of clutch play to know that it would be best for them to make that save, and that the difference between a goalie who performs well in a pressure situation and one that doesn't is merely a matter of knowledge or understanding. Anyone making that claim obviously doesn't understand how much making saves requires a netminder to play the percentages, particularly in today's NHL where key goals are often scored through screens or from deflections or on pucks ping-ponging around the crease or slot area.<br />
<br />
Even if goalies can increase their focus or energy level and actually boost their results (which is debatable), that still doesn't mean they have any chance at all at stopping a screened double-deflection into the top corner no matter how well they understand the delicate balance of momentum at that exact point in the game. It really doesn't take a mathematical background or a detailed knowledge of expected win probabilities to understand that goals against are a bad thing in close hockey games. That simple knowledge is surely the most basic of prerequisites to tend goal in the NHL, and it seems preposterous that it actually has an impact on the outcome of any games.The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com21tag:blogger.com,1999:blog-8148461224473220694.post-80922054263633200852012-04-26T11:35:00.000-04:002012-04-26T11:35:15.872-04:00Two of the Closest Series EverLast night's overtime victory by Washington completed what was likely the closest series in NHL history in terms of score. Not only was every game decided by a single goal, but 99.4% of the entire series was played with a goal differential of one or less. The only time either team managed to take a two goal lead over the seven games was when Jay Beagle scored in the second period of game five to put the Caps up 2-0, a margin that lasted less than three minutes before the Bruins cut it to 2-1.<br />
<br />
The West had a matchup that was also a strong contender for the title of closest ever right up until the final period of the series. Phoenix and Chicago went to overtime in each of the first five games of the series, and by the time of the second intermission in game six had spent 99.3% of their series tied or with one of the teams leading by a lone goal. However, in that final period Phoenix finally broke through and pulled away for a decisive 4-0 win.<br />
<br />
I thought it would be interesting to look at numbers broken down by score in these two series to see why they were so tight.<br />
<br />
Boston vs. Washington:<br />
<br />
Washington Up One:<br />
Shots: Washington 30, Boston 72<br />
Goals: Washington 1, Boston 7<br />
Save %: Holtby .903, Thomas .967<br />
<br />
Score Tied:<br />
Shots: Washington 145, Boston 162<br />
Goals: Washington 11, Boston 7<br />
Save %: Holtby .957, Thomas .924<br />
<br />
Boston Up One:<br />
Shots: Washington 32, Boston 11<br />
Goals: Washington 4, Boston 0<br />
Save %: Holtby 1.000, Thomas .875<br />
<br />
There were major score effects during the series, as would be expected. Including the brief period when Boston was down by 2, the trailing team outshot the team in the lead by the whopping margin of 107-41 and scored 12 goals in just 141.7 minutes of play for an amazing rate of 5.08 goals per 60 minutes. The leading team managed just one goal (0.42 per 60), scoring on just 2.4% of their shots taken.<br />
<br />
It is typical that the trailing team generates more shot attempts, but usually their percentages drop as they put more pucks on the net and take more risks, leaving themselves open to chances going back the other way. For whatever reason both the Caps and Bruins were able to get away with almost everything in their own end when pushing for the tie.<br />
<br />
The overall shot statistics flatter the Bruins a bit because they spent more time trailing. Boston outshot Washington by 20% overall but by just 12% with the game tied. It was still a very close series, and Washington was pushed over the top by an impressive effort from rookie netminder Braden Holtby.<br />
<br />
The Chicago-Phoenix series was similarly close in terms of scores, but the underlying numbers suggest that balance of play wasn't nearly as tight.<br />
<br />
Phoenix vs. Chicago:<br />
<br />
Phoenix Up Two Goals or More:<br />
Shots: Phoenix 11, Chicago 11<br />
Goals: Phoenix 2, Chicago 1<br />
Save %: Smith .909, Crawford .818<br />
<br />
Phoenix Up One:<br />
Shots: Phoenix 40, Chicago 76<br />
Goals: Phoenix 2, Chicago 5<br />
Save %: Smith .934, Crawford .950<br />
<br />
Game Tied:<br />
Shots: Phoenix 73, Chicago 124<br />
Goals: Phoenix 9, Chicago 6<br />
Save %: Smith .952, Crawford .877<br />
<br />
Chicago Up One:<br />
Shots: Phoenix 35, Chicago 30<br />
Goals: Phoenix 4, Chicago 0<br />
Save %: Smith 1.000, Crawford .886<br />
<br />
In this series the Blackhawks outshot the Coyotes by 51% overall, and an impressive 70% with the game tied, yet somehow managed to get outscored 17-12 over the course of six games, as well 9-6 in tie-game situations. The strong goaltending of Mike Smith compared to the inconsistent play of Corey Crawford was the decisive factor in the series.<br />
<br />
Smith was particularly strong in game six, a game where everything was massively tilted in favour of Chicago except for the scoreboard. I also found it interesting that Smith had the highest save percentage of any of the four goaltenders while his team held a one goal lead, which was perhaps unexpected given that the Blackhawks fought back three times to tie the game late in the third period. Several posters in this <a href="http://hfboards.hockeysfuture.com/showthread.php?t=1176251">HFBoards thread</a> specifically downgrade Smith's first-round performance because of his supposed lack of clutch play in allowing late game-tying goals, but to me that's making the classic mistake of evaluating playoff performance: Letting a few memorable events have too much influence while failing to properly appreciate the larger picture.<br />
<br />
For the sake of comparison, Braden Holtby gave up a lead in five out of seven games, including twice in the third period, yet nobody would call him unclutch. Allowing goals against in the final 10 seconds obviously has a huge negative impact on a team's win probability, but when 99% of the series is within one goal then every goal against has a major impact on the chance of victory. Other than one third period in Chicago, pretty much every situation these four goalies have faced so far in the 2012 playoffs was a clutch situation.<br />
<br />
Just as with Washington and Boston, the trailing team rode both a large outshooting advantage and insanely high percentages. Overall, shots were 122-81 in favour of the team playing catch-up, with turned into a 10-4 advantage on the scoreboard. That works out to a rate of 3.16 goals per minute for the trailing team, compared to just 1.26 for the team holding on to a lead.<br />
<br />
In some respects it is amazing that Chicago even came as close to winning the series as they did, given that Phoenix's scoring rate per shot was over twice as high. The repeated late-game comebacks to force OT kept them in it, but unfortunately the goaltending disparity was perhaps never more apparent than in extra time where Smith managed a .923 save percentage while Crawford put up a mere .813 and let in two very soft goals to help the Coyotes to the franchise's first second round appearance since 1987.<br />
<br />
It would be interesting to see detailed scoring chance numbers or a breakdown of odd-man rush chances to see whether the leading teams were generating chances and just missing their shots, or whether their defensive focus meant they were not creating many dangerous opportunities to score. In the absence of compelling evidence, however, I'd guess it was mainly a tremendous run of hot goaltending that kept the scores close (in both series combined, goalies on teams trailing by one stopped 97.3% of the shots against) and created 13 games of razor-thin margins in these two memorable series.The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com13tag:blogger.com,1999:blog-8148461224473220694.post-23416897261373612102012-04-15T11:30:00.000-04:002012-04-15T11:52:45.318-04:00Sitting on a Lead Isn't Working in 2012<div>Fifteen games in, the story of the 2012 playoffs so far has been third-period comebacks. Twelve out of 15 games have featured a one goal lead at some point in the third period, and in seven of those twelve games the trailing team fought back to tie. <span style="font-size: 100%; ">Five times the team that was trailing eventually ended up winning the game, four times in overtime and once in regulation (the Flyers' roller coaster 8-5 win over the Penguins on Friday night).</span></div><div><br /></div><div>I would have guessed that the trailing teams were riding very high percentages to be able to put up those kind of results, but that's not actually the case. Both the leading and trailing teams so far have shot 8.0% in the third period with one team up a goal, although the leading teams' numbers are slightly inflated because of empty netters (the shooting percentage with a goalie in the net for teams up by one is 6.1%). The primary reason for all the comebacks is that the trailing teams have been absolutely dominant in terms of possession, outshooting the opposition 88-49. That is a rate of 39-22 per 60 minutes of play.</div><div><br /></div><div>It is normal for teams to play to the score. According to <a href="http://behindthenet.ca/fenwick_2011.php?sort=4&section=down1">Behind the Net's stats</a>, t<span style="font-size: 100%; ">he Nashville Predators were the only team in the league this season that did not have over 50% of the Fenwick events while trailing by a goal, and teams down by one had an outshooting advantage of 29.6 to 24.5 per 60 minutes. Those numbers include results from the whole game, and would likely show a greater split for third period results only (some of my past findings indicate that the shot rate <a href="http://brodeurisafraud.blogspot.com/2009/01/third-period-updated.html">skews even more</a> in the third period alone).</span></div><div><span style="font-size: 100%; "><br /></span></div><div><span style="font-size: 100%; ">Despite generating more shots, however, the trailing teams were actually outscored during the regular season (2.54 to 2.43 per 60 minutes), which indicates that playing to the score was the right move for teams holding a late lead. It probably should be noted though that in a regular season sample team strength might also be a factor, given that the better teams would be more likely to spend time in the lead than the league doormats, whereas the playoffs do not have the same broad range of team quality.</span></div><div><br /></div><div>The regular season results give a trailing team shooting percentage of 8.2%, very close to the 2012 playoff numbers. During the regular season the numbers for the leading team went up to 10.4%, which indicates that the comeback teams in this year's playoffs have probably been a bit lucky or had their comebacks enabled by strong goaltending in the third period. That said, even if the leading teams' percentages rise as the playoffs go on, there will still be a lot of comebacks as long as the shot ratio remains in the vicinity of 2-to-1 in favour of the trailing teams.</div><div><br /></div><div>Utilizing a collapsing defence to preserve a late lead is the best strategy in some cases, but some teams (Pittsburgh and Phoenix, perhaps?) are probably currently reviewing their game tape to determine whether their late-game play is doing more to help them than to hurt them. You can trade quantity for quality in terms of chances against, but if the quantity gets too high than some pucks are going to go in anyway and the strategy is no longer optimal. It will be interesting to see whether teams can improve their ability to hang on to late leads or whether the comebacks will continue in 2012.</div>The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com6tag:blogger.com,1999:blog-8148461224473220694.post-35244991191103759312012-04-12T10:30:00.002-04:002012-04-12T10:41:38.194-04:00One of These Does Not Belong...<table><tbody><tr><td><b>Goalie</b></td><td><b>Sv%</b></td><td><b>Max</b></td><td><b>Min</b></td><td><b>Avg</b></td><td><b>PO Tms</b></td></tr><tr><td>M. Smith</td><td>.930</td><td>.974</td><td>.851</td><td>.926</td><td>.936</td></tr><tr><td>J. Quick</td><td>.929</td><td>.963</td><td>.881</td><td>.927</td><td>.930</td></tr><tr><td>J. Halak</td><td>.926</td><td>.963</td><td>.856</td><td>.931</td><td>.937</td></tr><tr><td>P. Rinne</td><td>.923</td><td>.960</td><td>.880</td><td>.921</td><td>.919</td></tr><tr><td>J. Howard</td><td>.920</td><td>.940</td><td>.881</td><td>.919</td><td>.919</td></tr><tr><td>R. Luongo</td><td>.919</td><td>.949</td><td>.869</td><td>.920</td><td>.930</td></tr><tr><td>A. Niemi</td><td>.915</td><td>.950</td><td>.863</td><td>.914</td><td>.915</td></tr><tr><td>C. Crawford</td><td>.903</td><td>.931</td><td>.867</td><td>.901</td><td>.896</td></tr></tbody></table><br /><span style="font-size: 100%; ">Sv% is total save percentage, Max and Min are each goalie's best save percentage marks over seven consecutive games during the 2011-12 season, Avg is the goalie's average save percentage per 7 game stretch (naturally, this metric will track very closely with the overall save rate), and PO Tms is each goalie's combined save percentage against the other 7 Western Conference playoff teams.</span><br /><div style="font-weight: normal; "><span><br /></span></div><div style="font-weight: normal; "><span>The obvious takeaway is that there is some really good puckstoppers out West, with six teams possessing demonstrably above-average goaltending. That leaves just the San Jose Sharks with the very average Antti Niemi, and the Chicago Blackhawks, who look to be the one team in the Western Conference that is in a substantial amount of trouble in goal heading into the playoffs.</span></div><div style="font-weight: normal; "><span><br /></span></div><div style="font-weight: normal; "><span>In a previous post, I pointed out that a typical Cup winning goaltender needs to put together a streak of approximately <a href="http://brodeurisafraud.blogspot.ca/2011/12/good-enough-to-win.html">.930 over 600 shots</a>. This season Crawford barely even managed to hit that during his best seven game stretch. His highest mark over 20 consecutive games was only .912. </span><span>If the playoff version of Corey Crawford is the same one that showed up during the regular season, it is very unlikely that Chicago will get the percentages needed to overcome four straight difficult opponents and end up with a Stanley Cup. Chicago did manage to win the 2010 Cup despite Antti Niemi's mediocre .910 save percentage, but most observers would agree that version of the Hawks with multiple star players on ELCs was stacked compared to this year's roster.</span></div><div style="font-weight: normal; "><span style="font-family: Georgia, serif; "><br /></span></div><div style="font-weight: normal; "><span style="font-family: Georgia, serif; ">That said, all hope is not lost for Blackhawks fans. Despite Crawford's mediocre play, Chicago still managed to go 13-10-3 against the other seven Western Conference playoff teams with him in net. That was still the second-worst record of any of the eight expected playoff starters (ahead of only Niemi), but it was not far behind most of the other teams as only Smith and Luongo managed to post a win percentage of .600 or better against that tough slate of opposition. Chicago has a very good team in front of Crawford, especially if captain Jonathan Toews is able to get back into the lineup and contribute at his usual level. </span><span style="font-family: Georgia, serif; ">In score-close Fenwick, one of the best measures of overall team strength, Chicago ranked</span><span style="font-family: Georgia, serif; "> </span><a href="http://behindthenet.ca/fenwick_2011.php?sort=6&section=close" style="font-family: Georgia, serif; ">5th in the league</a><span style="font-family: Georgia, serif; ">.</span></div><div style="font-weight: normal; "><span style="font-family: Georgia, serif; "><br /></span></div><div style="font-weight: normal; "><span style="font-family: Georgia, serif; ">The other thing to keep in mind is that Crawford acquitted himself quite well in the first round against Vancouver last year and had a much better overall season in 2010-11. Perhaps Crawford's true ability is closer to the .918 he managed in the 2010-11 regular season and playoffs combined than this year's .903, which would make him far more likely to be able to deliver Cup-calibre goaltending over the next two months.</span></div><div style="font-weight: normal; "><span style="font-family: Georgia, serif; "><br /></span></div><div style="font-weight: normal; "><span style="font-family: Georgia, serif; ">For what it is worth (probably not much), Crawford finished the season strong with a .921 and an 8-2-1 record over the last two months, including six wins over playoff teams, although Chicago's offensive output of 32 goals in the 11 games and stingy shot prevention of 23.5 SA/60 obviously also played a major role in that recent success.</span></div><div style="font-weight: normal; "><span style="font-family: Georgia, serif; "><br /></span></div><div style="font-weight: normal; "><span>The Western Conference playoffs are as usual going to be a grind filled with tight games where hot goaltending can make a difference. The Blackhawks have a strong team that could be a contender, except for the question mark related to the fact that their goaltending this season has been well behind the rest of the teams in the mix out West. I</span><span style="font-family: Georgia, serif; ">t seems safe to say that the pressure is on firmly on the shoulders of Corey Crawford because Chicago will likely need much better goaltending than they have been given so far in 2011-12 to be able to put together another Cup run.</span></div>The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com5tag:blogger.com,1999:blog-8148461224473220694.post-82168014226842953982012-04-10T11:50:00.000-04:002012-04-10T11:50:01.014-04:00Why Lundqvist Should Win the VezinaEven Strength Save Percentage in 2011-12 by Division:<div><br /></div><div>1. Northwest, .925</div><div>2. Pacific, .925</div><div>3. Central, .923</div><div>4. Northeast, .919</div><div>5. Southeast, .917</div><div>6. Atlantic, .916</div><div><br /></div><div>Quick and Lundqvist ended up with almost identical situational save percentage stats (both .933 at even strength, with Quick just slightly ahead on the penalty kill .908 to .905). The Kings faced a higher percentage of shots against on the PK, which caused Lundqvist to slightly edge out Quick in terms of overall save percentage by the narrow margin of .001. <span style="font-size: 100%; ">The closeness of those results, combined with Quick's extra workload and the Kings' late-season playoff charge, has made Quick a recent trendy Vezina pick, an impressive comeback given that it looked like Lundqvist had the award sewn up by the All-Star break.</span></div><div><span style="font-size: 100%; "><br /></span></div><div><span style="font-size: 100%; ">Assuming both goalies were competing in the same environment, it would indeed be very difficult to separate them by the numbers. However, i</span><span style="font-size: 100%; ">f each goalie's numbers are adjusted relative to their individual conferences, then Lundqvist opens up a decisive edge over Quick:</span></div><div><br /></div><div>Conference-adjusted situational save percentages:</div><div><br /></div><div>Quick: .930 EV, .907 PK, .941 PP</div><div>Lundqvist: .936 EV, .906 PK, .974 PP</div><div><br /></div><div>Multiplying those out by the league-wide average frequency of shots against in each situation, Lundqvist ends up with a conference and situationally adjusted save percentage of .932 compared to .927 for Quick.</div><div><br /></div><div>Another option would be to adjust each goalie's numbers relative to their division, although in that case the much smaller samples means it would be important to remove each goalie's results from the overall numbers (i.e. the Pacific without Quick and the Atlantic minus Lundqvist). That calculation only increases the margin in favour of Lundqvist, given that his .933 looks much more impressive when stacked up against the combined .912 put up by the rest of the Atlantic division, with the other netminders in the Pacific still combining for an above-average .924 mark even without the contributions of that division's Vezina candidate. Using the divisional numbers and the same correction for shots against by situation, Lundqvist's adjusted number moves well ahead of Quick .935 to .927.</div><div><br /></div><div>To me, anything close to a tie suggests Lundqvist should win because his elite track record means that it is much less likely that his terrific season was based on luck or other secondary factors. I would pick Lundqvist even assuming that both goalies faced identical shots against for this reason alone. Adjusting for the east/west disparity only makes the choice that much more obvious, in my opinion.</div><div><br /></div><div>Relying on historical records to evaluate a single season of goaltending is somewhat <span style="font-size: 100%; ">unfair to the goalie who is four years younger, but it is simply the reality of dealing with uncertainty in goalie evaluation (and why I don't think <a href="http://brodeurisafraud.blogspot.com/2012/02/why-counting-trophies-method-of-goalie.html">single-season awards</a> are all that significant). This was Lundqvist's third season in a row at .920 or better while Quick's previous career best was .918. Future years may well prove that Quick's true talent is in the mid- to upper-.920s, but as of right now that's probably not the smart way to bet.</span></div><div><br /></div><div>Another relevant piece of statistical info is that Quick's numbers were much better at home (.936 at home compared to .922 on the road), whereas Lundqvist's numbers were higher away from home (.934) than at MSG (.926). That doesn't necessarily mean much, variance is naturally going to be higher over 900 shot samples than over full-season results, but since road numbers are counted by a variety of different scorers they are less likely to be subject to bias. It is also worth noting because b<span style="font-size: 100%; ">oth goalies have been pretty consistent on the road over the last three seasons, with Lundqvist maintaining a steady .011-.013 gap over Quick:</span></div><div><br /></div><div><div>Quick: .915, .916, .922</div><div>Lundqvist: .926, .929, .934</div></div><div><br /></div><div>This year Quick's home numbers shot up while Lundqvist's improved slightly. Again that could be reflective of improved play for both goalies, but it could also be partially related to shot counting or team factors. The other interesting thing to note is that this is the third straight year that Lundqvist's save numbers have been better on the road. MSG is known for poor stat recording in general and it is possible that his numbers are being at least partially suppressed at home, especially given that Lundqvist <span style="font-size: 100%; ">faced </span><span style="font-size: 100%; ">an average of 5.6 more shots against per 60 minutes on the road compared to at home in 2011-12, coming on the heels of a 6.0 difference in 2010-11.</span></div><div><span style="font-size: 100%; "><br /></span></div><div><span style="font-size: 100%; ">On the other hand, Quick's shots against rates were 26.5 at home compared to 28.0 on the road in 2011-12. His shots against rate at home has actually increased in each of the last three seasons, at the same time as his road shots against rate has been continually decreasing. That's not the typical statistical profile of a goalie being disadvantaged by his home scorekeeper. </span><span style="font-size: 100%; ">Overall, the home/road numbers are </span><span style="font-size: 100%; ">just one more reason to be a bit more confident in the Swede than in the American.</span></div><div><br /></div><div><span style="font-size: 100%; ">Taking their histories into account along with </span><span style="font-size: 100%; ">the conference disparity, </span><span style="font-size: 100%; ">I think Henrik Lundqvist deserves to win his first best goalie award. </span><span style="font-size: 100%; ">It could be argued that the shot quality allowed by the Rangers was not typical of the rest of the Atlantic Division, or that goaltending in the Western Conference in general or the Pacific Division specifically was simply a whole lot better than it was out East, either of which would mean that the adjustments above are unfair to Quick. I would certainly listen to anybody willing to make those arguments, but right now I don't see enough supporting evidence on the table. Shot quality arguments are always particularly murky because of the lack of good data, and subjective comparisons are very difficult, particularly for two teams in opposing conferences.</span></div><div><br /></div><div>As an aside, this season has made me wonder at times whether we can continue to rely on the general assumption that <a href="http://brodeurisafraud.blogspot.com/2009/07/demise-of-even-strength-shot-quality.html">EV shot quality is relatively constant</a> between teams. The two major pieces of evidence in that direction are probably <span style="font-size: 100%; ">St. Louis' 2011-12 goalie stats and the conference splits displayed above. </span><span style="font-size: 100%; ">In the aggregate I think 5 on 5 shot quality is still probably not all that important for most of the league, but if there </span><span style="font-size: 100%; ">are some significant effects on the margins that would be important to know for goalie evaluation.</span></div>The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com7tag:blogger.com,1999:blog-8148461224473220694.post-75790519374313018252012-03-22T07:00:00.001-04:002012-03-22T07:00:13.459-04:00Ilya Bryzgalov and Regression<div><span style="font-size: 100%; ">Ilya Bryzgalov, first 27 games of 2011-12: .890</span></div><div>Ilya Bryzgalov, next 27 games of 2011-12: .929</div><div><br /></div><div>Ilya Bryzgalov, last 27 games of 2008-09: .898</div><div>Ilya Bryzgalov, first 27 games of 2009-10: .925</div><div><br /></div><div>It may still be too soon to proclaim that Ilya Bryzgalov is back in the kind of form that earned him a $51 million contract in Philadelphia, but the results have certainly turned around as of late for the Flyers' quirky netminder (8-1-1, 1.27, .955 so far in March).</div><div><br /></div><div><div>As I pointed out in my <a href="http://brodeurisafraud.blogspot.com/2011/12/value-of-quick-start.html">post on Jon Quick</a>, things that happen at the start of the season always seem to take on much greater significance. And when you have a slump in your first year in a new city that is notoriously tough on its goaltenders after signing a big-money contract in the off season and then end up increasing your exposure through a starring turn in HBO's 24/7 series, then any kind of early season struggles make it dead easy for sportswriters to start crafting narratives. There are all kinds of places to assign blame, from Bryzgalov's weak playoffs last year to his attitude and work ethic after signing his massive contract to his mental toughness and the pressure of the Philly market. It's possible to come up with all kinds of theories about the situation because while the performances were not up to par nobody knew for sure why exactly that was the case.</div><div><br /></div><div><span style="font-size: 100%; ">Is it possible that one of those things was affecting Bryzgalov? Probably, maybe even several of them at the same time. Insiders like <a href="http://www.cbc.ca/sports/hockey/opinion/2012/03/behind-bryzgalovs-bounce-back-30-thoughts.html">Elliotte Friedman</a> are most likely on the right track with some of the possible explanations for Bryzgalov's early-season play. Bryzgalov did look awful at times in games, worse than he did even when going through tough stretches in Phoenix, and it seems to be fairly unanimous within the team that he was struggling to cope with his greatly increased level of public exposure. At the same time, however, it is important to keep in mind the likely role of chance and variance in the goalie's results. As shown above, he has posted similar splits over a similar number of games before, even without the specific factors affecting his current season in Philly.</span></div><div><br /></div><div><span style="font-size: 100%; ">When a talented goalie goes into a slump, it can seem like they will never get out again. </span><span style="font-size: 100%; ">It's not always entirely bad luck, often they have to work on a few issues with their game or they have some off-ice problems, but with enough training and time those things are usually overcome and the goalie ends up returning to his elite form.</span></div></div><div><span style="font-size: 100%; "><br /></span></div><div><span style="font-size: 100%; ">That's why regression to the mean is always the way to bet. If it's simply a matter of luck, then that is going to even out over time as shooters will stop making their shots at an unusual rate. If the goalie has issues to fix, then in most cases he will put in the time and effort to deal with them. At the other end of the scale, if a goalie's style of play is unusually effective then the rest of the league will do their homework on them to try to take advantage of any weaknesses and drag them back towards the norm.</span></div><div><span style="font-size: 100%; "><br /></span></div><div><span style="font-size: 100%; ">Some have criticized stats guys' seemingly relentless focus on regression as removing the human variable and treating players like robots, but I think it is actually a natural consequence of human behaviour. </span><span style="font-size: 100%; ">When competition is involved, everyone copies everyone else and unsustainable advantages get erased fairly quickly. Those who excel may not always keep up the effort needed to separate them from the pack, while those who lag behind will often increase their intensity to try to make up ground. This is probably also one of the reasons why it is difficult to find persistent team advantages in terms of shot quality in today's NHL. A new system might initially work wonders but not once everyone else figures it out. </span><span style="font-size: 100%; ">In the long run, that often means there is not a lot of separation between the pack, especially when looking at a job like NHL starting goalie which only employs the top 30 best in the world at their craft.</span></div><div><br /></div><div>Extended slumps by top level goaltenders are not a rare phenomenon. Sometimes they appear to have an obvious cause and other times they do not. Pretty much every goalie will struggle through them over the course of their pro careers. <span style="font-size: 100%; ">A particularly good example is when Henrik Lundqvist, whose consistently elite track record stacks up among the best in the game, had a 33 game stretch at .888 in the middle of the 2007-08 season that ended with him finishing third in Vezina voting. Dominik Hasek also found himself below .900 twenty games into the 1997-98 season that concluded with a second straight Hart Trophy. The Dominator recorded an identical .945 save percentage in the twenty regular season games both immediately prior to and immediately following those brief early-season struggles.</span></div><div><br /></div><div>My philosophy is to deal with large sample sizes and bet on track record rather than recent form. Others prefer a "what-have-you-done-for-me-lately" approach that tries to take into account all kinds of other factors such as a goalie's mental state, his recent technical performance or the way the rest of the team has been performing. Both methods will get some right and some wrong, but I think the historical evidence suggests that betting on established talent over recent form is a far more successful method (just read <a href="http://www.arcticicehockey.com/">Arctic Ice Hockey</a>, Gabe Desjardins has been beating that drum for years). <a href="http://blogs.thescore.com/nhl/2012/03/16/messier%e2%80%99s-skates-regression-luck-and-transience/">Ellen Etchingham</a> also recently provided a great read on the subject of variance.</div><div><span style="font-size: 100%; "><br /></span></div><div><span style="font-size: 100%; ">Even if there was someone out there who could identify all of Bryzgalov's early-season technical flaws and could see between his ears well enough to perfectly measure how the pressure of his new environment would impact his play, they still might not do any better at predicting his next 27 games than somebody who simply knows that Bryzgalov is a .915 career goalie on 10,000+ shots. All Bryzgalov may need to do is tweak a few things in his game, change his mental approach, or have his team restructure some aspect of his environment and it might be enough to reset everything and put him back to his usual self, leaving that detailed analysis of his struggles pretty much obsolete.</span></div><div><span style="font-size: 100%; "><br /></span></div><div><span style="font-size: 100%; ">I don't mean to oversimplify the difficulty of fixing holes that have developed in your game, that is not always an easy process or something that happens overnight. And if you are the Philadelphia goalie coach, then obviously nothing is more important than diagnosing exactly what is going awry. But for proven talent, things usually end up working out in the long run, or at least until they hit the inevitable decline because of age or injuries.</span></div><div><span style="font-size: 100%; "><br /></span></div><div><span style="font-size: 100%; ">Bryzgalov is unquestionably a proven NHL talent, but while he has quieted the critics for the moment the playoffs are certainly going to be a pressure cooker where every small performance sample will be blown ridiculously out of proportion. Hopefully for him when those games roll around he will be closer to his March form than his level of play in October, or the media will no doubt be dusting off the exact same stories about his inability to handle the pressure of Philadelphia.</span></div>The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com9tag:blogger.com,1999:blog-8148461224473220694.post-4191506369167270682012-03-16T11:55:00.001-04:002012-03-16T11:58:27.853-04:00The Curse of ObamaIn the 20 games since the Boston Bruins' White House visit that Tim Thomas famously did not attend, the defending Vezina Trophy winner has gone 9-9-0 with a very uncharacteristic 3.07 GAA and .890 save percentage.<div><br /></div><div>That .890 would look ugly for pretty much any goalie in today's NHL, but it looks especially glaring for Thomas considering his excellence over the past three seasons. <span style="font-size: 100%; ">Going back to the start of 2008-09, Thomas' numbers have been consistently elite even when divided up into the relatively small sample size of 20 games (playoffs included):</span><div><div><br /></div><div>Nov '11-Jan '12: .935</div><div>May '11-Nov '11: .943</div><div>Mar '11-May '11: .929</div><div>Jan '11-Mar '11: .931</div><div>Nov '11-Jan '11: .939</div><div>Mar '10-Nov '11: .941</div><div>Dec '09-Mar '10: .911</div><div>May '09-Dec '09: .921</div><div>Feb '09-May '09: .936</div><div>Dec '08-Feb '09: .930</div><div>Oct '08-Dec '08: .937</div><div><br /></div><div>The .911 and .921 came in the latter half of 2009-10 when Thomas was limited by a hip injury. If that is enough to excuse those two results, it has been over three calendar years since a healthy Thomas had to endure a 20 game stretch below .929. And then he decided to skip a team event for personal reasons and everything fell apart.</div></div><div><br /></div><div>Obviously I don't actually think the flap surrounding Thomas and President Obama made any significant impact on his play, but there is no question that regression has hit the Bruins hard in net in 2012. Not only have Thomas' numbers nosedived, but <span style="font-size: 100%; ">Tuukka Rask is 0-3-1, 3.07, .886 since the All-Star break. The .940 team save percentage that the team was rocking early in the year was never going to hold up, but I didn't expect the wheels to come off this heavily either.</span></div><div><br /></div><div>At 37, Thomas is in the age range where performance levels can change pretty suddenly, and he has had a lot of recent mileage considering his workload this year combined his playoff run last season. Thomas is already in the top-10 all-time this year for games played by a 37-year old, and including playoffs only one goalie has ever played more games in his age 36 season than Thomas' 82 last year. That doesn't necessarily mean that an awful 20 game stretch is a sign of impending doom, but it's certainly something to keep an eye on. Thomas' recent form has to be at least somewhat concerning for Bruins fans with the playoffs just around the corner, <span style="font-size: 100%; ">given that elite goaltending has been a big part of the team's success over the past two seasons.</span></div></div>The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com17tag:blogger.com,1999:blog-8148461224473220694.post-58044643039148942992012-02-29T10:15:00.001-05:002012-02-29T10:17:40.548-05:00Why the Counting Trophies Method of Goalie Evaluation Is Flawed<div>One of the biggest problems with evaluating goalies by career value is that there aren't any good commonly-used counting statistics. A goalie's career line merely shows games played, wins, and shutouts, plus the rate stats of GAA and save percentage. Wins and shutouts are very heavily influenced by the rest of the team, with shutouts also varying widely depending on the level of league scoring. Games played is important in determining overall value, but does not take into account level of performance at all other than reflecting how long the netminder was able to convince an NHL team to keep giving them starts.</div><div><br /></div><div>There has been a shift towards a greater focus on save percentage, but as long as save percentage remains a rate stat it is difficult to understand intuitively whether a goalie with a higher save percentage but a lower workload is contributing more value than one of his peers with the opposite. There are a number of good ways to turn save percentage from a rate stat into a cumulative stat (typically by comparing to <a href="http://brodeurisafraud.blogspot.com/2008/10/save-percentage-vs-league-average.html">league average</a> or to replacement level and then multiplying by the shots against). <a href="http://www.hockeyprospectus.com/">Hockey Prospectus'</a> <a href="http://hockeyprospectus.com/sortable/">Goals Versus Threshold</a>, which is slightly more complex but based on a similar foundation, is a number that is recognized at least within the online hockey stats community, but there is not a widely accepted standard.</div><div><br /></div><div>As a shortcut, therefore, many people look at a goalie's trophy case, and use that to determine which netminder had the better career. Intuitively that makes sense, as when we evaluate athletes we want to know things like how many times they were considered the best in the league. However, I do not believe this is the best approach for evaluating NHL goaltenders.</div><div><br /></div><div>If somebody just sweeps the awards year after year, like Dominik Hasek did in the 1990s, then that is definitely showing something meaningful. Or when Glenn Hall kept getting voted ahead of other Hall of Famers while repeatedly overcoming the <a href="http://brodeurisafraud.blogspot.com/2009/09/dont-always-believe-your-lying-eyes.html">heavy bias towards the GAA leader</a>, that's also probably revealing something important about how his play was viewed by his contemporaries. But goalies with a handful of awards are exceedingly rare. When you are comparing two veteran goalies where one has a Vezina or a Smythe while the other one doesn't, I don't think that trophy really adds much information at all. Some trophy-focused individuals might, for example, try to argue that Miikka Kiprusoff's Vezina Trophy means he has had a better career than Roberto Luongo, even though the performance gap between them is likely at least 100 goals in Luongo's favour (Lou's career GVT is more than double Kipper's number).</div><div><br /></div><div>The problem with goalies is that one season is not a large enough sample to properly rate anybody, because results are not accurately tied to performance. Given that awards are handed out primarily based on results, this means that luck and team factors play a disproportionate role in winning awards for goalies.</div><div><br /></div><div>For a .914 goalie who faces 1800 shots in a season, the 95% confidence interval of his save percentage based on binomial probability would put his performance anywhere between .903 and .925. To prove that this is not just a theoretical exercise, we can just look at two goalies with .914 career save percentages: Ilya Bryzgalov and Ryan Miller. Both have a low mark of .906 as a starting goalie, and despite their strong career track records both have struggled for the majority of this season. Bryzgalov looks likely to set a new career low mark this year, although Miller looks to have turned things around as of late.</div><div><br /></div><div><span style="font-size: 100%; ">Their peaks, on the other hand, are much higher, with Bryzgalov hitting .921 last season and Miller topping out at .929 during his '09-10 Vezina season. Those ranges are in fact almost exactly what would be expected if their numbers varied by random chance alone. Between the two of them, their average high is .925 and if </span><span style="font-size: 100%; ">Bryzgalov ends up at his current .899 while Miller stays above .906 then their average low would be .903, which again would exactly match the predicted range given above.</span></div><div><br /></div><div>In addition to simple performance variation, a goalie's teammates could raise or lower his save percentage by up to about .005 or so depending on how many penalties they take and whether they are good at preventing shots against on the penalty kill. The official scorer in the goalie's home rink could also assist in cutting or boosting shot totals by a shot or so per game, which again could have an impact in the neighborhood of .005 compared to a goalie on the other end of the spectrum. And maybe a goalie plays for Ken Hitchcock or Jacques Lemaire and his team has a good year in front of him defensively in terms of reducing scoring chances, which could easily add another few thousandths to the final save percentage number.</div><div><br /></div><div>Over a career these effects often mostly wash out, as a goalie will benefit from them in some seasons and suffer because of them in others. But when looking at a single season, as is the case when considering awards nominations, these factors can further accentuate the already heavy effect of random chance.</div><div><br /></div><div>A goalie with at least a .920 save percentage over 1800 shots has about a 50% chance of being a Vezina nominee, based on seasonal results since the lockout. Bump that save percentage up to .925, and you probably have about a 50% chance of winning the trophy, given that half the goalies who met both cutoffs won the Vezina. Consider that binomial probabilities suggest that a goalie with league average talent will put up a .920 or better over 1800 shots 1 time out of every 5 just by chance, and you can see how it is entirely possible that a goalie who carves out a decent NHL career will probably luck into at least one good season somewhere along the line even before considering the other factors that could help his statistics. Fortunately there are selection effects that limit the number of flukes, since most average goalies won't be given that many starts by their teams, but it does still happen with some regularity.</div><div><br /></div><div>Whether a goaltender wins the Vezina or not depends not just on his own play, but also what other goalies are doing around the league. To return to the Luongo/Kiprusoff comparison above, it's easy to see the impact of external factors when you consider that if Martin Brodeur had his 2006-07 season in 2005-06 and vice versa, Luongo would be the guy with a trophy while Kiprusoff would have been shut out.</div><div><br /></div><div>It's not hard to find examples of goalies doing more or less the same thing year after year even as their voting numbers vary widely. Take Patrick Roy over the last five seasons of his career when he was the very picture of elite consistency, rattling off 61-63 starts per season, overall save percentage typically in the .915-.920 and EV SV% in the .925-.930 range and a GAA usually 2.20-2.30. In 2001-02, his numbers all improved a bit, particularly his GAA and shutouts, although his EV SV% was just .005 better than his five-year average. His team's improved shot prevention and penalty discipline helped as well. There's certainly a chance that Roy played better than normal in 2001-02, but there is also a pretty strong possibility that he was more or less the same goalie all the way through and the breaks went his way in '01-02.</div><div><br /></div><div>Over that period Roy typically got a few Vezina votes per season, until 2001-02 when he almost won the award. That year the high-minute goalies (Brodeur, Kolzig, et al) had down seasons, while Hasek was playing at a lower, <a href="http://brodeurisafraud.blogspot.com/2009/11/dominik-haseks-decline.html">post-injury</a> level. It turned out that only one starting goalie other than Roy posted a save percentage above .921.</div><div><br /></div><div>Unfortunately for Roy's trophy case, that goalie happened to be Jose Theodore, who put up a .931 save percentage on his way to the Vezina/Hart combo. If you look at Theodore's 2001-02 numbers in context, they are major outliers. He also had a bunch of the indicators of one-year flukes, including <a href="http://brodeurisafraud.blogspot.com/2010/05/special-teams-play-luck-or-skill.html">very high special teams numbers</a> and much better numbers at home than on the road.</div><div><br /></div><div>Knowing what we know now, it is very likely that Patrick Roy was a better goalie in '01-02 than Jose Theodore. That just wasn't immediately apparent from that 82 game sample, and that's why Theodore won the award. Using awards as the primary evaluation criteria, Theodore's first five seasons as a starter ranks ahead of Roy's last five seasons as a starter (unless you're one of those guys who thinks only the playoffs matter and you really love Roy's 2001 Cup/Smythe combo, and even in that case you'd probably give Roy just a slight edge), even though Roy's .929 EV SV% on 6165 SA is quite a bit better than Theodore's .921 on 6522 (about 50 goals better, or nearly two wins per season).</div><div><br /></div><div>In contrast, you won't find a skater win a scoring title primarily because of luck. Assume a typical first liner with 15 minutes per game at even strength and 3.5 minutes per game on the power play, who either doesn't play much on the PK or doesn't score any points when does get an occasional shorthanded shift. Let's say his team takes shots at an average rate while he is on the ice (27 shots per 60 at 5 on 5, 45 shots per 60 on the power play). That player and his linemates would need to put up a ridiculous shooting percentage, and he would have to be involved in an unusually high number of plays to get on the scoresheet enough to be in Art Ross contention.</div><div><br /></div><div>For example, if the player's team shot 13% at evens and 20% on the power play, both numbers above what any regular player managed last year, and got a point on 90% of his team's even strength goals and 75% of his team's power play goals, both extremely high and unusual participation percentages, the player would still end up with 97 points. That's a pretty high total and it would end up being near the very top of the league, especially this year, but it still isn't high enough for a top-3 finish in any of the post-lockout seasons. And again, this hypothetical player would need to get all the breaks just to get that close. If any of the luck factors drop off, then he's not in contention, and there are many ways that could happen (e.g. he misses a few games, his ice time decreases, his teammates don't score at a high rate, he gets unlucky with second assists or the power play runs more often through a teammate which reduces his scoring opportunities).</div><div><br /></div><div><a href="http://www.mc79hockey.com/?p=4301">Jordan Eberle is pretty much that guy</a> this year (at even strength his team is shooting 13% at even strength with him on the ice and he has points on 88% of his team's goals), and he's still tied for 10th in scoring. Joffrey Lupul is another guy that has flirted with the top of the scoring charts this season based on unsustainable percentages, and while he still sits just above Eberle in 9th it was always just a matter of time before he was going to left behind by the likes of Malkin, Stamkos and Giroux.</div><div><span style="font-size: 100%; "><br /></span></div><div><span style="font-size: 100%; ">Very high points finishes are meaningful because they are unlikely to be flukes. Pure trophy counting would still undervalue someone like Mats Sundin who was consistently productive although never near the very top of the league, but in general a player with a couple of high finishes can be considered to have had a better peak than a similar player who never climbed the table to the same degree (although of course context and team factors need to be taken into account).</span></div><div><br /></div><div>That doesn't happen to goalies. Flashes in the pan have won the Vezina, and average goalies have found themselves in trophy contention simply because fortune ended up favouring them over a 50-60 game stretch. Of course observers can sometimes identify when other factors or luck are at play; they don't always just follow the numbers to the exclusion of anything else. <span style="font-size: 100%; ">However, it is particularly difficult when rating a young goalie without much of a track record who has a big season. Is he breaking out, or is he getting lucky? Is he Pekka Rinne or Steve Mason? Only time will tell.</span></div><div><br /></div><div>It is my belief that goalies can only be properly evaluated in a multiple season context. With that in mind, single season awards should be considered relatively insignificant in terms of career evaluation.</div>The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com15tag:blogger.com,1999:blog-8148461224473220694.post-10981150201196890092012-02-24T14:05:00.001-05:002012-02-24T14:05:18.073-05:00Score One For the Kings<div><div>Los Angeles defencemen with at least 100 games played between 2007-08 to present, ranked by plus/minus rating per 82 games played:</div></div><div><br /></div><div>1. Sean O'Donnell, +8</div><div>2. Rob Scuderi, +6</div><div>3. Drew Doughty, +4</div><div><span style="font-size: 100%; ">4. Willie Mitchell, +4</span></div><div>5. Matt Greene, +2</div><div>6. Davis Drewiske, -3</div><div>7. Peter Harrold, -5</div><div>8. Jack Johnson, -21</div><div><br /></div><div>Obviously, <a href="http://www.coppernblue.com/2012/2/24/1892938/jack-johnson-is-not-good">Jack Johnson is not very good</a>, yet apparently he and a first round pick <a href="http://www.nhl.com/ice/news.htm?id=618589&navid=DL|NHL|home">are worth Jeff Carter</a>, a guy who scored more goals in the three seasons prior to this one than every player in the league save Ovechkin, Crosby, Stamkos and Marleau.</div><div><br /></div><div>Just as I prefer to look at multiple seasons' worth of data for goalies, I think there is at least some value in multiple years' worth of plus/minus given how the percentages tend to work themselves out over the larger sample, although obviously matchups and usage context are still important, especially for players utilized in a specific role.</div><div><br /></div><div>However, <span style="font-size: 100%; ">when you're supposed to be one of the best defencemen on your team and you're that much of an outlier in terms of getting outscored over a 338 game sample despite not playing tough minutes, it's pretty glaring. It's also very tough to make a linemates excuse given that Johnson had four </span><span style="font-size: 100%; ">different defencemen rank as his </span><a href="http://www.behindthenet.ca/nhl_time_on_ice_stats.php?ds=8&f1=2007_s&f2=5v5&f4=D&f5=L.A&c=0+1+3+5+8+7+9+10+11+12+13+14+15+16+17+18+19+20+21+22+23+24+25+26+27+28" style="font-size: 100%; ">highest defensive teammate TOI</a><span style="font-size: 100%; "> over that span, not to mention also having the benefit of playing more minutes with Anze Kopitar than any other Kings forward in four of the five seasons (it probably would have been all five if Kopitar played 82 games in 2010-11). At some point there's really nobody else left to blame. And the bad news for Blue Jackets fans is that their team is on the hook for paying Johnson $4.357 million per year through 2017-18.</span></div>The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com2tag:blogger.com,1999:blog-8148461224473220694.post-72997660934685738472012-02-10T10:30:00.000-05:002012-02-10T10:30:01.651-05:00The Hall of Fame Committee<div>I've often been critical of the decisions of NHL decision-makers in seasons past. But I have found myself being generally less and less critical of their moves and choices in recent seasons (and as my last post shows, it is clear that <a href="http://brodeurisafraud.blogspot.com/2012/01/vezina-trends.html">their perspectives have certainly changed</a> over time). I think NHL teams collectively have a much better sense of the value of goaltending and what makes a good goalie than ever before.</div><div><br /></div><div>I don't think the general managers from two decades ago were stupid. I do think quite a few of them were uninformed, unaware of the importance of objective analysis of goaltenders and focusing instead on the things that tradition dictated were important (like winning). I'm making that claim based on award voting and based on the number of bad goalies and washed-up veterans that kept getting NHL jobs long after they were deserving of them.</div><div><br /></div><div>The same logic applies to Hall of Fame voters. <span style="font-size: 100%; ">I've gotten into a few discussions about the Hall of Fame, both here and in other places, and when people ask me if I think certainly goalies will end up being elected, I generally say that I really don't know. I do know what kind of voting patterns have existed in the past, but I don't think that those historical rules remain valid given how perceptions have changed enough over the past two decades.</span></div><div><br /></div><div>Just because the voters may have overvalued Cups and wins in the past does not mean they are guaranteed to do so until the end of time. Some may have that kind of negative, defeatist approach when discussing the really borderline Hall of Famers, but I think that's unfair to the voting group because it implies they haven't learned anything over the last 20 years, and the progression of Vezina voting makes it absolutely clear that hockey insiders have in fact learned some lessons.</div><div><br /></div><div>Every goalie now up for voting has an entire career's worth of official save percentage numbers and an entire career's worth of Vezina voting done by the league's general managers. Even though it's almost been three decades since those changes were introduced, Ed Belfour was just the second Hall of Fame goalie who played his entire career in the official save percentage and modern Vezina eras, joining Patrick Roy. Both Belfour and Roy would have been slam-dunk picks in any year, and therefore are hardly litmus tests for how the Hall factors in these new developments. We simply have not seen how much those two things have changed the game in terms of rating goalie careers. As such, any attempt to use prior voting results to predict how the voters rate future HOF goalie candidates is probably little more than guesswork.</div><div><br /></div><div>I know for sure that there is at least one member on the Hall of Fame committee who doesn't care about goalie wins. A long time ago I linked <a href="http://brodeurisafraud.blogspot.com/2007/08/insightful-serge-savard.html">an article by HOF member Michael Farber</a> in which he quoted fellow HOF voter Serge Savard as saying that goalie was not the most important position, since in almost all cases teams make the goalie, rather than the other way around.</div><div><br /></div><div>In the past a guy like Scotty Bowman may well have been a traditionalist and rated goalies based on wins, I don't know. But he was there when the Red Wings waived Chris Osgood, and he remains a special advisor to the Chicago Blackhawks, who turfed out their Stanley-Cup-winning netminder to save a few bucks. Seems pretty clear he's either been overruled multiple times by his team's management, or else Bowman is using evidence other than merely wins and Cups to rate goalies. If he's able to do that while helping to run a team, there's no reason he shouldn't apply the same logic when debating Hall of Fame candidates.</div><div><br /></div><div>Any of the currently active writers or broadcasters on the committee have to be aware that teams are spending less money on goaltending, that mediocre goalies are winning Cups, and that save percentage is being used more than ever to rank and rate goalies. With less of a tradition of <a href="http://brodeurisafraud.blogspot.com/2010/12/swedes-have-it-right.html">rating goalies based on winning </a>in Europe, it's also possible that the two European voters would be more open to rating goalies who were good but not "winners" ahead of average goalies with terrific teammates.</div><div><br /></div><div>All this is pure guesswork, of course, and the secretive nature of the Hall's election process means that we really have little evidence to go on. Maybe Mike Vernon fell one vote short last year, maybe nobody even mentioned his name, I don't know, but it is at least a positive sign that nobody has voted him in yet, and there doesn't seem to be a huge groundswell of support to get that to happen any time soon. I do think over the next few years we will have a lot better idea of how the Hall rates modern goalies. Perhaps surprisingly to some I am actually fairly optimistic that they are going to get <span style="font-size: 100%; ">the choices more right than wrong, although only time will tell on that one.</span></div>The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com7tag:blogger.com,1999:blog-8148461224473220694.post-50838781240080820982012-01-17T16:00:00.000-05:002012-01-17T16:00:02.375-05:00Vezina Trends<div>"First, he leads the NHL in the one stat that trumps all others: wins." (<a href="http://espn.go.com/blog/nhl/post/_/id/13156/trophy-tracker-vezina-trophy-candidates">Scott Burnside, ESPN</a>)</div><div><br /></div><div>Going after Scott Burnside on goalie analysis is not dissimilar to shooting fish in a barrel, but my real beef is with how he is parroting the conventional wisdom that people within hockey consider wins to be extremely important. It might be Burnside's opinion that wins are the most vital stat, which is obviously misguided but he is allowed to personally believe whatever he wants. The problem is that when he explicitly claims to be handicapping the Vezina race, then at a minimum I would expect that he should be aware of what stats have actually been considered to be important in past voting.</div><div><br /></div><div>Here is how the last 20 Vezina winners have ranked in five key goalie stats (GVT is <a href="http://www.puckprospectus.com/article.php?articleid=236">Goals Versus Threshold</a>):</div><br /><table><tbody><tr><th>Year</th><th>Goalie</th><th>Sv%</th><th>GAA</th><th>Wins</th><th>SO</th><th>GVT</th></tr><tr><td>1991</td><td>Belfour</td><td>1</td><td>1</td><td>1</td><td>2</td><td>1</td></tr><tr><td>1992</td><td>Roy</td><td>1</td><td>1</td><td>3</td><td>1</td><td>1</td></tr><tr><td>1993</td><td>Belfour</td><td>2</td><td>1</td><td>2</td><td>1</td><td>2</td></tr><tr><td>1994</td><td>Hasek</td><td>1</td><td>1</td><td>6</td><td>1</td><td>1</td></tr><tr><td>1995</td><td>Hasek</td><td>1</td><td>1</td><td>5</td><td>1</td><td>1</td></tr><tr><td>1996</td><td>Carey</td><td>8</td><td>1</td><td>2</td><td>1</td><td>7</td></tr><tr><td>1997</td><td>Hasek</td><td>1</td><td>2</td><td>2</td><td>6</td><td>1</td></tr><tr><td>1998</td><td>Hasek</td><td>1</td><td>4</td><td>3</td><td>1</td><td>1</td></tr><tr><td>1999</td><td>Hasek</td><td>1</td><td>1</td><td>9</td><td>2</td><td>1</td></tr><tr><td>2000</td><td>Kolzig</td><td>2</td><td>4</td><td>3</td><td>4</td><td>1</td></tr><tr><td>2001</td><td>Hasek</td><td>3</td><td>2</td><td>3</td><td>1</td><td>2</td></tr><tr><td>2002</td><td>Theodore</td><td>1</td><td>2</td><td>14</td><td>2</td><td>1</td></tr><tr><td>2003</td><td>Brodeur</td><td>11</td><td>3</td><td>1</td><td>1</td><td>12</td></tr><tr><td>2004</td><td>Brodeur</td><td>8</td><td>2</td><td>1</td><td>1</td><td>9</td></tr><tr><td>2006</td><td>Kiprusoff</td><td>1</td><td>1</td><td>2</td><td>1</td><td>1</td></tr><tr><td>2007</td><td>Brodeur</td><td>1</td><td>2</td><td>1</td><td>1</td><td>3</td></tr><tr><td>2008</td><td>Brodeur</td><td>3</td><td>3</td><td>2</td><td>9</td><td>1</td></tr><tr><td>2009</td><td>Thomas</td><td>1</td><td>1</td><td>6</td><td>10</td><td>1</td></tr><tr><td>2010</td><td>Miller</td><td>1</td><td>1</td><td>4</td><td>7</td><td>1</td></tr><tr><td>2011</td><td>Thomas</td><td>1</td><td>1</td><td>9</td><td>2</td><td>1</td></tr></tbody></table><br /><div>Some readily apparent observations from the above table:</div><div><br /></div><div>1. It is very rare for the consensus best goalie to win the most games. Only 4 of the last 20 Vezina winners led the league in wins. In contrast, for each of the other four stats, the Vezina winner was more likely to lead the league than not. Wins are in fact easily trumped by save percentage, GAA, shutouts, and GVT.</div><div><br /></div><div>2. The data suggests that the emphasis on shutouts may be decreasing as well, although that could just be variance.</div><div><br /></div><div>3. The 1996, 2003 and 2004 decisions stand out quite starkly relative to the others. The unwillingness of voters to rank non-playoff goalies as the best in the league was a big factor in the '96 and '04 votes, which is at least somewhat understandable although I disagree with the logic. That leaves the '03 Vezina as the most unusual result of the last two decades. Voters overlooked a playoff goalie that had 1-1-10-5-1 ranking based on the above table, a pattern that much more closely matches the overall averages than that year's winner.</div><div><br /></div><div><div>4. The historical pattern that goalies <a href="http://brodeurisafraud.blogspot.com/2009/09/dont-always-believe-your-lying-eyes.html">require an excellent GAA</a> to win a Vezina has continued. I would suggest that a low GAA on a strong defensive team seems to be the biggest source of error in the current voting, as those goalies appear on ballots much more frequently than average goalies that rack up a lot of wins on strong offensive teams.</div></div>The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com26tag:blogger.com,1999:blog-8148461224473220694.post-25078085638513099382012-01-10T07:30:00.000-05:002012-01-10T07:30:03.904-05:00Grant Fuhr and Effort<div>One of the things people like to say about goalies on dynasty teams is that they didn't try as hard when it didn't matter, and as a result their stats were understated. I think the evidence generally suggests that while there are some score effects from changing team strategies, goalies usually do try to keep the puck out of the net at all times. With only 30 starting jobs available goalie competition is fierce, which makes less likely that goalies would be willing to slack off while in the game. Even good teams have to fight to make the playoffs these days (see the '10-11 Chicago Blackhawks as an example), which means that there can be major team consequences for a netminder with a habit of trying to coast though a game here or there. Finally, in today's low-scoring environment there is not a lot of garbage time so goals against in blowouts simply will not have a material impact on a goalie's stats.<br /><br />However, while those things may be true at the moment, they don't necessarily apply to results from several decades ago where the competitive balance and scoring level was much different than it is in today's salary capped NHL. I do think it is probably worth checking truly dominant teams to see whether there are some kind of unusual effects at play, since the incentives for players on those teams are not exactly the same as they are for everyone else.<br /><br />For example, I suspect that some members of the 1980s Edmonton Oilers may not have been playing much of a 200 foot game during the second half of the regulation schedule during the peak of their dynasty simply because they were already dozens of points in front of everyone else in the standings. With 16 of 21 teams making the playoffs in those days, there was really nothing to left to do by that point in the season other than pad their offensive stats while trying to stay healthy and in good shape for another attempted Cup run.</div><div><br />From 1983-84 to 1987-88 (numbers from the <a href="http://hsp.flyershistory.com">Hockey Summary Project</a> and <a href="http://www.hockey-reference.com">Hockey Reference</a>), there is a noticeable downward trend in Grant Fuhr's save percentages by month as the season wore on:<br /><br />Oct: 1121 SA, .898<br />Nov: 1288 SA, .889<br />Dec: 1181 SA, .870<br />Jan: 1286 SA, .890<br />Feb: 1128 SA, .871<br />Mar: 1158 SA, .880<br />Apr: 232 SA, .871<br /><br />It could be argued that Fuhr was experiencing fatigue, but that seems unlikely as a factor (other than potentially in 1987-88 when he played in 75 games) because he was usually used in a platoon scenario together with Andy Moog. On top of that, Fuhr's numbers jumped back up again to October levels as soon as the playoffs started.<br /><br />To summarize:<br /><br />Oct-Jan: 4876 SA, .887<br />Feb-Apr: 2518 SA, .875<br />Playoffs: 2268 SA, .899<br /><br />By the end of January, the Oilers were always sitting very comfortably in the standings.<br /><br />1983-84: 38-9-5, 41 pts ahead of 5th<br />1984-85: 36-9-6, 45 pts ahead of 5th<br />1985-86: 36-11-5, 40 pts ahead of 5th<br />1986-87: 34-14-11, 36 pts ahead of 5th<br />1987-88: 29-17-7, 26 pts ahead of 5th<br /><br />The only season the Oilers were not ranked first overall in the league was 1987-88, where they sat in third place but were still far above the playoff cut line. In all five seasons the team had more wins at the end of January than the last place team in their division would finish with at the end of the season, meaning they could have lost every game they played after January 31 and still made the playoffs. In short, the Oilers had very little to play for as a team from February onwards in any of those seasons.<br /><br />Looking at Andy Moog's monthly numbers, there is some reason to believe that the rest of the team was having a big impact on the late-season statistical slide:<br /><br />Andy Moog, 1983-84 to 1987-88:<br />Oct-Jan: 3363 SA, .890<br />Feb-Apr: 1572 SA, .876<br />Playoffs: 343 SA, .866<br /><br />Moog showed a very similar save percentage decline, suggesting that the Oilers as a group were less committed defensively once they had the division well locked up. Either that or Moog and Fuhr both had a similar lack of focus late in the season when the games became less meaningful. However, given that the two were mostly alternating starts, and were at least in some level of competition for the starting job come playoff time, I would guess that team defence may have been a more significant factor than the effort level of each individual goaltender.<br /><br />I think there is a reasonable argument to be made that Grant Fuhr's true talent in terms of save percentage was understated by his regular season numbers in the mid-1980s. From 1983-84 to 1987-88, his overall regular season save percentage was .884, a decent mark given the league average of .876 over the same period of time. However, if his February to April numbers are excluded as not being representative of a team giving 100% defensive effort in front of him, with his playoff numbers substituted instead, Fuhr's save percentage would jump to .891, nearly doubling his advantage relative to league average. That rate would also rank Fuhr up near the top of the league over that period of time, rather than merely the upper middle of the pack.<br /><br />It is still worth pointing out that Moog would be at .888 based on the same assumptions. That suggests that Edmonton's shot quality against was probably not nearly as bad as some suggest, at least when the team felt the game mattered and wanted to play defence, although Moog was an above-average goalie in his own right.<br /><br />Other goalies may have suffered slightly from this effect as well during the unbalanced '80s, but it seems likely that it would have had the biggest impact in Edmonton given their prolific offence and incredible team success. Fuhr may still be a bit overrated by some fans who rate him as one of the main keys to the Oilers' championships, but this is at least some evidence that supports the contention that he had Hall of Fame talent in his prime.</div>The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com7tag:blogger.com,1999:blog-8148461224473220694.post-65302366351515625482012-01-04T13:30:00.001-05:002012-01-04T13:30:02.025-05:00Anything Can Happen in One Game<div>As Canadian world junior fans learned yet again yesterday, anything can happen in a one game playoff. By now the more reactionary fans are well into their usual routine of blaming the goalie and/or the coaching staff, but all that really needs to be said is that the format of international tournaments works against the best teams and creates a high degree of randomness. The recent history of world junior and Olympic tournaments speaks to that, with some of the huge upsets that have taken place, together with the oft-repeated story of teams that looked like world-beaters through four or five preliminary games (as Canada did in this year's tournament), before unexpectedly falling to an inferior foe because of one bad outing in an elimination game (and as far as poor games go, it's certainly possible to do much, much worse than outshooting the opposition 56-24).</div><div><br /></div><div>The international tournament format caused me to think of an interesting hypothetical: What if the NHL postseason was a series of one-and-done showdowns? Obviously it's not possible to replay those postseasons based on that counterfactual, but it is possible to just look up the results for the first game of each playoff series. It's not a given that things necessarily would have turned out the same way if both teams knew it was do-or-die, but it's probably a fairly reasonable approximation.</div><div><br /></div><div>It turns out that having a single game elimination format would almost completely alter NHL history. Out of the last 22 Stanley Cup champions, only one of them never found themselves trailing 1-0 in a series at any point in their postseason run. The 2008 Detroit Red Wings are the only Cup winner to win all of their series openers in a single playoff season since Edmonton traded Wayne Gretzky. Every other Cup champion since then lost an opening game, meaning that if they were playing a one game series they would have been eliminated and would never have earned the chance to drink from Lord Stanley's mug.</div><div><br /></div><div>It would have been a similar story, although not quite as extreme, if all series had been best-of-three affairs. In that scenario, the clear majority of winning teams would still probably not have made it all the way through to win as they did. Fifteen out of the 22 teams lost 2 out of the first 3 games in at least one series on their way to a Cup. Even if the format was changed to a best of 5, that would still have a major impact on the final results, as somewhat amazingly half of the eventual champions trailed 3-2 after five games at some point during their Cup run.</div><div><br /></div><div>In total, based on these assumptions, Cup winning teams since 1988-89 would have won 61.4% of one game playoffs, 76.1% of three game playoffs, and 87.5% of five game playoffs.</div><div><br /></div><div>That supports the obvious fact that the larger the sample size, the more likely it is for talent to win out over luck. At the world juniors, it's obvious that Canada routinely has the most talent. Over the past five tournaments, Canada has a record of 26-5 with a goal differential of 185-65. Some portion of that is from pounding on the minnow nations, but even against the traditional top five hockey nations (USA, Sweden, Finland, Russia, Czech Republic) Canada still went 15-5. That's a .750 winning percentage, and the goal differential suggests that the team's record was fully earned (the Canadian juniors scored 99 and allowed 56 against the same opponents for a Pythagorean expected winning percentage of an even slightly better .758).</div><div><br /></div><div>That's an incredibly dominant record, but it still leaves the simple reality that if Canada is a 75% favourite in back-to-back playoff games against two solid opponents, that still leaves them with only about a 56% chance to win any given tournament. Given the talent of some of the American, Russian and Swedish squads in recent years, that's almost certainly overstating the odds of even a truly dominant team getting through two single elimination contests unscathed. The odds drop even further if the team did not secure a quarterfinal bye by finishing first in their pool.</div><div><br /></div><div>This is not a simple attempt to justify a loss. Winning a single elimination tournament is also less meaningful, for the exact same reasons. Sometimes a weaker team wins, sometimes a good team plays poorly but gets the breaks anyway. The longer the series, the less variance and the more confidence that the better team ends up triumphant. All Canadian hockey fans would like to claim that the 2010 Olympics win proved that Canada is the world's best hockey nation, for example, but that tournament alone is not enough to prove that assertion. A better argument would be to look at Canada's overall record in winning three of the last six best-on-best tournaments, but even that analysis would show that it is relatively close between the top nations. At the end of the day, many Canadian fans need to have more reasonable expectations about how much success to demand from the teenagers representing their country internationally.</div><div><br /></div><div>The international format is what it is, it's certainly exciting and it's not going away any time soon, but it's still important to not try to draw too much significance from such a short tournament. If you are tempted to do so, just remember that if the same rules applied to the NHL playoffs, a different team would probably end up winning well over 90% of the time.</div>The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com5tag:blogger.com,1999:blog-8148461224473220694.post-51107863519876677642012-01-03T08:00:00.001-05:002012-01-03T08:00:08.630-05:0040 Year Old Goalies<div>There was a discussion in the comments to a post over at <a href="http://www.arcticicehockey.com/2011/12/20/2648333/pdo-regression-to-the-mean-or-why-you-should-ignore-shooting">Arctic Ice Hockey</a> a couple of weeks ago about whether Tampa's goaltending (current team mark: .896) will regress back towards league average over the rest of the season. Over time goalie save percentages will nearly always move towards a goalie's career average. At the moment, Mathieu Garon is playing at close to his established level (.907 this season, .904 career) while Dwayne Roloson's seasonal rate is well below his career mark (.883 and .909 respectively). It looks like it is reasonable to expect major improvement from Roloson, which should boost Tampa's numbers the rest of the way.</div><div><br /></div><div>However, while I am confident that Tampa's team save percentage will continue to move upwards towards league average, I do not believe this will be because Roloson's numbers will get a whole lot better. It will instead occur as the team shifts more playing time to Garon, who started 11 games to Roloson's two during the month of December, or perhaps through bringing in another goaltender if GM Steve Yzerman decides to address his team's crease situation. Roloson's numbers will probably improve, if nothing else playing in more of a backup role against weaker opponents may help slightly, but the reasonable expectation is that at 42 years old he is simply too old to expect him to produce anything north of .900.</div><div><br /></div><div>Looking at the career records of goalies in the save percentage era <a href="http://www.hockey-reference.com/play-index/psl_finder.cgi?request=1&match=combined&year_min=1984&year_max=&season_start=1&season_end=-1&age_min=40&age_max=99&birth_country=&franch_id=&is_active=&is_hof=&pos=G&handed=&c1stat=&c1comp=gt&c1val=&c2stat=&c2comp=gt&c2val=&c3stat=&c3comp=gt&c3val=&c4stat=&c4comp=gt&c4val=&order_by=games_goalie">past the age of 40</a>, it is impressive how much the top two on the list stick out both in terms of quantity and quality of performance:</div><div><br /></div><div>Hasek: 3366 shots, .914</div><div>Roloson: 3602 shots, .907</div><div>Everyone else: 4899 shots, .891</div><div><br /></div><div>Hasek and Roloson each have two of the top four seasons among the 40+ crowd. Other than them, Ed Belfour is the only one who managed to keep his starting job past the age of 40, although his numbers were much lower. Everyone else had numbers that were below league average, in most cases well below.</div><div><br /></div><div>1. Hasek, 2005-06: 43 GP, .925</div><div>2. Roloson, 2010-11: 54 GP, .914</div><div>3. Hasek, 2006-07: 56 GP, .913</div><div>4. Roloson, 2009-10: 50 PG, .907</div><div>5. Joseph, 2007-08: 9 GP, .906</div><div>6. Belfour, 2006-07: 58 GP, .902</div><div>7. Hasek, 2007-08: 41 GP, .902</div><div>8. Burke, 2006-07: 23 GP, .901</div><div>9. Belfour, 2005-06: 49 GP, .892</div><div>10. Roloson, 2011-12: 17 GP, .882</div><div>11. Joseph, 2008-09: 21 GP, .869</div><div>12. Esposito, 1983-84: 18 GP, .859</div><div><br /></div><div>Based on those comparables, a good bet on Roloson's current save percentage talent is probably in the .895-.900 range, although with perhaps 15-20 starts remaining Roli's actual performance could still vary quite widely.</div><div><br /></div><div>Assuming Garon keeps up his current level of performance and keeps getting the majority of the starts, Tampa's save percentage will probably improve by something like .010 the rest of the way. For example, if Garon keeps his .907 through the end of the season while Roloson plays at .895 and the shot split between them moves from the current 57/43 to 67/33, the Lightning should end up with a save percentage of .903 over their last 50 games. That's still well below league average, which is why the team should certainly consider making a move if they want to make a stronger playoff push this season. History suggests their current goaltending will be unable to perform at a league average level, which will make it difficult for the Lightning to catch up in the standings.</div>The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com8tag:blogger.com,1999:blog-8148461224473220694.post-20884048432971849542011-12-31T08:00:00.000-05:002011-12-31T08:00:01.702-05:00Good Enough to Win<div>One thing that is often discussed about goalies by hockey fans is whether they are "good enough" to win a Stanley Cup. This is usually based on things like gut feel and extrapolating huge amounts of significance from small sample sizes; I have rarely seen anyone try to quantify what good enough to win a Cup actually means.</div><div><br /></div><div>First of all, winning is obviously a team result. The talent and luck necessary for a goalie to win a Cup on the Detroit Red Wings is a lot different than what is required on the New York Islanders. The historical record shows that only strong regular season teams win Cups, so we need to look at the kind of numbers goalies put up on those teams. That said, hot goaltending does have an impact. At some point even a good team is going to run against other strong opponents in their quest for the Cup, and in those games superior goaltending can become a tiebreaking factor (e.g. the 2011 Cup Finals).</div><div><br /></div><div>Here are the save percentages for each Cup-winning goalie in the save percentage era, adjusted to league average and normalized to the current average save level (.911):</div><div><br /></div><div>1984: Grant Fuhr, .933</div><div>1985: Grant Fuhr, .925</div><div>1986: Patrick Roy, .946</div><div>1987: Grant Fuhr, .932</div><div>1988: Grant Fuhr, 913</div><div>1989: Mike Vernon, .930</div><div>1990: Bill Ranford, .934</div><div>1991: Tom Barrasso, .937</div><div>1992: Tom Barrasso, .926</div><div>1993: Patrick Roy, .945</div><div>1994: Mike Richter, .933</div><div>1995: Martin Brodeur, .934</div><div>1996: Patrick Roy, .931</div><div>1997: Mike Vernon, .932</div><div>1998: Chris Osgood, .923</div><div>1999: Ed Belfour, .933</div><div>2000: Martin Brodeur, .933</div><div>2001: Patrick Roy, .940</div><div>2002: Dominik Hasek, .923</div><div>2003: Martin Brodeur, .936</div><div>2004: Nikolai Khabibulin, .933</div><div>2006: Cam Ward, .928</div><div>2007: J.S. Giguere, .927</div><div>2008: Chris Osgood, .932</div><div>2009: Marc-Andre Fleury, .911</div><div>2010: Antti Niemi, .910</div><div>2011: Tim Thomas, .939</div><div><br /></div><div>Those numbers are quite consistent. Twenty out of 27 goalies had an adjusted save percentage between .923 and .937. The average was .930 on 582 shots against. The only goalies to win the Cup with average save numbers were Fuhr in 1988, Fleury in 2009 and Niemi in 2010. Patrick Roy was the only Cup winning goalie to record a number of .940 or better, which remarkably he managed to do in each of his three Conn Smythe winning performances.</div><div><br /></div><div>The overall averages for Cup Finalists were very similar, with an average of .927 on 572 SA. The distribution was different however. Eight of 27 had an adjusted save percentage of .939 or better, which reflects the fact that there have been a number of weaker teams that needed strong goaltending just to make it to the Final. Eight other Finalists had adjusted save percentages of .917 or worse. Some of those simply benefitted from strong teammates, while others were mostly good for three rounds and then saw their numbers nosedive as results starting going against them during the Finals.</div><div><br /></div><div>This analysis gives the rough historical rule of thumb that to win a Stanley Cup, you need a goalie capable of putting up a .930 save percentage over 600 shots. That level of statistical performance doesn't guarantee a Cup, a number of goalies have played at an even higher level than that only to see their teams fall short at the final hurdle, but it makes a ring very possible if other variables (scoring, defence, injuries, opposition, etc.) also happen to break right.</div><div><br /></div><div>Because of variance, nearly any goalie who makes it to the NHL could put up a .930 on 600 shots with enough luck, although it is not very likely to happen for a replacement level goaltender. According to the binomial probability function, a .900 talent goaltender would have a 0.7% chance of putting up that target number on any given 600 shot stretch. That means that even if they saw 600 shots against in every playoff season, they would still need to play in 99 of them to have a greater than 50% chance of going over .930 in one of them. Unless they happen to be astronomically lucky or find themselves playing for a complete powerhouse, I think it is fair to say that in general a .900 talent goalie is not good enough to win a Stanley Cup.</div><div><br /></div><div>For a .905 goalie, the odds increase to 1.9%, still not even once every 20 times which is the usual cutoff point to determine statistical significance. The point where the probability moves above 5% is when the goalie's talent is .911, which is right about league average. The chances are much greater for one of the league's elite goalies. A .920 talent goalie would play at .930 or better over 600 shots about 20% of the time.</div><div><br /></div><div>That shows that a top goalie on a contending team would have a reasonably good chance to win a Cup, but that it is still far from a sure thing. Goalies have short careers and often only a short window of opportunity to compete in the playoffs with a true contender. That is why it is not surprising that some elite goalies who conclusively proved their talent over hundreds of regular season games still never managed a deep playoff run. It was not because they weren't good enough to win a Cup, it was because they didn't get the breaks that are required to win a championship.</div><div><br /></div><div>The idea that most starting goalies in the league are capable of .930 over 600 shots is also backed up by the actual statistical record. There are only seven teams who do not currently employ a goaltender that has put together at least one stretch of consecutive games with a save percentage of .930 or better on at least 600 shots against since 2009-10. Even among those seven, five of them have goalies who very narrowly missed the cutoff:</div><div><br /></div><div>Reimer, Toronto: .929 on 622 SA</div><div>Theodore, Florida: .929 on 608 SA</div><div>Lehtonen, Dallas: .929 on 581 SA</div><div>Varlamov, Colorado: .931 on 563 SA</div><div>Brodeur, New Jersey: .929 on 603 SA</div><div><br /></div><div>Some might quibble with the relatively unproven Reimer or Varlamov, or even the aging Brodeur, but I'll count all five as being close enough. That leaves just Columbus and Tampa Bay. Steve Mason's best stretch since '09-10 was .923 on 571 shots, while Roloson's best in the last two and a bit regular seasons was .926 on the same 571 SA. However, these numbers are from the regular season only; if playoff numbers count then from March 29 to May 19 Roloson had a .931 on 623 shots against.</div><div><br /></div><div>Despite his hot spring last year, I think Roloson's age makes it unlikely that he will regain that form, and Mason's recent track record is simply not very good at all. I think it is probably fair to say that the Blue Jackets and Lightning may not currently have goaltending that is good enough to win a Cup. Other than that, every other team has a goaltender that has shown they can play at a high enough level for a long enough period of time that while they may not be a good bet to provide that level of goaltending during a playoff run, they would at least have an outside chance at winning a Cup if they were fortunate enough to be a member of a contending team.</div><div><br /></div><div>This discussion should make it quite clear that evaluating a goalie's ability to win a Cup based on their past history is a woefully inadequate method. Nearly every starting goalie in the league is good enough to win a Cup in the right situation, and for a typical playoff team any netminder that is average or better should probably be considered good enough to win if they can just get on a hot streak at the right time. However, in any individual playoff season the odds would still be very much against them, even for an elite goalie on a contending team.</div><div><br /></div><div>The only caveat to this analysis is that it seems likely that the threshold for a Cup winning goalie has dropped even further since the lockout. As <a href="http://www.coppernblue.com/2011/12/26/2644442/bruins-goal-differential">Copper 'n Blue pointed out recently</a>, there haven't exactly been huge gains in parity even with the salary cap system. As a result, goaltending performance has become less decisive than in previous seasons. Four out of six post-lockout goalies have been below .930, with two of them well below that mark. The numbers have dropped for Cup Finalists as well, who have averaged .923 since 2006. I'd estimate that the threshold is probably closer to .925 than .930 in today's NHL, which would leave only Columbus as a team without a goalie with the proven ability to perform above that level.</div>The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com7tag:blogger.com,1999:blog-8148461224473220694.post-3122396923569440902011-12-20T18:30:00.000-05:002011-12-20T18:30:01.568-05:00The Value of a Quick StartI was one of a number of hockey observers who thought that by this point in time Jonathan Bernier would have mounted a serious challenge for the Los Angeles' Kings starting job, if not taken it over outright from Jonathan Quick. However, there hasn't been much of a goalie controversy at all, and there is no doubt that the 3rd round pick from Connecticut is the currently the clear #1 ahead of the highly-touted first-rounder from Quebec.<br /><br />Is Quick a better goalie than Bernier? At the moment that seems obvious, based on their play over the last season and a bit and the way the team has distributed the playing time between them. However, it should be noted that Quick has a significant advantage in the battle between the two young goalies, having been born two years earlier. At the moment, Quick is 25 and Bernier is 23. For the sake of comparison, Jaroslav Halak was 25 and Carey Price was two months away from turning 23 when Montreal made the controversial move to trade their 2010 playoff hero away at the end of the postseason and bet on their younger goaltender. Quick is considerably more experienced, with an extra 180 regular season and playoff games in the NHL under his belt. That raises the reasonable question of whether Quick is the better goalie, or whether he is merely the more developed talent for the moment.<br /><br />In addition to being a higher draft pick, Bernier had also had a better minor league career. If you compare the two of them by age, Bernier's progression was well ahead of Quick's through his early twenties.<br /><br />At 19, Quick was still in high school, although he put up very good numbers. Bernier was recognized as one of the best goaltenders in the CHL, made the Kings out of camp and ended up with a brief cup of coffee in the NHL (4 games), before joining Manchester at the end of his junior season and starting 3 out of the team's 4 games in the AHL playoffs. Bernier also made Canada's under-20 national team for the world junior championships, while Quick was not selected to Team USA.<br /><br />For his age 20 season, Quick went to UMass, where he would spend two seasons. At 20, Bernier was already a solid pro, posting a .914 save percentage in 54 games played as an AHL starter. The next year Bernier was even better with a spectacular .937 save percentage in 74 regular season and playoff games, earning the AHL's top goaltender award.<br /><br />At the age of 22, Bernier joined the NHL seemingly for good as the Kings' backup goalie. He did fairly well as a backup (.913 in 25 games), although he didn't exactly take the league by storm as he had in the AHL. Compare that to Quick, who turned pro for his age 22 season which he split between the ECHL (38 GP, .905) and AHL (19 GP, .922), plus a trio of brief appearances in the NHL.<br /><br />To summarize:<br /><br />19: Quick in high school, Bernier AHL playoff starter<br />20: Quick in NCAA, Bernier AHL starting goalie<br />21: Quick in NCAA, Bernier AHL goaltender of the year<br />22: Quick ECHL starter/AHL backup, Bernier NHL backup<br /><br />Up to that point in their careers, Bernier's development was clearly surpassing Quick's. However, things turned around in their age 23 seasons. Quick started the year in the AHL, but was called up to Los Angeles in December. When he arrived he made the most of his chance, playing very well early on in stopping 94.6% of the shots against and recording two shutouts in his first six starts. With Erik Ersberg and Jason LaBarbera both playing poorly, Quick ended up quickly taking over the Kings' starting job. Over the remaining 37 games he would play in that season, Quick's save percentage was .909, almost exactly league average (.908).<br /><br />In his 23 year old season, Bernier also managed to record pretty average numbers in the NHL (.913 in 25 games), but he started very slow, losing 5 of his first 7 starts with a mere .889 save percentage. Bernier's early season struggles were magnified by the fact that Quick did very well out of the gate in the same 2010-11 season (7-1-0, 1.84, .936 in October of 2010), further solidifying his claim to the starting job.<br /><br />This season Quick yet again began red-hot, going 6-1-2, 1.52, .947 in October, before quite naturally tailing off a bit since November 1. That was the third time in the last four NHL seasons that Quick was almost unbeatable in the first month he played, leading to some fairly extreme splits for his young career: so far:<br /><br />Quick since 2008-09:<br />First month played: 23-8-4, 2.02, .928<br />Rest of season: 89-74-12, 2.72, .911<br /><br />Compare that to Bernier, who for the second year in a row is off to a slow start.<br /><br />First 7 games in 2010-11: 2-5-0, 3.30, .889<br />Remainder of 2010-11: 9-3-3, 2.13, .923<br />First 7 games in 2011-12: 2-4-0, 3.10, .883<br /><br />Games at the start of the season often take on extra significance because they help establish a team's pattern of distributing starts between their goaltenders and the impact on a goalie's seasonal statistics is more noticeable. Look at how many fans around the league were either pronouncing their team's #1 as a Vezina candidate in November because of a strong early run of form or were panicking because their team's goalie took a while to discover their usual game. A hot or cold start takes longer to average out, whereas a slump in February or March has much less of an effect on a goalie's seasonal numbers to date because they may already have 40-50 games played by that point in the season.<br /><br />The first <a href="http://www.arcticicehockey.com/2011/2/23/2005954/the-importance-of-a-goalies-first-15-games">few games can also be quite critical </a>in terms of establishing a reputation for a young goalie trying to crack the NHL. It took all of five Jon Quick starts in 2008 before Los Angeles traded Jason LaBarbera to Vancouver and pretty much anointed Quick the starter. If those early starts had included a couple of blowout losses, then the team may very well have decided that LaBarbera wasn't actually that bad after all while Quick was in need of more seasoning in the minors. There is no doubt that Quick's hot streaks were almost perfectly timed to advance his career. The only way he could have timed them any better was if he managed to get on a real roll in the postseason.<br /><br />I think there is a fair chance that Quick and Bernier are not that far apart in true talent, even disregarding the age gap between them. In the AHL, Quick put up a .923 on 1033 shots, while Bernier recorded a .928 on 3937 shots. Minor league success does not always translate to the big leagues, but it is at least evidence that the two were in a similar ballpark, even though Bernier was doing it at a younger age.<br /><br />In the NHL, Quick's career regular season save percentage is .914 compared to Bernier's .906. However, if we exclude Bernier's four games at age 19, where he quite naturally struggled like the majority of teenagers do in the NHL at that age, and we add playoff numbers to increase the sample size, suddenly the career NHL save percentages for the two goalies converge quite a bit:<br /><br />Quick: .913 on 6026 SA<br />Bernier: .911 on 925 SA<br /><br />Quick's sample size is much larger, which means we are far more confident in our estimate of his true talent level. In addition, given that the majority of goalies are below average, it is safest to assume that a young goalie who hasn't proven much in the NHL is below average until he has faced a few thousand shots against. Bernier's pre-NHL track record makes it somewhat more likely that he is a real talent, but it is best to remain conservative at this point. Nevertheless, I will be very interested to revisit these numbers after the end of this season to see if they remain similar.<br /><br />One thing that could be argued in Quick's favour is that his numbers have been trending upward over the last three seasons. However, I'm not sure how much to credit him for that given that his improvement has come almost entirely on the penalty kill.<br /><br />2008-09: .926 EV, .869 PK<br />2009-10: .919 EV, .853 PK<br />2010-11: .921 EV, .903 PK<br />2011-12: .928 EV, .922 PK<br /><br />Quick is a better goaltender today than he was in 2008-09, but he has also probably been very lucky on his last 435 shots against while shorthanded as .910 is an unsustainable PK SV%. For comparison's sake, Bernier's career numbers are .916 at EV and .890 on the PK (again, excluding his 19-year old season). Bernier may also have gotten a bit of luck on special teams, or perhaps the Kings' penalty kill has been unusually strong as of late, although his PK sample size is very small.<br /><br />Looking at the progression and career numbers of the two young Kings goaltenders, it is hard not to wonder about the size of the impact of hot starts as well as Quick's opportunity to compete for the starting job in 2008-09 while there was not already an established starter, when Quick's two year head start in terms of age really turned into an advantage. Bernier is currently on pace to end his age 23 season with a career total of 49 games played. Jonathan Quick got into 116 of them in his age 23 and 24 seasons while competing mostly against Erik Ersberg, who was probably never more than a replacement level goaltender. Even if he starts playing better than Quick right now, Bernier will probably never get anywhere near that much playing time over this season and next.<br /><br />If the crease didn't open up for Quick and he didn't have hot starts to begin nearly every season, it is certain that he would have played in fewer games, potentially many fewer games. The Kings brought Bernier along slowly, and it is possible that his development may have stalled somewhat given his infrequent usage as a backup goalie this season and last, whereas Quick went from an AHLer to an NHL starter in one season, and as a result his extra games played in the show at age 23 and 24 were likely very significant in helping him close the early career development gap against his teammate. That said, it is also possible that Bernier was never going to fulfill his earlier promise anyway. Even highly rated draft picks sometimes don't pan out.<br /><br />This comparison reminds me of an article I wrote a while back which discusses the <a href="http://brodeurisafraud.blogspot.com/2008/02/value-of-opportunity.html">impact of opportunity </a>on another Kings goalie, Jamie Storr. Storr was sort of the anti-Quick in that he was never able to put together a good run when it seemed like the starting job was available to be won, even though his overall save numbers were actually pretty good.<br /><br />It's always hard to separate talent and luck early in a young goalie's career, when we really don't know enough about them to properly assess their true ability at the NHL level. Right now Quick is solidly ahead of Bernier, but has that been because of talent or opportunity? It may never be possible to figure that out with any degree of confidence, but the years ahead will give some additional information that will help make a more accurate estimate. For now, I certainly wouldn't rule out the possibility that Bernier is either as good Quick right now or that he will still eventually turn out to be better when both are in their primes. Los Angeles may be facing a Halak/Price type of decision at the end of next season when both goaltenders become free agents, and it will be interesting to what choice they will end up making.The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com11tag:blogger.com,1999:blog-8148461224473220694.post-47136392846443106372011-12-14T07:00:00.000-05:002011-12-14T07:00:19.955-05:00What Does a Clutch Goaltender Look Like?<div>One of the most common goaltending cliches is, "It's not how many saves you make, it's when you make them." Colour commentators tell us this over and over again in their rush to credit goalies for wins or blame them for losses, and many hockey fans agree with them. Not every save is the same, they say. Saves that keep a team in the game or allow them to hold on to the lead are more important, and what happens when the game is already decided really doesn't matter so much.</div><div><br /></div><div>Following that logic, a clutch goalie will make a higher percentage of saves when the score is close, giving their team a "chance to win". As such, we would expect them to have much better numbers in close games than in garbage time.</div><div><br /></div><div>After the 2011 postseason, I don't think the people saying this kind of stuff really believe what they are saying. Either that or they simply don't recognize it when they see it. The reason for that claim is simply this: Strictly based on the above definition of clutch play (a goalie who performs better when the score is close than when it isn't), I doubt there are many goalies who have ever had more "clutch" numbers over the course of a single playoffs than Roberto Luongo in 2011. Yet, needless to say, Luongo didn't exactly get a whole lot of praise as someone who "made the key saves at the key times."</div><div><br /></div><div>First, let's look at Luongo's stats at the series level:</div><div><br /></div><div>Series tied: 7 wins, 1 loss, 0.97 GAA, .968 save %</div><div>VAN up 1: 6 wins, 4 losses, 2.56 GAA, .909 save %</div><div>VAN up 2+: 2 wins, 5 losses, 4.59 GAA, .868 save %</div><div><br /></div><div>The Canucks never trailed in any series throughout the playoffs, and a big reason for that was their ridiculous goal prevention record when a series was tied. Luongo was particularly sharp in opening games, posting 3 shutouts in 4 tries.</div><div><br /></div><div>On the other hand, when the Canucks went well out ahead of their opponents in the series they repeatedly suffered meltdowns. That's not particularly admirable, but the same logic that rates some saves are more key than others could be applied to rate some games as more important than others. And, if you do that, then any reasonable definition of those "key games" would have to include games where the series was tied, since a team that always wins when the series is tied could never be eliminated.</div><div><br /></div><div>For the sake of comparison, here are Tim Thomas' numbers:</div><div><br /></div><div>Series tied: 7-4, 1.39, .955</div><div>BOS up 1: 1-3, 3.11, .909</div><div>BOS up 2+: 2-0, 1.00, .967</div><div>BOS down 1: 4-2, 2.84, .921</div><div>BOS down 2+: 2-0, 1.50, .961</div><div><br /></div><div>With the series tied or their teams up one game, Luongo's numbers were better than Thomas'. The main difference was that Thomas was great at closing out the Flyers series and he was also great in the two games where the Bruins faced 0-2 deficits.</div><div><br /></div><div>Let's move on to the game level. Here are Luongo's numbers broken down by game score:</div><div><br /></div><div>Lead by 5: 0 saves, 1 shot, .000 save %</div><div>Lead by 4: 0 saves, 1 shot, .000 save %</div><div>Lead by 3: 18 saves, 19 shots, .947 save %</div><div>Lead by 2: 56 saves, 60 shots, .933 save %</div><div>Lead by 1: 154 saves, 164 shots, .939 save %</div>Tie game: 257 saves, 276 shots, .931 save %<br />Down by 1: 84 saves, 92 shots, .913 save %<div>Down by 2: 24 saves, 32 shots, .750 save %</div><div>Down by 3: 41 saves, 45 shots, .911 save %</div><div>Down by 4: 14 saves, 17 shots, .824 save %</div><div>Down by 5: 2 saves, 3 shots, .667 save %</div><div>Down by 6: 0 saves, 1 shot, .000 save %</div><div><br /></div><div>What's obvious from that chart? If the game was close, Luongo made a high percentage of the saves. But if it was a blowout, then everything went in. Down by 2 or more goals, Luongo had an .827 save percentage on 98 shots, which is almost unbelievably bad. In garbage time, Luongo made very few saves at all - with either team leading by 4 or more goals, he stopped just 16 out of 23 shots for a mere .696 save percentage. If I was a member of Vancouver's coaching staff, I'd be somewhat concerned by that number and what it could indicate about Luongo's compete level. That said, if it is only "when you make the saves" that counts, then his performance in blowout games should be considered meaningless anyway.</div><div><br /></div><div><a href="http://www.coppernblue.com/">Copper 'N Blue</a> also tracked scoring chances for all of Vancouver's playoff games. Because it is possible for goals to be allowed on non-scoring chances (which Luongo did four times in the Nashville series and six times in the playoffs overall), I calculated scoring chance save percentage as (scoring chances against minus goals against) divided by scoring chances against.</div><div><br /></div><div>Lead by 5: 2 chances, 1 goal, .500 save %</div><div>Lead by 4: 1 chance, 1 goal, .000 save %</div><div><div>Lead by 3: 5 chances, 1 goal, .800 save %</div></div><div><div>Lead by 2: 29 chances, 4 goals, .862 save %</div></div><div><div>Lead by 1: 76 chances, 10 goals, .868 save %</div></div><div><div>Tie game: 127 chances, 19 goals, .850 save %</div></div><div>Down by 1: 50 chances, 8 goals, .840 save %</div><div><div>Down by 2: 19 chances, 8 goals, .579 save %</div><div>Down by 3: 26 chances, 4 goals, .846 save %</div><div>Down by 4: 5 chances, 3 goals, .400 save %</div><div>Down by 5: 2 chances, 1 goal, .500 save %</div><div>Down by 6: 1 chance, 1 goal, .000 save %</div></div><div><br /></div><div>The numbers are pretty similar, although Luongo's numbers with the lead come down slightly relative to his trailing numbers, likely because of score effects. With the Canucks leading, the opposition took 2.2 shots for every scoring chance recorded. When Vancouver trailed, the ratio dropped to 1.8. Still, the overall conclusion is the same: Luongo's problems were not with the game close or Vancouver in the lead, but rather with the Canucks trailing by more than one goal. And in blowout games he apparently wasn't even trying (7 goals against on 11 scoring chances with either team leading by 4 or more).</div><div><br /></div><div>Not surprisingly, Vancouver did a lot better in close games than in blowouts. Excluding empty net goals, they were 12-4 in games decided by one goal, 2-0 in games decided by two goals, and 1-6 in games decided by three goals or more.</div><div><br /></div><div>Having said all that, let's compare Luongo's save percentages by score to those of his Stanley Cup goaltending counterpart, Tim Thomas:</div><div><br /></div><div>Score within 1 goal: Luongo .931, Thomas .940</div><div>Up by 2 or 3 goals: Luongo .937, Thomas .944</div><div>Down 2 or 3 goals: Luongo .844, Thomas .957</div><div><br /></div><div>Luongo was knocked for his ability to hang on to leads, especially during the Nashville series after giving up a couple of late tying goals, but his numbers while leading actually weren't too far off what Thomas was putting up for Boston. With the score close, Thomas again had an edge but not nearly as much as one would think based on their overall numbers. By far the biggest difference in performance between the two goalies was that Luongo was blown out repeatedly and did far worse when his team fell behind by two goals or more.</div><div><br /></div><div>Did Luongo's awful play in blowouts have much of an effect on Vancouver's win/loss record? Maybe, maybe not. It would certainly be possible to argue that the Canucks would have been unlikely to come back in those situations anyway, especially with how anemic their offence was at times during the playoffs. On the other hand, Boston came back twice from two goal deficits, once again Montreal and once against Tampa Bay. If Thomas hadn't made the saves in those situations, the Bruins would quite possibly have never have made it to the Finals.</div><div><br /></div><div>To me, the implications of these numbers are pretty clear. On one hand, you can choose to cling to the "key saves at key times", "the only thing that matters is clutch play" logic and praise Roberto Luongo for elevating his game in key situations with the score close in last year's Stanley Cup playoffs. Alternately, you could consider that most of the game is a <a href="http://brodeurisafraud.blogspot.com/2009/08/making-key-saves-72-of-time.html">"key situation"</a>, realize that <a href="http://brodeurisafraud.blogspot.com/2011/10/desire-and-success.html">effort and desire don't correlate perfectly</a> with success, and understand that most goalies have the mindset to keep the puck out of the net at all times. That would cause you to reject the "key saves" logic, and instead rate goalies based on their overall performance. In that case, you would be perfectly entitled to knock Luongo's playoff performance, particularly relative to that of Tim Thomas.</div><div><br /></div><div>That's assuming people are being logically consistent, however. In reality, there isn't an awful lot of logic involved in either hockey fandom or hockey reportage. When most people say "clutch goaltending", they usually simply mean "good goaltending". If not that, then they mean "goaltending behind excellent teammates". Another tactic is to move the goalposts, narrowing the sample size to focus on a few particular games (e.g. game sevens or Stanley Cup Finals games) as the only ones that qualify for the "clutch" distinction. I disagree with that logic since a team that didn't win in the earlier rounds would not have made it to the Finals at all, and similarly without winning three out of the first six no team would still be alive to participate in a game seven.</div><div><br /></div><div>I've been in the camp that focuses on overall performance all along, so I'm not defending Luongo here. I think that throughout the 2011 playoffs, factoring in both his good and his bad games, Luongo was pretty ordinary. I do think that his play was better in close games, and I'm quite confident that if there was a hockey metric similar to baseball's <a href="http://en.wikipedia.org/wiki/Win_probability_added">win probability added</a>, Luongo would rate much better according to that than he would based on overall save percentage. Whether that is a significant observation depends on your perspective on clutch goalies.</div><div><br /></div><div><div>At this point I think it's also impossible not to accept the theory that Luongo has a higher-than-normal propensity to melt down when things turn against him. I used to agree with <a href="http://www.mc79hockey.com/?p=3640">Tyler Dellow</a> that it was essentially media narratives driving the perception, but the repeated blowouts involving Luongo and the above save percentage splits by score make that position tough to hold. I would still argue that Luongo's overall career playoff performance is reasonable relative to his true talent level, but has he ever had some forgettable single game performances on the way.</div></div>The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com15tag:blogger.com,1999:blog-8148461224473220694.post-42065463956922914072011-12-08T15:00:00.000-05:002011-12-08T15:00:00.270-05:00Dave Bolland and the Percentages<p>It's fun early in the season to click around on <a href="http://www.behindthenet.ca/">Behind the Net</a> and look at the huge variation in on-ice shooting percentage and on-ice save percentage for hockey players around the league. For example, Detroit's Drew Miller has a .988 save percentage behind him this season. Matt D'Agostini is at .980, benefitting from Brian Elliott's completely unexpected early season star turn in St. Louis. In San Jose, Martin Havlat and Michal Handzus are at .966 and .964. At the other end of the scale, Ottawa's goalies have been absolutely ventilated (.795) with rookie Stephane DaCosta on the ice, explaining his team-worst -9 rating. Steve Downie, Marty Reasoner, Craig Adams and Matthew Lombardi are other regulars with on-ice save percentages still below .850.</p><p>There can be huge differences even between teammates playing in front of the same defencemen and goaltenders. Da Costa's teammate Jesse Winchester has a .940 save percentage behind him, meaning a shot has been 3.4 times more likely to go in the net with DaCosta on the ice than with Winchester. There's obviously no way a forward could have anything even close to that much of an impact on shot quality. It's a similar story in Detroit, where nobody scores with Drew Miller, Cory Emmerton (.955), Darren Helm (.955), or Tomas Holmstrom (.960) on the ice, but perennial Selke nominees Henrik Zetterberg (.891) and Pavel Datsyuk (.904) get lit up. Some small part of that is likely related to quality of competition, but with those kind of ranges and samples it is mostly luck.</p><p>The same type of thing can happen over a postseason as well, given that a typical Stanley Cup winner plays 22-26 games, and when it does it becomes more widely noticed and emphasized because the whole hockey world is paying attention. An example of a player who has been absolutely rocking the percentages in the playoffs lately is Chicago's Dave Bolland.</p><p>A huge part of both the 'Hawks Cup run in 2010 and their almost-comeback against the Canucks in their first round series in 2011 was the ability of the team's checking line to outscore strong opposition. Bolland attracted a lot of attention for his work, and a good portion of those accolades are indeed deserved. Bolland is a key member of the Blackhawks because of his ability to play tough minutes and has a big impact on Chicago's team depth when he is in the lineup. However, over the last three playoff series he and his linemates were outscoring at a completely unsustainable rate.</p><p><a href="http://www.coppernblue.com/">Copper 'n Blue</a> counted scoring chances for the Blackhawks' series against San Jose and Philadelphia in 2010, as well as the first round matchup against Vancouver last season. With Bolland on the ice in the 14 games he played over that stretch, Chicago created 49 scoring chances and gave up 69 against at even strength. Given the difficulty of his minutes in terms of opposition and defensive zone starts, that's really not too bad for Bolland and his linemates. The curious part is that at the same time Bolland's plus/minus somehow managed to end up at +13.</p><p>Excluding shorthanded and empty net goals, Chicago outscored their opponents 16-5 with Bolland on the ice at even strength. That means the team scored in over 1 of 3 recorded chances (34.8%), while the scoring chance save percentage behind him has been an improbable .922. Depending on who is counting them, typical rates are 1 goal scored per 6 or 7 scoring chances. If you add up those two numbers, you get a way-off-the-charts scoring chance PDO number of 1270.</p><p>I often write about how much luck there is in the playoffs, and how randomness plays a big factor in what kind of labels get applied to players. When you have a player who is both playing well and getting lucky it becomes very tough for the opposition to overcome, and perhaps equally tough for sportswriters to avoid hyping up the impact of that particular player. Focusing strictly on results in terms of goals for and against, it is hard to deny that Bolland had a huge impact on the last three series for the Blackhawks. However, the underlying numbers show that it would be virtually impossible for that level of outscoring to continue, as the percentages needed to be extremely skewed in Bolland's favour for the numbers to come out the way they did. I wouldn't bet on his line outscoring Joe Thornton or the Sedins again in their next postseason matchup.</p><p>This season, Bolland's percentages have been trending in the exact opposite direction, which explains why he currently sits at -5. Despite facing the highest QualComp on the team and starting in his own zone 33.9% of the time, Bolland manages to almost break even in terms of Corsi and the Hawks have actually outshot their opponents 124-112 with him on the ice at 5 on 5. All that indicates that Bolland is playing extremely well, but unfortunately his PDO so far is just 943, mainly because the save percentage behind him is just .868, and as a result he has been outscored 17-10. In the long run it typically all evens out.</p>The Contrarian Goaltenderhttp://www.blogger.com/profile/03433370306939690205noreply@blogger.com5