Tuesday, May 22, 2012

Mike Smith: Good Season or Good Goalie?

Case A:  2011-12 Was A Fluke Season

The fact that goalie results are heavily influenced by randomness and have a lot of variance from year-to-year has been clearly established by statistical analysis.  It would be very unlikely for an ordinary starting goalie to hit .930 just by luck, but it is not beyond the realm of possibility.  If the goalie is perhaps slightly above-average and aided by some relevant team factors then that explanation becomes a lot more compelling.  The sudden massive improvement in numbers for Mike Smith makes it reasonable to question where his true talent lies.  After all, it is not very often that a 30-year old goalie is able to bump up his career save percentage by .008 in the course of a single season.

The most commonly advanced argument by those seeking to downgrade Mike Smith is the team argument that claims that Dave Tippett is a defensive genius that helps all goaltenders succeed in Phoenix.  It's generally a good idea to be skeptical of shot quality arguments, but on the other hand there are three goalies now that have superior numbers under Tippett then they managed everywhere else since the lockout (regular season and playoffs combined):

Ilya Bryzgalov:
Without Tippett:  7517 SA, .911
With Tippett:  4481 SA, .919

Jason LaBarbera:
Without Tippett:  2703 SA, .905
With Tippett:  1474 SA, .916

Mike Smith:
Without Tippett:  4430 SA, .907
With Tippett:  2617 SA, .934

It is probably also worth noting that Smith played in the Pacific Division, a division that had a higher average save percentage than any other division in the league.  Part of that is surely because the Pacific has some great, top-flight goalies, but the league-leading number was also likely influenced at least to some degree by the tight style of play that is more typical for teams on the West Coast.

In the playoffs and regular season combined this year, Smith has faced just 15% of his shots against on the penalty kill.  Throughout the rest of his career his average was 19% (although part of the decrease was because penalties were down in 2011-12).  Smith also posted a .909 save percentage on the PK, which vastly surpasses his previous career PK rate of .874.  This year was only the second time in his career that Smith's PK rate even went above .880.

If Smith had faced 19% of his shots against on the PK with a PK save percentage of .880, his seasonal save percentage would have dropped .006 to .924.  Assuming that Phoenix has some additional shot quality effect at even strength relative to the rest of the league, he may only have played at a level of around .920 in a neutral team situation.  Obviously Smith had a terrific campaign, but perhaps those potential team factors caused some skeptical GMs around the league to drop him out of the top three in Vezina voting, even though his numbers suggest he probably deserved that ranking (Smith led the league in GVT, a measure that historically tracks very well with Vezina winners).

One large negative indicator for Mike Smith heading into this season is that he had an extreme home/road split.  Prior to this year he had a career save percentage of .918 at home compared to just .896 on the road.  That's usually not a good sign, given that road save percentages are subject to less potential scorer bias since they are spread across a number of different arenas.  This year, Smith's degree of improvement on the road (+.030 to .926) was almost twice as much as the increase in his home save percentage (+.016 to .934).  It is perhaps interesting to note that both LaBarbera (.922 on the road) and Bryzgalov (.921) have excellent road numbers under Tippett in Phoenix (both actually did better away from home than they did in Glendale). Phoenix has also finished in the top eight in road record in each of the past three seasons, despite finishing 16th in points at home this season for the second year in a row.

To summarize, Smith's track record doesn't support anything close to a season of 67 GP at .930, and there is evidence that suggests Phoenix may be a place that helps its goalies out a bit.  As a result, Smith is probably headed for a major regression in his numbers for 2012-13.


Case B:  Mike Smith Is A Good Goalie

Smith has been very impressive in the playoffs, causing some to argue that his game has developed and he is in the process of joining the game's goaltending elite.  The caveat is that subjective arguments are affected by all kinds of observer biases, and sometimes it is hard to differentiate between a good goalie and a lucky goalie or a hot goalie, but Smith's numbers have been so outstanding that it is likely they do represent a significant improvement, even taking into account some of the other factors that may be in play.

One of the biggest question marks in evaluating Mike Smith is determining how much of an impact the concussion he suffered late in 2008 had on his career development.  It's certainly possible to make the numbers fit a narrative that portrays Smith as a promising goalie early in his career before he was brought low by a concussion, and that it shouldn't be that surprising that Smith has blossomed into a quality NHL starter now that he has fully recovered.

Smith was concussed in December 2008.  His career save percentage as of December 31, 2008 was .913, which is very strong taking into account the league average of .907 from 2007 to 2009.  Smith's 2008-09 season on a really bad Tampa team looks quite impressive in retrospect.  The Lightning fired Barry Melrose in mid-season, ended up second last overall, and went 10-22-9 with a 3.62 GAA with their backup goalies in the net (Smith himself was 14-18-9 and 2.62).  Unfortunately Smith's campaign was cut short by his concussion symptoms.

How much did the effects of his head injury affect Smith in 2009-10 and 2010-11?  It's difficult to tell, particularly because he faced a relatively small sample size of 1600 shots.  In 2010-11 he would likely have been much closer to full recovery, but rarely played in a backup role behind Dwayne Roloson.  Smith's combined numbers for those two seasons, together with January 2009 when he was playing with concussion symptoms before getting shut down for the year, come to .899 on 2096 SA, which is well below where he was prior to the injury.

Smith have simply have been somewhat lucky early in his career and then unlucky later on, we've seen that happen many times over a couple of 2000 shot samples.  However, it is also entirely possible that his injury had a major impact on his results and that he has had above-average talent since the start of his career.

It has been widely reported that Phoenix goalie coach Sean Burke wanted to bring in Mike Smith because Burke saw potential there.  Maybe Burke was correct that Smith was a star in waiting, although a cautionary note is that those are the types of things that are easy to say in hindsight if you want to make a specific talent evaluator or coach look great, mainly because they don't account for any of the misses (if Smith didn't work out then nobody would be writing stories about how Sean Burke got it wrong).

Smith's two-year, $4 million deal doesn't exactly suggest that Phoenix thought they were going to be getting Vezina-calibre goaltending, but at the same time with LaBarbera in the backup role and no real other options on the farm the Coyotes were clearly betting their season on Smith.  If they didn't think he was going to be at least average it is questionable whether they would have made that move.  Goalies don't always follow linear career paths, and maybe the change of scenery combined with coaching and his personal development helped Smith make the jump and join the games' elite.

Conclusion

It seems to be an absolute rock-solid bet that Mike Smith's numbers are going to regress next season, and that his true talent level doesn't quite measure up to the level of performance he has displayed this year.  On the other hand, it seems clear that Smith's concussion had a negative impact on his career, and as a result his career numbers are at least somewhat understated.

There is a chance that Smith is now one of the game's best goalies, and there is a chance that this was his career season.  The most likely case is that Smith is not an elite goalie who can be counted on to remain near the top of the league year after year, but he may be an above-average starter who still has a number of useful years ahead of him.  Smith is probably still a good candidate to put up another season of around .920 or maybe even a little better next year, given Phoenix's team discipline and the fact that he outperformed league average by .006 over a three season stretch earlier in his career when he was likely not as good as he is right now.

8 comments:

David Johnson said...

It should be noted that Smith played for Tippett early in his career in Dallas. Here are his with/without Tippett regular season stats:

With Tippett:
2006-07: .912 (45/511)
2007-08: .906 (48/510)
2011-12: .930 (144/2066)
Total: .923 (237/3087)

Without Tippett:
2007-08: .893 (36/338)
2008-09: .916 (108/1282)
2009-10: .900 (117/1165)
2010-11: .899 (58/576)
Total: .905 (319/3361)

Not sure it makes a difference in your analysis but worth pointing out.

I think it is probably safe to assume that Tippett's defensive style of coaching is a boost to a goalies save percentage as probably is playing in the pacific division. The opposite may very well be true in Tampa where the Lighnting played a more offensive oriented game, as did most of the other southeast division teams.

I suspect the true Mike Smith playing in a neutral division behind a neutral team is somewhere between his .923 Tippett save percentage and his .905 Tampa save percentage. Probably somewhere around the .910-915 range which isn't too bad if he can do that consistently from year to year. That would put him a step or two behind the elite goalies, but should provide him with a regular job in the NHL.

Anonymous said...

(((wins ÷ games) * 1000) ÷goals against average) * save percentage

(((W ÷ GP) * 1000) ÷G.AA) * SV%

Anonymous said...

I was waiting for an analysis of Smith and his remarkable season. Good article. I think you need to deal with Elliot next.

Unknown said...

I enjoyed your article/attempt.
One criticism,However, I feel Tippet system narrative/ evidence very weak.

To counter it check A Ryder
here: http://www.hockeyanalytics.com/Research_files/2011_NHL_Review.pdf

Ryder work makes a 'real' attempt to seperate Defence from Goaltending

For 2011 Phx's defence (under Tippet) ranked 25th

Interesting LA ranked 2nd.
There is strong evidence that Quick is not elite & benefiting from LA 's top D.

That being said the Vezina is for the year's performance & If Ryder's work is anywhere accurate & repeats this year than Smith deserves Vezina. And, Quick most likely doesn't deserve it.

The fact that Smith also had 'luck' this year is irrelevant in the trophy consideration.All great performances contain luck.

Is Smith likely to be elite . No! I agree with your conclusion that he is most likely a solid keeper.

Anonymous said...

lol I am not a phoenix fan or whatever but 90% of what you write on this blog is pure bullshit. Just wanna let you know. worthless idiot

Hostpph said...

I have to say that he had a great season and I hope that It is a pity that he didn't have a season like this one.

cassino aussie said...

Therefore i appreciated the content, you imagine the article writer appeared to be discussing on a web surfer, the thing seemed to be and also what is considered trendy or maybe what exactly is flexible but additionally what on earth is dishes around the go. As a result of the writer, I'm just usually listening to their own internet site, and also each one of their own website page will not progress i really do unattached, keeps the very first thing which might be functional at lifestyles.

hakeem nour said...


مكافحة حشرات
نقل اثاث
نقل اثاث بالرياض
شركة نقل عفش بالرياض
نقل عفش
تسليك مجارى
شركة تنظيف موكيت بالرياض
شركة تنظيف مسابح بالرياض
تخزين عفش
شركة تسليك مجارى بالرياض
شركة تنظيف فلل بالرياض
شركة تخزين اثاث بالرياض
شركة مكافحة حشرات