Interesting Links, and Some Thoughts on Sports Journalism

I don't usually post links to other articles, but there are a few that I wanted to highlight as they are definitely worth checking out.

First of all, JLikens at Objective NHL demonstrates that there is one more adjustment I need to make to my save percentage rankings, an adjustment for rink reporting bias. That is certainly a topic that requires future study. I don't think that an observed shot differential makes an open-and-shut case for rink reporting bias, as I think there are some teams that are more likely to allow fewer or more shots at home based on playing style, or possibly other factors like offensive/defensive strategy, commitment to matching lines, frequency of back-to-backs played on the home vs. on the road, etc. However, it is pretty clear that certain rinks do count shots differently, and that would have affected goalie numbers.

Tom Awad at Puck Prospectus did a statistical ranking of the top 10 goalies since 1944. His numbers look pretty reasonable, although I think his value over replacement metric maybe gives too much of a bonus for longevity (Tony Esposito seems a bit out of place at #4). Martin Brodeur is ranked in a tie for 5th. Interestingly enough, given the recent discussion in this space, one of the goalies tied with Brodeur is Ed Belfour.

There was an interesting quote from John Davidson that I ran across in an article by Eric Duhatschek (hat tip: Cycle Like the Sedins):

“If you take [Brodeur's] whole career playing in New Jersey and document odd-man rushes against for that whole period, he'd have the fewest odd-man rushes against, I would think – and the fewest penalties, because they're so disciplined. Style of play, him handling the puck, which means fewer injuries to defencemen, which means they're healthy to play the full season. There's a big domino effect there.”

I don't disagree with the first part, and the second part is something that would be interesting to look into.

Any of you who hate the goalie wins stat as much as I do will probably be amused by this post at Copper 'n Blue (specifically the part about Miikka Kiprusoff). The first comment is a classic, as well.

And finally, I just had to throw in a link to this article by Damien Cox entitled "Will People Really Debate Whether Martin Brodeur is the Best Ever?". Forget Awad's numbers, or mine, or anyone else's, here comes the mainstream journalist saying that in 5 years it will be completely laughable to pick anyone other than Brodeur as the best ever.

I'll never be able to match up to the excellence of Coxbloc in skewering the ramblings of the co-writer of Brodeur's autobiography, but I'd like to address this article briefly, as there has been some discussion in the comments here lately about how someone like me can reconcile the fact that I disagree with a lot of people who spend their time around the pros and are paid to cover the sport of hockey.

I don't think journalists are stupid. I have no doubt that Cox would easily be able to understand everything I have written on this blog. I don't think he lacks basic math skills, and I don't think he even distrusts statistics. I think he just forms viewpoints without defining and testing his criteria, and he is uninterested in testing those opinions by using alternate methods.

The way I see it, the best bloggers and independent hockey analysts possess two main things that are very much lacking in the majority of mainstream sports journalism:

1. Logical reasoning skills
2. Intellectual curiosity

Let's take an example from Cox's article here. He brings up talks about New Jersey's general lack of success prior to 1993-94, and then their success afterwards. Here is his argument, split into its components:

Premise 1: Lemaire became coach in 1993-94
Premise 2: Brodeur became starting goalie in 1993-94
Conclusion: "It was equal parts of Lemaire and Brodeur, then, that made the Devils develop into the type of team they became."

They both showed up at the same time, therefore they are equally responsible? That quite clearly does not follow, and no attempt was made to quantify or even reasonably subjectively evaluate the relative contributions of each, much less the other 19 skaters on the roster. Something happened, and somebody was there while it happened - well, he must have contributed to it. Martin Brodeur's team won the Stanley Cup in 2003 while Roberto Luongo's team missed the playoffs. I guess that means Brodeur must have been the better goalie. Grant Fuhr has won a lot of championships, he must have been clutch, and so on.

Cox's whole article is a great example of a lack of clear logical argument. It is, however, a typical journalist's greatest ever article, a hodge-podge of observations, anecdotes and opinions that are somehow supposed to coalesce into a coherent demonstration of greatness. It is distinguished by its lack of an attempt to compare the subject to others, even peers who played at the exact same time Brodeur did, and its lack of defining the relevant criteria of greatness. Does Cox consider puckhandling skill to be more or less important than playoff success? How about "defining the personality of a franchise", is that more or less important than Vezina Trophies? Who knows?

Not surprisingly whenever a journalist sits down and types a bunch of unrelated items into his computer and calls it a proof, the article tends to fall a bit flat. Even more so when, as in this instance, the opinion espoused happens to be wrong in the first place.

Point 2, lack of intellectual curiosity, tends to come up when people bring numbers to the table. Fire Joe Morgan was classic at exposing mainstream journalists who would ridicule advanced statistical metrics because they disagreed with them, without even understanding what they meant.

That kind of anti-numbers bias comes up in hockey as well, but there is more to it than that. To me, journalists seem to be satisfied with simple explanations, and seem to have little interest to investigate further to see whether something is true. I have read the attempts of a number of different journalists to account for the effect of New Jersey's excellent defensive play on Brodeur's success, and I've never seen any of them talk about shot quality. They'll usually pull up some carefully selected irrelevant metric to show that it doesn't matter (e.g. "Brodeur ranked in the top 10 in shots against seven times in the last 10 seasons"), or they'll gloss it over by talking about at best tangentially related things like New Jersey's offensive performance or the number of Devils coaching changes, or they'll demonstrate that New Jersey did not have excellent defensive personnel or excellent shot prevention in 2007-08 and skillfully extrapolate those results backward over the prior 14 years of Brodeur's career.

The reason I focus on Brodeur so borderline obsessively is that I find his career to be very interesting. He has had spent almost his entire career within an extreme team context, and he has a large gap between the subjective evaluation of hockey observers and the objective evaluation of the statistical record. He played behind a great defence - how much does that help a goalie? He played a lot of games - how hard is that to do, and how valuable is it to a team? He is great at all the goalie non-save skills - how big of an impact does that have on the rest of his team? His team won a lot of games and Cups - was that because of great/clutch goaltending, or because of superior team play?

Answer all of those questions for Brodeur and you can pretty much do it for anyone, and therein lies the challenge. But getting a complete answer to any individual one of them is not easy, much less properly evaluating the whole, and that is why you can forgive me if I don't have a ton of respect for journalists who haven't even attempted any of that legwork trying to tell me the case is already closed.