Friday, July 6, 2012

The Value of Subjective Evaluation

I've written many times about how I do not put a high degree of emphasis on subjective evaluations of goaltenders because there are extraneous and often subconscious factors that can impact how a performance is judged. Even on the individual game level, where the task should presumably be at its very easiest, luck and the performance of the goalie's teammates still have a big impact on how they are rated.

TSN analyst and former NHL goaltender Jamie McLennan scored every goaltending performance in the 2012 Stanley Cup playoffs based on a subjective scale from 1-5, which gives an interesting point of comparison between what the numbers show in terms of saves and goals against and what an informed expert concludes from their individual judgment. I do not question McLennan's scouting ability or his knowledge of goaltending, but the data set he has provided has some interesting properties that force me to question how much value his analysis actually adds.
  • In 86 playoff games, McLennan never gave the losing goalie a better score than the winning goalie.  He gave the two the same score only 6 times, meaning that 93% of the time the goalie on the winning team was judged to have played a better game.  Eleven times the two goalies had a save percentage within .005, suggesting there was likely very little difference in their play, yet the winning goalie routinely received a higher degree of recognition.  When you factor in score effects that typically end up inflating the winning goalie's numbers slightly, it is likely that the losing goalie often managed to match or outperform the winner, yet they never got a better score and only rarely were even graded on the same level as their counterpart
  • The correlation between a goalie's average game score and his overall save percentage was 0.924, which is an extremely high degree of correlation
  • Goalies received a 5 every single time they had a save percentage of .970 or better, regardless of how many shots they faced
  • If you compare the save percentage rankings with the game score rankings, only 4 out of the 17 goalies with at least 3 games played in the 2012 playoffs have a ranking differential of more than two (Niemi, Howard, Brodeur and Holtby)
  • Using regression, each goalie's average game score can be predicted from their overall save percentage.  Every goalie's predicted average score was within 0.25 of their actual average game score, with the exception of Jon Quick, who was 0.37 higher, and Antti Niemi, who came in a whopping 0.67 lower
In summary, McLennan's rankings did not seem to add much information.  He really liked Jon Quick, but he was hardly unique in that viewpoint; the Conn Smythe Trophy is proof enough that most observers liked what they saw from the Kings' goalie. McLennan really wasn't a fan of Niemi's playoffs, giving him scores of 2 for games of .906 and .923, both very unusual for his ranking system (there were only two other games total where a goalie got a 2 for a .900+ save percentage outing).  Perhaps we can conclude from this that the numbers flattered the Sharks' netminder a bit relative to his actual performance.  However, it is also at least possible that McLennan has some sort of bias against Niemi, who had strong numbers at even strength (.940) but was ventilated on the penalty kill (.806), a unit that has been a point of serious weakness for San Jose over the past two seasons.

Beyond those two, comparing the save numbers to the game scores indicates that McLennan thought that Marc-Andre Fleury, Cory Schneider, Jimmy Howard and Martin Brodeur were all a bit better than their numbers suggest, while Tim Thomas, Jose Theodore and Corey Crawford were all a bit worse.  That makes sense for Fleury, awful performances do tend to disproportionately drag down a goalie's overall averages, as well as Brodeur who is noted for his non-save skills (although McLennan also openly admitted to giving the veteran a few sympathy marks for his play in the Stanley Cup Finals).

I would subjectively agree that Thomas and Crawford may both have been a bit worse than their numbers suggest, particularly if you factor in situational leverage and their impact on win probability.  A previous post of mine looked at save percentage by game score, and Thomas and Crawford were certainly outplayed by their opposite numbers when the game was close.  How much of that is randomness and how much of that was each goalie's fault is an open question, but I'm not surprised that someone subjectively rating goalies would take their situational performance into account to some extent.  Still, if I turn the analysis around to predict save percentage based on game score, McLennan was subjectively downgrading both goalies by only about .006-.008, not a very significant change at all for a 150-200 shot sample.

Imagine two individuals, one who didn't watch a second of playoff hockey but was armed with detailed stat sheets showing the save efficiency of every goalie, and one who also didn't watch a second of playoff hockey but still somehow faithfully tuned in every night to hear Jamie McLennan's Post2Post segment on TSN.  Which one would be in better position to rate the goaltenders in the 2012 playoffs?  I think it probably would be the McLennan fan, but their advantage would be very slight as the two would still agree on almost everything.

Over and over, analysis tends to show that the subjective factors often hyped by broadcasters and hockey insiders (shot quality, clutch saves, etc.) really do not have that much of an impact at the end of the day.  That's not always the most intuitive finding for us narrative-obsessed sports fans, but it's hard to argue with the evidence.  I think we should be careful to completely dismiss potential factors that over time could have a significant impact, particularly at the career level, but given that nearly every observer seems to vastly overrate the value of goaltending contributions that are not encapsulated in save percentage I think it reinforces the idea that a goalie's save rate should remain the primary and most trusted method of evaluation.  Subjective opinions from people who know what they are talking about should not be disregarded, but they should at least be treated with some level of skepticism and compared with the statistical record to test their validity before given much weighting in the final evaluation.

Thursday, June 28, 2012

Why Couldn't Mats Sundin Score on the Power Play?

Mats Sundin was named to the Hall of Fame in his first year of eligibility, creating some controversy as many thought he was not fully deserving of that honour.  Some observers seemed especially miffed that Sundin was inducted ahead of Brendan Shanahan.

I don't really see the injustice there to be honest as I think Sundin is fully deserving of the Hall.  If you gave me the choice of Sundin or Shanahan I would have taken Sundin at virtually any point during their careers.  Sundin's record of consistent production is pretty strong, and I don't particularly care about his lack of team success or failure to win any major trophies.  His international scoring record, in particular, is fantastic (18 goals, 21 assists for 39 points in 30 games played in best-on-best tournaments, plus 18-26-44 in 35 games in his world championships career).

Many have wondered why Sundin was unable to duplicate the same excellent results in the NHL, particularly in the playoffs. North American observers are sometimes quick to resort to the traditional explanation that European players are more motivated to perform well in international tournaments than in Stanley Cup postseason games, but I'm
pretty skeptical of that being a major factor. I think a better explanation is that Mats Sundin was one of the best 5 on 5 forwards in the world and was playing with better linemates for Tre Kronor than he was in Toronto.

Sundin has a very impressive record of even strength scoring. From 1996-97 to 2001-02, he finished in the top 20 in the league in even strength scoring in six consecutive seasons while amassing 338 points at even strength over that span, the second-best total in the league behind only Jaromir Jagr. When you take into account Sundin's usual lack of top linemates and coach Pat Quinn's favoured strategy of rolling four lines that had the byproduct of reducing the available ice time for his #1 centre relative to other stars around the league, Sundin's scoring rates are even more impressive.

Here are the even strength and power play scoring rates during the regular season and playoffs for 8 of the top centers in the league from 1997-98 to 2003-04 (plus Brendan Shanahan, given all the recent discussion of whether he was more deserving than Sundin):


PlayerRS EVRS PPPO EVPO PP
Forsberg2.946.363.115.43
Sundin2.664.042.353.23
Sakic2.645.461.945.20
Lindros2.594.271.721.72
Turgeon2.534.962.244.94
Modano2.364.982.054.95
Yashin2.284.750.993.59
Yzerman2.264.981.995.08
Shanahan2.235.241.953.88

Sundin ranks second to only Forsberg in both the regular season and the playoffs in his rate of even strength point production. Sundin also had the best even strength goalscoring rate in the regular season as well as the fourth-best pace in the playoffs.  
However, the former Leaf captain ranks dead last in power play scoring in the regular season, and only Lindros (who had all of 7 playoff games played during this period) ranks below him in playoff power play scoring.

I checked the participation rates for the centers (percentage of team goals while a player was on the ice on which they recorded either a goal or an assist) to see if there were any major discrepancies:

Forsberg: 86.4% EV, 69.8% PP
Sundin: 83.9% EV, 64.4% PP
Sakic: 87.1% EV, 66.1% PP
Lindros: 81.5% EV, 64.4% PP
Turgeon: 85.7% EV, 70.0% PP
Modano: 83.8% EV, 64.7% PP
Yashin: 83.3% EV, 74.7% PP
Yzerman: 78.5% EV, 59.3% PP

Sundin's rates are pretty typical in both game situations. His power play rate is slightly below the group average, but is identical to that of Lindros and very close to Modano's.  Yzerman's PP number is interesting, given that it is much lower than the others.  To add to that, Brendan Shanahan's participation rate in the same unit was 61.4%.  These numbers suggest that the Red Wings' dominant power play unit was more of a team effort than, say, the Colorado Avalanche power play which was very dependent on Sakic and Forsberg.

Was Mats Sundin a poor performer on the power play, or was he merely a victim of a poor special teams unit in Toronto? It's probably at least a bit of both. Sundin apparently wasn't good enough to singlehandedly lift his team's unit above average, but he did score 47 points with the man advantage with Quebec in 1992-93 as a member of a standout PP lineup also consisting of Sakic and Steve Duchesne. Sundin also saw his rate jump in 2002-03 to 5.1 PPP/60 after several seasons in a row in the 3s or low 4s.  Over the remainder of his career Sundin never again dropped below 5.2.
Maybe he finally figured out how to score as a 31-year old, or maybe adding teammates like Nolan, Mogilny and Nieuwendyk had an impact and helped boost Sundin's scoring statistics.

It is interesting to compare the power play numbers for Sundin's Maple Leafs with Brendan Shanahan's Detroit Red Wings during the same period (1998 to 2004). Putting the top 10 in power play goals for each team side by side really illustrates the difference in quality, and does seem to suggest that Sundin would have most likely been able to rack up a lot more points if he had better teammates to share the load with the man advantage.

Detroit Red Wings, Power Play Goals ('98-04):

1. Brendan Shanahan, 81
2. Steve Yzerman, 52
3. Nicklas Lidstrom, 46
4. Sergei Fedorov, 46
5. Tomas Holmstrom, 43
6. Brett Hull, 29
7. Martin Lapointe, 25
8. Igor Larionov, 21
9. Vyacheslav Kozlov, 20
10. Luc Robitaille, 16

Toronto Maple Leafs, Power Play Goals ('98-04):

1. Mats Sundin, 69
2. Gary Roberts, 28
3. Sergei Berezin, 27
4. Bryan McCabe, 22
5. Steve Thomas, 21
6. Darcy Tucker, 21
7. Jonas Hoglund, 17
8. Igor Korolev, 14
8. Alexander Mogilny, 14
10. Mikael Renberg, 13

I think Sundin was disadvantaged by team factors, particularly from 1997 to 2002, which also happens to be his peak period of even strength scoring.  As the team's best player he should shoulder some of the blame for Toronto being so mediocre with the man advantage, but results from earlier and later in his career show that when Sundin did have the good fortune to play together with star linemates then he was able to post better power play scoring numbers.  Pumping up his PP scoring stats could have moved Sundin from the 75-85 point range to a consistent 90+, which would have made him a more significant factor in the overall scoring race and in turn would have seen him viewed in a much more positive light today.


One final stat to compare Sundin and Shanahan:  In the 18 seasons where both of them played in the NHL, Shanahan scored more even strength points than Sundin only twice.  I'd take Sundin over Shanny every single time, and I think he's a deserving first ballot Hall of Famer.

Wednesday, June 6, 2012

Darryl Sutter and Goaltending

Darryl Sutter is getting a lot of credit for his impact on the Los Angeles Kings this season, which is perhaps not too surprising given that the team was 15-14-4 prior to his hire and 40-15-11 since, playoffs included.  Jon Quick is all over the headlines for his ridiculous postseason numbers, and certainly much of that is deserved, but there is also some historical evidence that suggests Sutter may be in the class of coaches that have a positive impact on the statistics of their goaltenders.

Throughout his career, Sutter's goaltenders have routinely been above average.  Sutter-led teams have only posted a below-average save percentage in two out of his dozen seasons as an NHL coach, and in every one of the remaining ten his team was at least .006 above the league benchmark in save rate:

1992-93: .901 in Chicago (.885 avg)
1993-94: .902 in Chicago (.895 avg)
1994-95: .907 in Chicago (.901 avg)
1997-98: .896 in San Jose (.906 avg)
1998-99: .915 in San Jose (.908 avg)
1999-00: .911 in San Jose (.904 avg)
2000-01: .914 in San Jose (.903 avg)
2001-02: .918 in San Jose (.908 avg)
2002-03: .897 in San Jose/Calgary (.909 avg)
2003-04: .919 in Calgary (.911 avg)
2005-06: .917 in Calgary (.901 avg)
2011-12: .930 in Los Angeles (.914 avg)

Overall:  .910 under Sutter, .903 league average

Sutter had Belfour for three seasons, Kiprusoff for two and Quick this past year, so he was partially lucky to benefit from some good goaltending.  However, the numbers before and after he arrived in the different towns seem to suggest that there was a consistent save percentage effect as a result of Sutter's hiring.  I looked at the full season prior to Sutter being hired and the full season after he was fired, with partial in-season results before he was hired/after he was fired also included in the before and after sample:

Chicago (before & after):  4352 SA, .898 save %, .893 average, +.005
Chicago under Sutter:  5940 SA, .903 save %, .892 average, +.011

San Jose (before & after):  6434 SA, .906 save %, .908 average, -.002
San Jose under Sutter:  11781 SA, .910 save %, .906 average, +.004

Calgary (before & after):  5738 SA, .909 save %, .907 average, +.002
Calgary under Sutter:  5545 SA, .914 save %, .906 average, +.008

Los Angeles (before):  3258 SA, .917 save %, .913 average, +.004
Los Angeles under Sutter:  1271 SA, .930 save %, .914 average, +.016

That's a consistent bump of .006 at each of Sutter's first three stops, with his L.A. numbers looking even better so far.

I should point out however that selection bias probably has an impact here, given that teams with low save percentages would be more likely to fire coaches and hire replacements.

Combined before sample:  .901 save percentage, .905 league average, -.004
Combined sample with Sutter:  .910 save percentage, .903 league average, +.007
Combined after sample:  .914 save percentage, .906 league average, +.008

Looking at it this way gives a potentially much less charitable interpretation of Sutter's true impact:  Maybe he simply coached some good goalies and was the beneficiary of teams bouncing back from poor seasons.  On the other hand, it does seem reasonable that the impact of a coach would continue in at least some fashion even after they leave town.  If Sutter played a key role in developing young players or established a style of play that the team continued to use under his successor then he could be partially credited for some of those continuing effects.

It is always important to take regression to the mean into account when evaluating coaches, or else guys hired by underachieving teams will look like heroes nearly every time as the team's results gradually change to more closely match their overall level of talent.  Sutter is not a miracle worker, and I think that Jack Johnson for Jeff Carter trade had a larger impact on the Kings' amazing transformation into a playoff juggernaut than their mid-season coaching change.  On the other hand, Los Angeles is certainly doing a great job of protecting their goaltender through great defensive play at the moment, and that reflects well on their head coach.

In the competitive world of the NHL, slight edges can sometimes end up being important, and Sutter's coaching may just be providing Jonathan Quick the defensive advantage needed to help the Kings' goaltender complete his memorable season with a great postseason run that currently has him holding the highest official playoff save percentage of all-time among goalies that participated in more than one playoff round.

Monday, May 28, 2012

Shootout Records Don't Predict Playoff Success

There was an interesting statistical pattern this year in the first round of the playoffs:  Only one of the goalies on a winning team had a better shootout win/loss record this year than his counterpart on the losing team.

Rangers vs. Ottawa:  Lundqvist 4-3, Anderson 6-1, Rangers win
Boston vs. Washington:  Thomas 7-1, Holtby 0-1, Caps win
Florida vs. New Jersey:  Theodore 4-7, Brodeur 7-2, Devils win
Pittsburgh vs. Philadelphia:  Fleury 9-2, Bryzgalov 3-5, Flyers win

Vancouver vs. Los Angeles:  Luongo 6-6 (Schneider 2-1), Quick 6-8, Kings win
St. Louis vs. San Jose:  Halak 3-7 (Eliott 1-3), Niemi 8-4, Blues win
Phoenix vs. Chicago:  Smith 6-8, Crawford 6-4, Coyotes win
Nashville vs. Detroit:  Rinne 4-5, Howard 7-2, Predators win

Combined totals:
Winning goalies:  34-42 in shootouts this year
Losing goalies:  55-28 in shootouts this year

This result was surely largely influenced by randomness, especially given that the trend somewhat reversed itself in subsequent rounds with Brodeur and the Devils continuing to win.  However, some matchups probably looked closer than they were in the standings because the weaker team had the benefit of a regular season shootout edge.  The Flyers, for example, would have had a better record than the Penguins if all shootouts were counted as ties (although the Penguins' goal differential advantage indicates that Pittsburgh probably still should have been a slight favourite in that series).

The shootout looks like it is here to stay in the NHL, but it does still seem unfair that it has an impact on the regular season standings that are used to determine playoff seedings.  When comparing two teams to make predictions for a playoff series, shootout results should obviously be disregarded.  That said, regular season records aren't even the best way to predict which playoff teams to bet on anyway (as the Kings and Devils are currently demonstrating), with metrics such as score-tied Fenwick and goal differential showing more predictive power anyway.

Tuesday, May 22, 2012

Mike Smith: Good Season or Good Goalie?

Case A:  2011-12 Was A Fluke Season

The fact that goalie results are heavily influenced by randomness and have a lot of variance from year-to-year has been clearly established by statistical analysis.  It would be very unlikely for an ordinary starting goalie to hit .930 just by luck, but it is not beyond the realm of possibility.  If the goalie is perhaps slightly above-average and aided by some relevant team factors then that explanation becomes a lot more compelling.  The sudden massive improvement in numbers for Mike Smith makes it reasonable to question where his true talent lies.  After all, it is not very often that a 30-year old goalie is able to bump up his career save percentage by .008 in the course of a single season.

The most commonly advanced argument by those seeking to downgrade Mike Smith is the team argument that claims that Dave Tippett is a defensive genius that helps all goaltenders succeed in Phoenix.  It's generally a good idea to be skeptical of shot quality arguments, but on the other hand there are three goalies now that have superior numbers under Tippett then they managed everywhere else since the lockout (regular season and playoffs combined):

Ilya Bryzgalov:
Without Tippett:  7517 SA, .911
With Tippett:  4481 SA, .919

Jason LaBarbera:
Without Tippett:  2703 SA, .905
With Tippett:  1474 SA, .916

Mike Smith:
Without Tippett:  4430 SA, .907
With Tippett:  2617 SA, .934

It is probably also worth noting that Smith played in the Pacific Division, a division that had a higher average save percentage than any other division in the league.  Part of that is surely because the Pacific has some great, top-flight goalies, but the league-leading number was also likely influenced at least to some degree by the tight style of play that is more typical for teams on the West Coast.

In the playoffs and regular season combined this year, Smith has faced just 15% of his shots against on the penalty kill.  Throughout the rest of his career his average was 19% (although part of the decrease was because penalties were down in 2011-12).  Smith also posted a .909 save percentage on the PK, which vastly surpasses his previous career PK rate of .874.  This year was only the second time in his career that Smith's PK rate even went above .880.

If Smith had faced 19% of his shots against on the PK with a PK save percentage of .880, his seasonal save percentage would have dropped .006 to .924.  Assuming that Phoenix has some additional shot quality effect at even strength relative to the rest of the league, he may only have played at a level of around .920 in a neutral team situation.  Obviously Smith had a terrific campaign, but perhaps those potential team factors caused some skeptical GMs around the league to drop him out of the top three in Vezina voting, even though his numbers suggest he probably deserved that ranking (Smith led the league in GVT, a measure that historically tracks very well with Vezina winners).

One large negative indicator for Mike Smith heading into this season is that he had an extreme home/road split.  Prior to this year he had a career save percentage of .918 at home compared to just .896 on the road.  That's usually not a good sign, given that road save percentages are subject to less potential scorer bias since they are spread across a number of different arenas.  This year, Smith's degree of improvement on the road (+.030 to .926) was almost twice as much as the increase in his home save percentage (+.016 to .934).  It is perhaps interesting to note that both LaBarbera (.922 on the road) and Bryzgalov (.921) have excellent road numbers under Tippett in Phoenix (both actually did better away from home than they did in Glendale). Phoenix has also finished in the top eight in road record in each of the past three seasons, despite finishing 16th in points at home this season for the second year in a row.

To summarize, Smith's track record doesn't support anything close to a season of 67 GP at .930, and there is evidence that suggests Phoenix may be a place that helps its goalies out a bit.  As a result, Smith is probably headed for a major regression in his numbers for 2012-13.


Case B:  Mike Smith Is A Good Goalie

Smith has been very impressive in the playoffs, causing some to argue that his game has developed and he is in the process of joining the game's goaltending elite.  The caveat is that subjective arguments are affected by all kinds of observer biases, and sometimes it is hard to differentiate between a good goalie and a lucky goalie or a hot goalie, but Smith's numbers have been so outstanding that it is likely they do represent a significant improvement, even taking into account some of the other factors that may be in play.

One of the biggest question marks in evaluating Mike Smith is determining how much of an impact the concussion he suffered late in 2008 had on his career development.  It's certainly possible to make the numbers fit a narrative that portrays Smith as a promising goalie early in his career before he was brought low by a concussion, and that it shouldn't be that surprising that Smith has blossomed into a quality NHL starter now that he has fully recovered.

Smith was concussed in December 2008.  His career save percentage as of December 31, 2008 was .913, which is very strong taking into account the league average of .907 from 2007 to 2009.  Smith's 2008-09 season on a really bad Tampa team looks quite impressive in retrospect.  The Lightning fired Barry Melrose in mid-season, ended up second last overall, and went 10-22-9 with a 3.62 GAA with their backup goalies in the net (Smith himself was 14-18-9 and 2.62).  Unfortunately Smith's campaign was cut short by his concussion symptoms.

How much did the effects of his head injury affect Smith in 2009-10 and 2010-11?  It's difficult to tell, particularly because he faced a relatively small sample size of 1600 shots.  In 2010-11 he would likely have been much closer to full recovery, but rarely played in a backup role behind Dwayne Roloson.  Smith's combined numbers for those two seasons, together with January 2009 when he was playing with concussion symptoms before getting shut down for the year, come to .899 on 2096 SA, which is well below where he was prior to the injury.

Smith have simply have been somewhat lucky early in his career and then unlucky later on, we've seen that happen many times over a couple of 2000 shot samples.  However, it is also entirely possible that his injury had a major impact on his results and that he has had above-average talent since the start of his career.

It has been widely reported that Phoenix goalie coach Sean Burke wanted to bring in Mike Smith because Burke saw potential there.  Maybe Burke was correct that Smith was a star in waiting, although a cautionary note is that those are the types of things that are easy to say in hindsight if you want to make a specific talent evaluator or coach look great, mainly because they don't account for any of the misses (if Smith didn't work out then nobody would be writing stories about how Sean Burke got it wrong).

Smith's two-year, $4 million deal doesn't exactly suggest that Phoenix thought they were going to be getting Vezina-calibre goaltending, but at the same time with LaBarbera in the backup role and no real other options on the farm the Coyotes were clearly betting their season on Smith.  If they didn't think he was going to be at least average it is questionable whether they would have made that move.  Goalies don't always follow linear career paths, and maybe the change of scenery combined with coaching and his personal development helped Smith make the jump and join the games' elite.

Conclusion

It seems to be an absolute rock-solid bet that Mike Smith's numbers are going to regress next season, and that his true talent level doesn't quite measure up to the level of performance he has displayed this year.  On the other hand, it seems clear that Smith's concussion had a negative impact on his career, and as a result his career numbers are at least somewhat understated.

There is a chance that Smith is now one of the game's best goalies, and there is a chance that this was his career season.  The most likely case is that Smith is not an elite goalie who can be counted on to remain near the top of the league year after year, but he may be an above-average starter who still has a number of useful years ahead of him.  Smith is probably still a good candidate to put up another season of around .920 or maybe even a little better next year, given Phoenix's team discipline and the fact that he outperformed league average by .006 over a three season stretch earlier in his career when he was likely not as good as he is right now.

Thursday, May 10, 2012

Understanding When to Make A Save

"Goaltending in the playoffs so much is about when you give up goals, giving your team a chance to stay in a game when the momentum's going against you or when you've had it.  Brian Elliott simply didn't do that...Conversely, Jonathan Quick, he was timely, he was strong on his game.  The St Louis Blues scored six goals in this series on Jonathan Quick, largely due in part to him not only being a talented goaltender, but to being dialed in to the time of the game and understanding that a save needed to be made, he was there all the way through the series."  (Craig Button, TSN panel)

I'm pretty sure that Jonathan Quick probably does understand when a save needs to be made a lot better than Craig Button does.  If any goalie is in a position to realize the importance of every goal against, it is the backstop for a Los Angeles team that ranked 29th in the league in scoring and played in nine 1-0 games this season.  Even with the Kings' improved playoff offence, it seems very unlikely that Quick was taking anything for granted.  Obviously any goalie who allows just six goals against in four games is making a lot of saves, not just a lot of "timely" saves, and Quick has been great so far in these playoffs because he has stopped nearly everything that has been thrown at him.

If you had to make a case for anything about the Kings being timely, it would be their scoring and possession game more so than their goaltending.  Against St. Louis Quick was pretty great regardless of score, posting a save percentage of .947 or better during each of the key score differentials (down by 1, tied, leading by 1).  The Kings' offence scored 1/4 (25%) while trailing by one, 6/33 (18.2%) while tied, and 3/35 (8.6%) when leading by one.

Los Angeles was also dominant on the shot clock over the Blues with the score tied.  In game one shots were 16-16 and goals were 1-1 with the game tied, and a strong effort from Quick was a big factor in the result.  In games two through four, however, the Kings outshot St. Louis 17-6 and outscored them 5-0 with the score tied.  To score almost as many goals as shots allowed is amazing.  In addition, the average distance on those half-dozen shots against was 42.2 feet and probably only a couple of them could even be marked down as scoring chances.

The biggest problem with Button's logic, though, is the implication that there is choice involved in goaltending.  His absurd premise is that any goaltender can choose to stop any puck, if only they have the necessary clutchness or understanding of clutch play to know that it would be best for them to make that save, and that the difference between a goalie who performs well in a pressure situation and one that doesn't is merely a matter of knowledge or understanding.  Anyone making that claim obviously doesn't understand how much making saves requires a netminder to play the percentages, particularly in today's NHL where key goals are often scored through screens or from deflections or on pucks ping-ponging around the crease or slot area.

Even if goalies can increase their focus or energy level and actually boost their results (which is debatable), that still doesn't mean they have any chance at all at stopping a screened double-deflection into the top corner no matter how well they understand the delicate balance of momentum at that exact point in the game.  It really doesn't take a mathematical background or a detailed knowledge of expected win probabilities to understand that goals against are a bad thing in close hockey games.  That simple knowledge is surely the most basic of prerequisites to tend goal in the NHL, and it seems preposterous that it actually has an impact on the outcome of any games.

Thursday, April 26, 2012

Two of the Closest Series Ever

Last night's overtime victory by Washington completed what was likely the closest series in NHL history in terms of score.  Not only was every game decided by a single goal, but 99.4% of the entire series was played with a goal differential of one or less.  The only time either team managed to take a two goal lead over the seven games was when Jay Beagle scored in the second period of game five to put the Caps up 2-0, a margin that lasted less than three minutes before the Bruins cut it to 2-1.

The West had a matchup that was also a strong contender for the title of closest ever right up until the final period of the series.  Phoenix and Chicago went to overtime in each of the first five games of the series, and by the time of the second intermission in game six had spent 99.3% of their series tied or with one of the teams leading by a lone goal.  However, in that final period Phoenix finally broke through and pulled away for a decisive 4-0 win.

I thought it would be interesting to look at numbers broken down by score in these two series to see why they were so tight.

Boston vs. Washington:

Washington Up One:
Shots:  Washington 30, Boston 72
Goals:  Washington 1, Boston 7
Save %:  Holtby .903, Thomas .967

Score Tied:
Shots:  Washington 145, Boston 162
Goals:  Washington 11, Boston 7
Save %:  Holtby .957, Thomas .924

Boston Up One:
Shots:  Washington 32, Boston 11
Goals:  Washington 4, Boston 0
Save %:  Holtby 1.000, Thomas .875

There were major score effects during the series, as would be expected.  Including the brief period when Boston was down by 2, the trailing team outshot the team in the lead by the whopping margin of 107-41 and scored 12 goals in just 141.7 minutes of play for an amazing rate of 5.08 goals per 60 minutes.  The leading team managed just one goal (0.42 per 60), scoring on just 2.4% of their shots taken.

It is typical that the trailing team generates more shot attempts, but usually their percentages drop as they put more pucks on the net and take more risks, leaving themselves open to chances going back the other way.  For whatever reason both the Caps and Bruins were able to get away with almost everything in their own end when pushing for the tie.

The overall shot statistics flatter the Bruins a bit because they spent more time trailing.  Boston outshot Washington by 20% overall but by just 12% with the game tied.  It was still a very close series, and Washington was pushed over the top by an impressive effort from rookie netminder Braden Holtby.

The Chicago-Phoenix series was similarly close in terms of scores, but the underlying numbers suggest that balance of play wasn't nearly as tight.

Phoenix vs. Chicago:

Phoenix Up Two Goals or More:
Shots:  Phoenix 11, Chicago 11
Goals:  Phoenix 2, Chicago 1
Save %:  Smith .909, Crawford .818

Phoenix Up One:
Shots:  Phoenix 40, Chicago 76
Goals:  Phoenix 2, Chicago 5
Save %:  Smith .934, Crawford .950

Game Tied:
Shots:  Phoenix 73, Chicago 124
Goals:  Phoenix 9, Chicago 6
Save %:  Smith .952, Crawford .877

Chicago Up One:
Shots:  Phoenix 35, Chicago 30
Goals:  Phoenix 4, Chicago 0
Save %:  Smith 1.000, Crawford .886

In this series the Blackhawks outshot the Coyotes by 51% overall, and an impressive 70% with the game tied, yet somehow managed to get outscored 17-12 over the course of six games, as well 9-6 in tie-game situations.  The strong goaltending of Mike Smith compared to the inconsistent play of Corey Crawford was the decisive factor in the series.

Smith was particularly strong in game six, a game where everything was massively tilted in favour of Chicago except for the scoreboard.  I also found it interesting that Smith had the highest save percentage of any of the four goaltenders while his team held a one goal lead, which was perhaps unexpected given that the Blackhawks fought back three times to tie the game late in the third period.  Several posters in this HFBoards thread specifically downgrade Smith's first-round performance because of his supposed lack of clutch play in allowing late game-tying goals, but to me that's making the classic mistake of evaluating playoff performance:  Letting a few memorable events have too much influence while failing to properly appreciate the larger picture.

For the sake of comparison, Braden Holtby gave up a lead in five out of seven games, including twice in the third period, yet nobody would call him unclutch.  Allowing goals against in the final 10 seconds obviously has a huge negative impact on a team's win probability, but when 99% of the series is within one goal then every goal against has a major impact on the chance of victory.  Other than one third period in Chicago, pretty much every situation these four goalies have faced so far in the 2012 playoffs was a clutch situation.

Just as with Washington and Boston, the trailing team rode both a large outshooting advantage and insanely high percentages.  Overall, shots were 122-81 in favour of the team playing catch-up, with turned into a 10-4 advantage on the scoreboard.  That works out to a rate of 3.16 goals per minute for the trailing team, compared to just 1.26 for the team holding on to a lead.

In some respects it is amazing that Chicago even came as close to winning the series as they did, given that Phoenix's scoring rate per shot was over twice as high.  The repeated late-game comebacks to force OT kept them in it, but unfortunately the goaltending disparity was perhaps never more apparent than in extra time where Smith managed a .923 save percentage while Crawford put up a mere .813 and let in two very soft goals to help the Coyotes to the franchise's first second round appearance since 1987.

It would be interesting to see detailed scoring chance numbers or a breakdown of odd-man rush chances to see whether the leading teams were generating chances and just missing their shots, or whether their defensive focus meant they were not creating many dangerous opportunities to score.  In the absence of compelling evidence, however, I'd guess it was mainly a tremendous run of hot goaltending that kept the scores close (in both series combined, goalies on teams trailing by one stopped 97.3% of the shots against) and created 13 games of razor-thin margins in these two memorable series.