Which NFL Draft Expert Had The Dumbest Mock Draft?
Republished with permission from Pundit Tracker.
The 2013 NFL Draft was widely viewed to be more unpredictable than most. After grading the mock drafts of Mel Kiper (ESPN), Todd McShay (ESPN), and Mike Mayock (NFL.com), we can confirm that those views proved correct: all three pundits had a rough year. Todd McShay, who was #1 in mock draft accuracy in each of the past four years, had a particularly woeful showing.
Let’s start with our simple variability measure, which is based on the difference between when each player was projected to be picked and when he was actually picked. A lower variability score is better:
Variability 2008 2009 2010 2011 2012 2013 Average
Mayock 7.3 9.6 9.9 9.3 7.9 10.7 9.1
Kiper 10.1 8.8 10.4 7.7 8.5 11.7 9.6
McShay 10.7 8.7 8.8 6.8 7 21.5 10.6
The average variability for the three pundits from 2008-12 was 8.8, which underscores just how poor their 2013 performance (14.7 average) was. Big misses for all three included Sharrif Floyd going #3 to Oakland (he went #23 to Minnesota) and Eddie Lacy going late in the first round (actually went late second round). McShay and Mayock both whiffed on Geno Smith, picking him to go #6 to Cleveland (actual: #39 to Jets).
The worst projection of all, however, was McShay pegging Ryan Nassib going #7 to Buffalo (actual: #110 to the Giants). This was by the far the worst first-round projection since we started tracking the mock drafts in 2008.
Here are all the major hits and misses:
Biggest Hits and Misses (2008-2013)
The variability metric can be significantly impacted by “outliers” such as Nassib, so we have calculated a host of alternative metrics, including:
Capped Variability (lower = better): caps the maximum penalty of any pick at one round—for instance, McShay’s Nassib pick would be graded as 32 spots off rather than 103 spots
Median Error (lower = better)
Hit Rate (higher = better): pure percentage of how many picks were correct
Here are the results for these three metrics from 2008-2013.
Capped Variability 2008 2009 2010 2011 2012 2013 Average
Mayock 7.3 9.6 9.3 9.3 7.9 10.3 8.9
McShay 10.7 8.7 8.7 6.8 7 12.3 9.1
Kiper 10.1 8.2 9.5 7.7 8.5 10.9 9.3
Median Error 2008 2009 2010 2011 2012 2013 Average
Mayock 2 4 3 3 3.5 3.5 3.2
Kiper 3 3.5 3 4 3 3.5 3.4
McShay 4 4 3 3.5 3 5 3.8
Hit Rate 2008 2009 2010 2011 2012 2013 Average
Mayock 35% 28% 22% 28% 19% 28% 27%
Kiper 29% 25% 31% 28% 22% 25% 27%
McShay 16% 25% 34% 25% 16% 22% 23%
PunditTracker's mission is to bring accountability to the prediction industry by cataloging and scoring the predictions of pundits. This post has been corrected to reflect that Pete Thamel works for Sports Illustrated.
at the side shots at Cam...are yall really trying to compare Mark to Cam, like really?
It's always something new.
