By: John Shirley

Within the 2020 SIS Rookie Handbook, we provided a look at how well some player-level quarterback metrics correlate between the NCAA and the NFL. The following table and excerpt from the Handbook summarizes the results:

Correlation of QB Rate Metrics

MetricNFL Year-to-Year (n=71)Final NCAA Season to NFL Career (n=20)
Scramble%0.760.50
ADoT0.410.40
Catchable%0.480.33
ADoC0.330.29
Comp%0.490.22
Sack%0.340.04
EPA/DB0.330.04
TD/INT0.320.03
Y/A0.310.00

“The metrics that correlate the highest year-to-year are the ones that measure what quarterbacks have the most control over: accuracy (Catchable%), aggressiveness (ADoT), and the decision to scramble (Scramble%). These are also the same things that have a high correlation from college to the NFL. Performance value metrics have much lower year-to-year correlations and NCAA to NFL correlations, most likely due to the fact that these measure overall offensive performance instead of direct quarterback performance.

“SIS’s Total Points value metric shows relative stability at the NFL level (correlation = .45), but as we only have NCAA Total Points data for 2018 and 2019, we do not have a large enough sample to model a relationship. This is also a drawback for all of the quarterback metrics, as any relationship based on a sample size of 20 should be taken as a first glimpse and not gospel.”

Using this information, we can see that the top five metrics (Scramble%, ADoT, Catchable%, ADoC, and Completion%) show some relationship between a player’s performance in college and his performance in the NFL. By using these metrics and historical college data from previous draft classes, we can compare this season’s quarterback prospects to the college performance of current NFL players. We’ll use a similarity score on the scale of 0 to 100, with a higher number representing a more similar player.

Results

SIS Rookie Handbook Position RankPlayerMost Similar PlayerSimilarity Score
1Joe BurrowBaker Mayfield73
2Tua TagovailoaDwayne Haskins86
3Justin HerbertDeshaun Watson92
4Jordan LoveSam Darnold81
5Jacob EasonDrew Lock89
6Jake FrommCooper Rush88
7Tyler HuntleyJake Browning69
8Jalen HurtsKyler Murray74
9Anthony GordonGardner Minshew II84
10Steven MontezDaniel Jones87

 

SeasonPlayerScramble%ADoTCatchable%ADoCComp%
2017Baker Mayfield5.7%10.788.3%8.170.5%
2019Joe Burrow7.4%9.191.2%7.776.3%

Joe Burrow’s closest statistical comparison is fellow Heisman winner Baker Mayfield. Although, this is one of the weaker comparisons among the group. This is mainly due to how incredible Burrow’s season was. There are not many other quarterbacks that can compare to his high-level accuracy, while also pushing the ball down the field with an ADoT of 9.1.

SeasonPlayerScramble%ADoTCatchable%ADoCComp%
2018Dwayne Haskins5.0%7.985.3%6.370.0%
2019Tua Tagovailoa4.0%8.387.8%6.171.4%

If this result surprises you because of the difference in stature between the two quarterbacks, maybe their similar stat lines convince you otherwise. It’s worth noting that if we include height as a variable in our model, Deshaun Watson becomes Tua’s strongest comparison.

SeasonPlayerScramble%ADoTCatchable%ADoCComp%
2016Deshaun Watson4.0%8.585.1%5.667.0%
2019Justin Herbert4.0%8.483.4%5.866.7%

Justin Herbert and Deshaun Watson have the highest similarity score among the group, and when you look at their near-identical key statistics, it’s easy to see why. That said, if the 4 inch difference height between the two is too much for you to see past (pun intended), our height-inclusive model pegs Daniel Jones as most similar to Herbert, albeit with a similarity score of just 77.

How It Works

The first part of creating the similarity scores is to normalize the five input metrics, which essentially means that we are adjusting them so that they are all on the same scale of 0 to 1.

We can then input the normalized metrics into the distance formula, which compares all players to each other and measures how far apart each player is based on the inputs. So, players with similar metrics will have short distances, while players with wildly different performances will be far apart.

The final part of the process is to create a similarity score out of the distances. This will be done by using the formula: 1 / (1+Distance). The final output will be a similarity score on the scale of 0 to 100, with a higher number representing a more similar player.

This doesn’t mean each player will have a similar NFL career path as their comparison. But, it can be a fun and useful way of analyzing prospects. For more in-depth stats and full scouting reports on the entire 2020 draft class purchase the 2020 SIS Rookie Handbook.