Who has the inside track on the playoff? You can ask a number of experts and analysts. One of the more popular computer-based prognosticators, thanks to their affiliation with ESPN, is FiveThirtyEight.
And, so, it seemed like a good measuring stick with which to compare the accuracy of this college football blog. Five weeks before the end of the season we crafted a system of comparison to judge which system was more accurate. Final Score:
Analyzing ‘only’ conference champions and playoff participants is, admittedly, a rather narrow comparison. Analyzing only a single year’s data is also narrow. But we’ll chalk up a victory for this site and below give you a breakdown of predictions.
|Big Ten-Penn State||19.2||24.2|
|Big 12-OK State||22.2||32.8|
These numbers represent the average over the last 5 weeks that a given team would win the listed “Championship”. Viewing only the bolded Champions reveals a 3:3 tie between the two computers. Getting into these championship games, however, was predicted slightly better by the CFB Computer, which more heavily favored 4 of the 6 runner-ups.
Except for the National Championship, “winning” any of the above championships is accomplished solely on the field. Being able to predict the slightly subjective choices of the playoff committee is a degree more difficult.
The CFB Computer scores a 3:1 victory here (4:1 when including median), and by a healthy margin. What led to this victory? Two things. One, you’ll notice how much expectation 538 pinned on Oklahoma, a 2-loss team from a middling conference who already lost to Ohio State. Our computer had a similar, though smaller, love affair with Western Michigan, but Oklahoma was well understood to be behind any 2-loss Big Ten Champ.
Two, the CFB Computer weights SOS a little heavier than 538, compared to the number of losses. Fourth seed Washington, the only playoff team 538 weighted more heavily, arguably got into the playoff solely on their 12-1 record (see 2014 Florida State jumping TCU), rather than because of their performance. They were this year’s Cinderella. We simply had higher expectations that they lose another game, and while a Cinderella can monkey with an otherwise perfect bracket, it does not detract from the CFB Computer’s victory over FiveThirtyEight and ESPN’s FPI.
See you next year! Hopefully then we can compare more than 2 systems.