This project is a tool created by a team at the University of Wisconsin-Madison College of Engineering for forecasting the first four team NCAA football playoff using Monte Carlo simulation and data analytics.
I am very excited to present our first NCAA playoff forecasts today.
As mentioned in the methodology section, we consider three variants of the ranking methodology we use in our simulation. Below, we present the results for our models as well as the ensemble model that average across the three models, with 10,000 replications for each model. Let’s start with the ensemble model. Comments on the results are below.
Ensemble model results
The top teams to make the playoff with the fraction of simulations in playoff.
- Florida State : 0.303544
- Mississippi State : 0.289211
- Mississippi : 0.260909
- Alabama : 0.174873
- Georgia : 0.163807
- Notre Dame : 0.139638
- Minnesota : 0.138238
- Michigan State : 0.111237
- Auburn : 0.11037
- Nebraska : 0.10457
- Oregon : 0.0891697
- Arizona : 0.0735691
- Marshall : 0.0639723
- Utah : 0.0629354
- Baylor : 0.0569019
- Ohio State : 0.0568352
- Duke : 0.0516018
- Texas Christian : 0.0446682
- Kansas State : 0.0359679
- Louisiana State : 0.030501
- Louisville : 0.0259342
- Arizona State : 0.0253008
- Washington : 0.0249675
- Colorado State : 0.0240008
- Penn State : 0.0215341
The top teams to just miss the playoff with the fraction of simulations ranked fifth.
- Florida State : 0.0397347
- Mississippi State : 0.0362014
- Georgia : 0.0360347
- Notre Dame : 0.0335011
- Minnesota : 0.0323011
- Alabama : 0.0307678
- Mississippi : 0.0303681
- Michigan State : 0.0277009
- Nebraska : 0.0274343
- Marshall : 0.0270344
The fraction of playoffs with at least one team from each major conference:
- ACC: 0.495
- Big12: 0.231
- B1G: 0.528
- PAC12: 0.387
- SEC: 0.845
Comments:
We see that the SEC will almost certainly have a team (probably 2) in the playoff. The other conferences do not look as good. Based on inter-conference play, it looks like teams from the PAC12 looks weaker than it should (there are no undefeated teams) and B1G looks stronger than it should. Likewise, it looks like too many B1G teams will make the playoff in the simulation. Again, this happens because we don’t have humans in the loop at all – our model does not even “see” expert rankings such as the AP Top 25 or the USA Today Coaches polls based on the games played thus far. In the future, we will explore how additional information can be used to “vote” for teams in our model.
After eight weeks of footballs, the team-to-team network created by wins and losses is still pretty sparse. As a result, some of the forecasts made are too bold (I’m looking at you Minnesota!). We will have a more connected network when more games have been played, and with more data will come more refined forecasts.
Also keep in mind that the strength of schedule for future games is not equal between teams, and therefore, some teams are downgraded based on tough future matchups. However, there is still a lot of football to play – this should become more apparent a couple of weeks before the end of the season.
See you next week! Don’t forget to follow us on twitter @badgerbrackets
.
The results from the three models used in the ensemble model are below.
Results for the wins only model.
The top teams to make the playoff with the fraction of simulations in playoff.
- Florida State : 0.5385
- Mississippi State : 0.3947
- Georgia : 0.2706
- Mississippi : 0.251
- Alabama : 0.2139
- Michigan State : 0.2115
- Auburn : 0.2039
- Oregon : 0.1897
- Nebraska : 0.1839
- Minnesota : 0.1578
The top teams to just miss the playoff with the fraction of simulations ranked fifth.
- Auburn : 0.0504
- Georgia : 0.0496
- Mississippi State : 0.0474
- Mississippi : 0.0472
- Florida State : 0.0464
Results for the wins and losses model.
The top teams to make the playoff with the fraction of simulations in playoff.
- Mississippi : 0.5022
- Mississippi State : 0.4298
- Florida State : 0.4166
- Alabama : 0.2536
- Notre Dame : 0.2103
- Minnesota : 0.1996
- Georgia : 0.1811
- Auburn : 0.1405
- Utah : 0.1359
- Oregon : 0.1321
The top teams to just miss the playoff with the fraction of simulations ranked fifth.
- Florida State : 0.0797
- Georgia : 0.0627
- Mississippi State : 0.0504
- Alabama : 0.0479
- Marshall : 0.0477
Results for the full model.
The top teams to make the playoff with the fraction of simulations in playoff.
- Mississippi : 0.5288
- Mississippi State : 0.4726
- Florida State : 0.3742
- Alabama : 0.3115
- Notre Dame : 0.2779
- Minnesota : 0.2605
- Georgia : 0.21
- Auburn : 0.1437
- Arizona : 0.132
- Michigan State : 0.1301
The top teams to just miss the playoff with the fraction of simulations ranked fifth.
- Florida State : 0.0782
- Mississippi State : 0.066
- Notre Dame : 0.0606
- Georgia : 0.0589
- Minnesota : 0.0589