tag:blogger.com,1999:blog-38600807.post4124676228589837136..comments2015-01-23T09:58:36.299-05:00Comments on Advanced Football Analytics (formerly Advanced NFL Stats): Team Efficiency Rankings - Week 12Brian Burkenoreply@blogger.comBlogger40125tag:blogger.com,1999:blog-38600807.post-7110743632606435812012-11-29T14:09:39.277-05:002012-11-29T14:09:39.277-05:00Let me cut through the crap, and answer your quest...Let me cut through the crap, and answer your question: Carolina loses games it shouldn't because Ron Rivera sucks. Simply put, he is not a bright guy. One piece of evidence: He benches his $43 million RB DeAngelo Williams all year, and now he tells us how great he is: http://sports.yahoo.com/news/rivera-panthers-confidence-rb-williams-100258526--nfl.html.<br /><br />The guy is dumb.Montanahttp://www.blogger.com/profile/08179329838880839059noreply@blogger.comtag:blogger.com,1999:blog-38600807.post-36255271293298578162012-11-27T00:17:10.313-05:002012-11-27T00:17:10.313-05:00@ Mike M, just because you predicted one game corr...@ Mike M, just because you predicted one game correctly doesn't mean your explanation was correct. A predicted 61% chance to win means 39% chance of losing.<br /><br />It's a truism that teams regress toward the mean, but there isn't a set number of games after which they regress toward the mean - it's just like flipping a coin, after 10 heads in a row, the likelihood of the next flip being tails is not higher because the coin must regress to the mean. But of course if after a few heads, you predict that the coin will regress to tails, you'll be correct, and if you're wrong and you predict the next flip will be heads, you'll eventually be correct.<br /><br />Seattle's loss could just as well be explained by the very long distance they had to travel, having a larger road performance drop-off than most teams, Miami playing better than usual, and of course just plain luck.<br /><br />Obviously their defense let them down in the 4th quarter, but their offense played fine - especially their passing game with about 8.6 YPA. So was it just their defense that has been playing too well the last couple of games and had to regress (in the 4th Q)?Jasonnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-68187903696042945112012-11-26T18:41:05.339-05:002012-11-26T18:41:05.339-05:00The model may regress stats, not sure your point. ...The model may regress stats, not sure your point. Seattle was 61% to win and I told you before the game that was not accurate, and it wasn't. The model had no clue Seattle would play so far below their averages.<br /><br />JR --- Good point. Some of that 40% or whatever % it is that teams are lucky, isn't luck at all but lack of understanding using stats properly , which I pointed out before the Seattle game.<br /><br /><br /><br />Mike M.noreply@blogger.comtag:blogger.com,1999:blog-38600807.post-9937417747944097432012-11-26T16:12:56.466-05:002012-11-26T16:12:56.466-05:00Didn't you already prove that the NFL is indis...Didn't you already prove that the NFL is indistinguishable from a league where 40% of the games are decided by luck? What if Carolina just happens to have 5 losses on their schedule that all came up tails? That'd be a 1-in-32 occurrence, which might be observed in any season. If they won all five of those games, they'd be 9-2... or as good as the Ravens' record. <br /><br />And look at where the Ravens are. 9-2 with absolutely no reason to be there except guts and luck. J.R.http://www.blogger.com/profile/13913599852443572486noreply@blogger.comtag:blogger.com,1999:blog-38600807.post-1848563520404345442012-11-26T09:42:18.365-05:002012-11-26T09:42:18.365-05:00Mike, what about the fact that Brian's model D...Mike, what about the fact that Brian's model DOES regress team efficiency stats?Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-63391466037401393762012-11-25T21:04:14.310-05:002012-11-25T21:04:14.310-05:00Jon Jackson --- your right, my explanation is only...Jon Jackson --- your right, my explanation is only a patial reason why, not the only reason why Carolina is so highly ranked.<br /><br />Seattle had their regression to the mean just like I suggested they would and lost the game.<br /><br />Looking at Seattle's effeciency passing stats, they were out-played by Miami by 1.7 yards per pass att.<br /><br />That's a whopping 3 full yards below their average.<br /><br />The model using averages has no-clue Seattle was due a regression to the mean therefore favored Seattle by 61%.<br /><br />Non of the major web sites, CHFF & FO have figured this out................ yet.<br /><br />Now because Miami beat Seattle in passing effeciency by a fairly good amount the model will over-rate that performance, not knowing that performance was actually due to happen. It wasn't as much great play by Miami as it was a regression to the mean by Seattle. <br /><br />Next week we have more teams ready to have a regression to the mean, I'll post those in the team effeciency rankings for next week.Mike M.noreply@blogger.comtag:blogger.com,1999:blog-38600807.post-18125392239797476092012-11-24T13:31:46.409-05:002012-11-24T13:31:46.409-05:00@Jon Jackson, losing to lower ranked teams doesn&#...@Jon Jackson, losing to lower ranked teams doesn't work here because whether the team won or lost is irrelevant to this metric. What is relevant is that the metric is only based on the most repeatable or predictive stats.<br /><br />So when you see a team ranked much higher than their win loss record suggests, it must mean they are losing because of non-predictive stats which are not included in the metric.<br /><br />I think special teams is probably part of the explanation. Red zone performance, fumble recovery luck, 4th quarter defensive collapses, 3rd down conversions, general high leverage situation failures and on and on... there are many things that could be at play here.<br /><br />However, I think people are really overreacting here just because one team seems to be so off. It would make more sense to wait until the season is over and then examine the other statistics not measured by the model and see if including them adds to the model's predictive value.Jasonnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-39112308024976069412012-11-22T22:46:01.630-05:002012-11-22T22:46:01.630-05:00Mike M.,
Are you stating you have a different met...Mike M.,<br /><br />Are you stating you have a different metric than the one presented on this web site?(and by the way where are the spreadsheets for your game win probability predictions and the spreadsheets for team efficiency? They are probably in a easy to find place, but I can't find them. I'd really like to study them) Or do you have a different rating system? (Again, I would like to see that as well) Your logic above sounds good, And I fully accept that all teams never fully play exactly to their average. However, the goal (at least my goal) is to develop a system that minimizes team performance variance and maximizes team performance predictability.<br /><br /><br />I understand your concept of a "regression to the mean". However, for Carolina to have such an inflated team efficiency rating...practically all their opponents would have to be playing above their respective mean, in 6 of their 8 losses, for these lower ranking teams to beat them.<br /><br />TB at 16th rated(and falling) 2 losses<br />NYG at 8th rated a 29 pt blowout(the superbowl champs must of really been up to beat the 5th rated panthers by 29pts)<br />Atlanta 7th rated<br />Dallas 14th rated<br />Chicago 13th rated<br /><br />6 losses to teams lower than the panthers, Am I to believe that all 6 were playing above their mean? Occam's Razor is a principle stating that among competing hypotheses, the one that makes the fewest assumptions should be selected.<br /><br />So we either assume that 6 bad teams played really really well against a great (2-8) Carolina team, OR we assume that Carolina is just not very good. Which has the fewest assumptions? <br /><br />In chess, if you lose to a lower rated player, your US <br />Chess Federation ranking drops much more, than if you lose to a better ranked opponent.<br /><br />Why doesn't that work here?<br />Jon Jacksonnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-64470495160806165312012-11-22T21:32:17.456-05:002012-11-22T21:32:17.456-05:00"Brian, if you have any semblance of integrit..."Brian, if you have any semblance of integrity left you won't even think about an idiotic "coaching" metric."<br /><br />Umm...not sure how to interpret that from some random internet commenter. Pretty confident in my integrity, thanks.<br /><br />"As Chase pointed out, you seem to be alone in saying CAR has shown very good on-field production. But hey, you managed to misrepresent the works of Doug Drinen and Aaron Schatz in one fell swoop!"<br /><br />Misrepresentation is a strong charge, Mr. anonymous. If Doug or Mr. Shatz dispute that their models are not backward-looking, you should instantly ignore them. However, I doubt either would make that claim. But hey, keep trolling, troll.Brian Burkehttp://www.blogger.com/profile/12371470711365236987noreply@blogger.comtag:blogger.com,1999:blog-38600807.post-596675206816620122012-11-22T11:10:38.342-05:002012-11-22T11:10:38.342-05:00Mike M,
You just described one of the reasons why...Mike M,<br /><br />You just described one of the reasons why this model works so well. Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-71100061191131907192012-11-22T10:09:01.852-05:002012-11-22T10:09:01.852-05:00According to my meterics Carolina should of won th...According to my meterics Carolina should of won the game by about 7 pts based on the effeciency stats in the game. About 85% of the teams that are supposed to win do win in my meteric and most of the losses come from games that should be decided by 3 pts or less.<br /><br />Their loss is likely a combination of coaching and pure luck. <br /><br />With all that said, I think one of the reasons Carolina is so highly rated here is because of opponent adjustments.<br /><br />Let me explain, and by the way I've followed stuff like this for 30 years in the NFL. <br /><br />Teams don't play at their averages game after game, sometimes they play at extreme high levels and when this happens of coares that team builds-up huge effeciency stats in those games and makes the team look better than they are, because this is not maintanable to continue at this extreme high level of play "a regression to the mean" happens to the team.<br /><br />There are things you can look for that point to when "a regression to the mean" is coming, sometimes I can be off by 1 week, but rarely will I be off by more.<br /><br />Carolina has played a number of opponents this season that were ready for "a regression to the mean". In other words, a team that was coming off extreme levels of play and had built-up their effeciency stats to high levels so Carolina recieved alot of credit for opponent adjustments and Carolina played those teams well because those teams had "a regression to the mean" in the Carolina game. <br /><br />This happened in the Tampa game where Tamps was due for " a regression to the mean" and it did happen but Tampa was very forunate to pull that game out.<br /><br />Carolina also play Atlanta earlier in the year in a similar situation where they almost won against a team coming off a number of strong games.<br /><br />An example of this happening this weekend is Seattle VS Miami. Seattle comes in off an extreme level of play that is simply not maintainable and Miami is coming in off a extreme low level of play that is not likely to continue.<br /><br />"A regression to the mean" will likely happen and Miami would be the right play against the spread at +3.5 and will in all likely-hood win straight up and many will be sssooooo surprised by this. <br /><br />If you look at the probabilities, the model has Seattle at 61%, because Seattle is coming off extreme levels of play and has built-up their effeciency stats in the process, what the model does not know is that Seattles extreme level of play is not maintainable.<br /><br />Like I said, I could be off by 1 week, but probally not.<br /><br />When you add it all-up, TEAMS DO NOT PLAY AT THEIR AVERAGES EACH WEEK, sometimes they play well above and that almost certainly means they will play below at some point soon.<br /><br />And this is one reason why a model can not achieve a very high rate of succes.Mike M.noreply@blogger.comtag:blogger.com,1999:blog-38600807.post-32733236260265562752012-11-22T04:38:33.315-05:002012-11-22T04:38:33.315-05:00Did anyone actually see the TB-Carolina game sunda...Did anyone actually see the TB-Carolina game sunday? I just watched the game and all this BS talk of 4th down decisions is moot if the refs call the right call for the Martin touchdown with 10:53 remaining. a obvious miss call. <br /><br />But it didn't matter 'cause the panthers defense stinks.<br /><br />You guys spend so much energy on academic questions. the real question is who will win this week.<br /><br />If the metric system in place used here can't do any better than the vegas point spread, or the canned computer software..what is the point.<br /><br />Present your metric on a spreadsheet available to all to use, and analyze. I'll present mine and may the best metric win.Jon Jacksonnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-68859391364551739472012-11-21T20:53:00.082-05:002012-11-21T20:53:00.082-05:00I think Jeff has a really good beginning of a plan...I think Jeff has a really good beginning of a plan here. Anon, I ask you why you think we shouldn't rank coaches? Certainly a team that has an excellent AYPA but runs 75% of the time will not be accurately ranked by Brian's model, and that's a reflection on coaching outside of scheme. Even more so for an aggressive coach on 4th downs versus one that kicks all the time.Jameshttp://www.blogger.com/profile/01838293735141324662noreply@blogger.comtag:blogger.com,1999:blog-38600807.post-23443785658290516952012-11-21T19:37:37.638-05:002012-11-21T19:37:37.638-05:00Brian, if you have any semblance of integrity left...Brian, if you have any semblance of integrity left you won't even think about an idiotic "coaching" metric.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-26819631006554712592012-11-21T10:58:19.837-05:002012-11-21T10:58:19.837-05:00The "coaching" metric discussion comes u...The "coaching" metric discussion comes up frequently in the comments. And I tend to agree with the comment made by one user that the answer that it's "embedded in the metrics" is insufficient--though probably partially true. I wish I had both the time (and the skills) to try the test the following metric, but I'll offer it up and perhaps it will inspire some thought (and improvement on the base idea) on a way to include "coaching" in the model.<br /><br />My thought on a possible coaching metric would be looking at play by play data, and calculating some kind of score (using either WPA or EPA) based on the variation resulting from "optimal" play selection versus "actual" play selection. So for instance, it's been said that teams should pass more on first and second down, and run more on third down. So let me use real names to demonstrate. Let's say on 1st and 10 from the 20, midway through a close game in the third quarter, Mike Smith's Falcons throw the football. Presuming that a pass from 1st and 10 from the 20 in this situation is "more optimal" than a run from 1st and 10 from the 20 in this situation, Mike Smith receives a EPA and/or WPA score that is the variance between the EXPECTED outcomes of a pass versus a run. The ACTUAL outcome is irrelevant for Mike Smith's score. Now let's say that pass goes for 8 yards and they are facing 2nd and 2 from the 28. We do the same thing on the "optimal" play call for the next play. Let's say it "should" be a run (I have no idea--in fact, I imagine they should still pass--just using as an example). And let's say they pass and pick up 10 more yards. Well if the "optimal" play "should" have been a run, then the variance between the expected EP/WPA of run v. pass would be negative, and Smith would get a reduction in WPA/EP. Essentially, it's not too different from the 4th down "go for it" calculations that we see every week posted on this site (particularly when coaches fail to go for it when they "should"). We can calculate how much expected WPA or EPA is different between the "optimal" choice and the actual choice. The actual result is irrelevant.<br /><br />In as much that coaches tend to be non-optimal in the NFL (as evidenced by this site's analysis), I would expect most coaching EPAs and WPAs to be negative. But maybe "less negative" is better than "really negative". And maybe Ron Rivera (who's made some rather dubious 4th down decisions) would have one of the REALLY negative WPAs and EPAs.<br /><br />We could use league baselines or team baselines to determine "optimal" choice (though I'm guessing team baselines would have much more limited data and reduce any potential significance--but maybe not). Perhaps we limit it to "high leverage" situations only (end of half, end of game, OT), similar to how the model limits baseline calculations to "normal" situations. Limiting to high leverage situations probably is better given it's those situations where coaching decisions probably have the greatest impact.<br /><br />I'm aware there are plenty of deficiencies. The fact Peyton Manning pretty much calls the plays would make it seem unfair to punish/reward John Fox for play call decisions. But it may serve as a starting point at least. And if we limited measurement of the coaching metric to high leverage situations only, I would argue Fox has a larger role (though not too vociferously).<br /><br />Just an idea. I'm sure I've overlooked deficiencies that may be obvious to some that would invalidate this approach as being meaningful. But perhaps it will spur some thinking on it from people far brighter than I am.<br /><br />Jeffnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-27238876796220333562012-11-21T05:31:43.054-05:002012-11-21T05:31:43.054-05:00@Kulko EP data is here http://spreadsheets.google....@Kulko EP data is here http://spreadsheets.google.com/ccc?key=0AhEXxf9odCnMdHJJd3lkUDVsX25BbUdsY2FmOUM1T3c&hl=en<br /><br />Ian Simcoxhttp://www.blogger.com/profile/01518825067469269377noreply@blogger.comtag:blogger.com,1999:blog-38600807.post-79891574777186583802012-11-21T03:44:42.981-05:002012-11-21T03:44:42.981-05:00Another thing I iam wondering when looking in the ...Another thing I iam wondering when looking in the ranking is wheter AYPA is the best possible metric for the passing game. I think it undervalues the 10yd nature of the NFL rules to a certain extend and I wonder if Adjusted EPA/Attempt would do a better job here. (By Adjusted I mean considering sacks and cutting of Interceptions to a 10 yd return or similar). I ahve been trying to rebuild the model from 2011 data but I have realized that the function for EPA is not publically available.<br /> Kulkohttp://www.blogger.com/profile/17657346387956365135noreply@blogger.comtag:blogger.com,1999:blog-38600807.post-36902171721133919512012-11-21T03:40:23.236-05:002012-11-21T03:40:23.236-05:00Well so with different Luck they are an average te...Well so with different Luck they are an average team and Brian wouldnt be asking when his model had the panthers at 10-14. But at five you would expect a team whose expected record is more like 6-3,7-2 and thats quite far away from being 2-8. OTOH there are teams like this for every year and every system just because sometimes a team hits all their completiions/incompletions on third down and then the result are much better than the average play result. This things tend to go away oin the long run, but at least for one team the long run usually is only next year.Kulkohttp://www.blogger.com/profile/17657346387956365135noreply@blogger.comtag:blogger.com,1999:blog-38600807.post-25220439047827384372012-11-20T23:09:19.029-05:002012-11-20T23:09:19.029-05:00In an alternate universe with slightly different l...In an alternate universe with slightly different luck, Carolina is 5-3 and no one is saying anything. Ignore the trolls Brian. <br /><br />On a side note, I've noticed you're been a lot more apologetic about the model this year. I miss the old aggressive, almost militant, Brian.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-79953364615410687862012-11-20T22:19:14.689-05:002012-11-20T22:19:14.689-05:00As Chase pointed out, you seem to be alone in sayi...As Chase pointed out, you seem to be alone in saying CAR has shown very good on-field production.<br /><br />But hey, you managed to misrepresent the works of Doug Drinen and Aaron Schatz in one fell swoop!Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-31741052932418327682012-11-20T21:25:40.888-05:002012-11-20T21:25:40.888-05:00The ANS model is not worse at predicting game outc...The ANS model is not worse at predicting game outcomes than 'an average computer model.' That is false. Over a period of a few weeks here and there, all models will have good streaks and bad streaks. Go back several years and you'll find a much different result.<br /><br />The question is: why is CAR losing despite very good on-field production?Brian Burkehttp://www.blogger.com/profile/12371470711365236987noreply@blogger.comtag:blogger.com,1999:blog-38600807.post-59269350849739693682012-11-20T16:54:42.936-05:002012-11-20T16:54:42.936-05:00For those of us in office confidence pools who hav...For those of us in office confidence pools who have to turn in our picks by tomorrow night: is there a way for us to calculate any of the upcoming WPs on our own?Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-77168943223437463892012-11-20T16:33:53.711-05:002012-11-20T16:33:53.711-05:00Brian, you call other systems "backward looki...Brian, you call other systems "backward looking" but as someone posted last week, the ANS model is worse at predicting game outcomes than an average computer model. So what gives?Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-51020435852314021622012-11-20T16:27:05.312-05:002012-11-20T16:27:05.312-05:00I respect the forum you have developed here, the c...I respect the forum you have developed here, the conversation and analysis it generates. However,<br /><br />I'm confused, your explanation on why Carolina lost wasn't satisfactory. TB beat Carolina twice (that's a sweep of a two game series), TB wins and Carolina loses. Carolina stays at the 5th best team, TB drops 3 positions. To say TB is simply lucky, well lucky teams win games.<br /><br />Bill Parcells said, "You are what your record says you are."<br /><br />And 2-8 sucks.<br /><br /> Carolina is 2-8, blame the coach if you want...this team dissolved, the defense gave up 18 pts in the final 10 minutes of the game, and you have the defense rated 6th. Top 20% defenses probably shouldn't give up 18pts in the final 10 minutes and allow a team to score a TD on the first OT possession. This isn't the first time something like this happened(bears game).<br /><br />My system said TB would win by 3, TB won by a score in OT. I posted this in the comments on Week 11 team Efficiency Ratings. <br /><br />I like what you are doing here. But throwing good ratings after bad at this Carolina team is a mistake, and when a system blows a gasket like this, it may be time to fix the system.<br /><br />Jon Jacksonnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-90574018206930085832012-11-20T16:13:23.601-05:002012-11-20T16:13:23.601-05:008 games is a tiny sample size. Remember this is th...8 games is a tiny sample size. Remember this is the same Carolina that should have beaten the Falcons (who everyone agrees is a great team)Anonymousnoreply@blogger.com