Early in the second quarter of the Los Angeles Rams’ wild-card playoff game against the Arizona Cardinals, Rams head coach Sean McVay faced a third-and-2 at the Arizona 33-yard line with a 7-0 lead. Running back Cam Akers had just gained 3 yards rushing up the middle on the previous play, and he substituted out of the game as time ticked off the play clock. With 16 seconds left, quarterback Matthew Stafford took a step toward the huddle but abruptly stopped, throwing his arms up slightly in exasperation. A close-up shot of McVay reading from his play sheet revealed the reason why: Stafford still hadn’t gotten the play call from his coach.
The Rams finally broke the huddle with eight seconds on the play clock. Stafford walked to the line, quickly looked over the defense, glanced up at the clock and shook his head, seemingly realizing he didn’t have time to execute the pre-snap motion the play called for. He called time and stalked to the sideline, leaving the Rams with just one timeout left in the half.
As it turns out, burning through timeouts unnecessarily is something of a McVay calling card. According to the NFL’s Michael Lopez, no coach wasted more timeouts on a per-game basis from 2018 through Week 9 of 2021. Those “operational” timeouts — timeouts due to play clock mismanagement, the wrong personnel on the field, failed challenges, or simply the look the defense is giving the offense — are largely avoidable and can be quite costly. After all, timeouts come in handy at the end of each half and help a team keep drives alive late in the game.
This led us to wonder: Is McVay’s play-calling good enough to overcome the lost value of “wasted” timeouts? And not just McVay — is any NFL coach good enough to spend timeouts frivolously and still come out ahead?
To find out, we used the nflfastR package and looked at every play teams ran during the 2021 season (including the wild-card round) on offense after calling an operational timeout. For this analysis, we defined operational timeouts as low-leverage timeouts taken with four or more minutes left in the half — in other words, timeouts taken when the game probably isn’t on the line. After identifying those plays, we summed them up by team and calculated the expected points added (EPA) per play and the win probability added (WPA) per play. Finally, we calculated the total points added for each metric as well.
AFC North rivals Baltimore and Cleveland battled for the fewest operational timeouts in the NFL this season with just three for Baltimore and four for Cleveland. Even better, the Ravens and the Browns came in second and third in win probability added per play on the plays they called after those timeouts, indicating that perhaps they weren’t wasted after all — they actually helped set the team up for success.
Another AFC North team, the division champion Cincinnati Bengals, also makes an appearance, ranking fifth in WPA per play on a surprisingly high 20 plays after operational timeouts. But no team in the league benefited more from pausing the action midgame than the Miami Dolphins.
Which teams got the most out of ‘wasted’ timeouts?
NFL teams in the 2021 season by total expected points added and win probability added after “operational” timeouts, and EPA and WPA per play after those timeouts
Total
Per play
Team▲▼
Timeouts▲▼
epa▲▼
wpa▲▼
epa▲▼
wpa▲▼
Miami Dolphins
8
+9.04
+51.12
+1.13
+6.39
Baltimore Ravens
3
+2.23
+13.62
+0.74
+4.54
Cleveland Browns
4
+7.45
+9.86
+1.86
+2.47
Philadelphia Eagles
16
+12.31
+25.43
+0.77
+1.59
Cincinnati Bengals
22
+8.71
+34.58
+0.40
+1.57
Los Angeles Rams
13
+8.79
+19.55
+0.68
+1.50
Indianapolis Colts
8
+2.86
+11.17
+0.36
+1.40
Washington Football Team
6
+2.45
+7.07
+0.41
+1.18
Green Bay Packers
31
+14.68
+32.41
+0.47
+1.05
Kansas City Chiefs
4
-0.31
+4.15
-0.08
+1.04
Houston Texans
17
+9.35
+14.10
+0.55
+0.83
Pittsburgh Steelers
12
+5.29
+9.28
+0.44
+0.77
Denver Broncos
7
+1.48
+5.18
+0.21
+0.74
Los Angeles Chargers
6
+3.59
+4.30
+0.60
+0.72
New York Jets
17
+4.15
+11.89
+0.24
+0.70
Tampa Bay Buccaneers
18
+0.68
+7.58
+0.04
+0.42
Minnesota Vikings
12
+0.79
+3.18
+0.07
+0.27
Jacksonville Jaguars
14
-1.17
+3.35
-0.08
+0.24
New York Giants
9
-1.48
+2.00
-0.16
+0.22
San Francisco 49ers
16
+8.80
-2.50
+0.55
-0.16
Arizona Cardinals
20
+7.87
-3.97
+0.39
-0.20
Dallas Cowboys
8
-5.77
-3.25
-0.72
-0.41
Seattle Seahawks
12
-5.61
-5.83
-0.47
-0.49
New England Patriots
9
+2.03
-5.17
+0.23
-0.57
Atlanta Falcons
9
-1.68
-5.51
-0.19
-0.61
New Orleans Saints
21
-10.49
-16.42
-0.50
-0.78
Tennessee Titans
8
-4.28
-6.77
-0.53
-0.85
Buffalo Bills
14
+2.80
-13.65
+0.20
-0.98
Carolina Panthers
23
-16.10
-24.63
-0.70
-1.07
Las Vegas Raiders
16
-3.12
-18.11
-0.20
-1.13
Detroit Lions
9
-0.24
-29.77
-0.03
-3.31
Chicago Bears
10
-13.61
-41.61
-1.36
-4.16
Operational timeouts are defined as low-leverage timeouts taken with four minutes or more remaining in the first or second half of a game. Timeouts forfeited as a result of a lost challenge are included. The 2021 season includes all 18 regular-season games plus wild-card games.
Source: nflfastr
Not only did the Fins lead the league in WPA on plays after operational timeouts, they called eight of them over the course of the regular season, accumulating 51.1 percentage points of total win probability added. Brian Flores truly did nothing wrong.
At sixth, we find McVay’s Rams firmly in the black, averaging a point and a half of WPA on offense after “wasting” a timeout. Not too shabby! So does this mean that McVay has silenced the critics, and the nattering nabobs of negativism have been hoisted by their own petard?
Well, maybe not. We still need to account for the value of those timeouts. Back in 2014, Brian Burke, now at ESPN, conducted an analysis that estimated the value of a timeout as being worth 3.1 points of win probability. If we use his finding and subtract it from the WPA per play in the chart above for each team, we can calculate a new metric that will tell us if the timeouts were worth the cost. We call the new metric Timeout Win Probability Over Expected, or TOWPOE, and it paints a pretty bleak picture.
Only Miami and Baltimore profited from timeouts
NFL teams in the 2021 season by operational timeouts, win probability added per timeout taken and Timeout Win Probability Over Expected (TOWPOE)
team▲▼
timeouts▲▼
WPA per play▲▼
TOWPOE▲▼
Miami Dolphins
8
+6.39
+3.29
Baltimore Ravens
3
+4.54
+1.44
Cleveland Browns
4
+2.47
-0.63
Philadelphia Eagles
16
+1.59
-1.51
Cincinnati Bengals
22
+1.57
-1.53
Los Angeles Rams
13
+1.50
-1.60
Indianapolis Colts
8
+1.40
-1.70
Washington Football Team
6
+1.18
-1.92
Green Bay Packers
31
+1.05
-2.05
Kansas City Chiefs
4
+1.04
-2.06
Houston Texans
17
+0.83
-2.27
Pittsburgh Steelers
12
+0.77
-2.33
Denver Broncos
7
+0.74
-2.36
Los Angeles Chargers
6
+0.72
-2.38
New York Jets
17
+0.70
-2.40
Tampa Bay Buccaneers
18
+0.42
-2.68
Minnesota Vikings
12
+0.27
-2.83
Jacksonville Jaguars
14
+0.24
-2.86
New York Giants
9
+0.22
-2.88
San Francisco 49ers
16
-0.16
-3.26
Arizona Cardinals
20
-0.20
-3.30
Dallas Cowboys
8
-0.41
-3.51
Seattle Seahawks
12
-0.49
-3.59
New England Patriots
9
-0.57
-3.67
Atlanta Falcons
9
-0.61
-3.71
New Orleans Saints
21
-0.78
-3.88
Tennessee Titans
8
-0.85
-3.95
Buffalo Bills
14
-0.98
-4.08
Carolina Panthers
23
-1.07
-4.17
Las Vegas Raiders
16
-1.13
-4.23
Detroit Lions
9
-3.31
-6.41
Chicago Bears
10
-4.16
-7.26
Operational timeouts are defined as low-leverage timeouts taken with four minutes or more remaining in the first or second half of a game. Timeouts forfeited as a result of a lost challenge are included. The 2021 season includes all 18 regular-season games plus wild-card games.
Source: nflfastr
Only two teams — the Dolphins and the Ravens — managed to extract surplus value from their operational timeouts. Whatever benefit the other 30 teams received from stopping the clock and regrouping before the end of the half (or game) didn’t come close to covering the costs of the timeouts they spent to purchase those precious extra seconds.
Just look at the Chicago Bears. Matt Nagy hemorrhaged an average of 7.3 percentage points of win probability each time he called an operational timeout this year, according to TOWPOE. Not to be outdone, Matt Rhule and the Carolina Panthers called 23 probably terrible timeouts. Rhule accrued an astonishing total win probability debt of 96 percentage points, most in the league.
Even if Burke’s estimate of the value of a timeout is a little too high, Miami, Baltimore and Cleveland still were the only teams to bank more than 2 points of WPA per play after an operational timeout. Unless you believe timeouts are worth less than 2 points of win probability, which seems dubious, the conclusions really don’t change.
For McVay and the Rams in the wild-card round, everything worked out in the end. On the play immediately following the Rams’ timeout, wide receiver Odell Beckham Jr. lined up in the slot in a trips-bunch formation, something Arizona was apparently unprepared for. The Cardinals secondary blew the coverage, and Beckham ended up wide open outside the numbers on the left side of the field. Odell caught a 15-yard pass from Stafford and rumbled another 16 yards before being pushed out at the 2. The Rams would go on to score a touchdown and beat the Cardinals handily, 34-11.
McVay wasted a timeout, and it didn’t seem to matter. But he shouldn’t count on that if he wants his team to get back to the Super Bowl. The takeaway for teams this year is clear: Calling a play — any play — is likely better than wasting a timeout in search of the perfect call.
Check out our latest NFL predictions.
