Fatigue became a factor in the second overtime, as the teams combined for 13 shots.
The Rangers had a chance to take the lead late in regulation when Mike Knuble was called for goaltender interference at 14:25 of the third period, even though he received a nudge from both Brian Boyle and McDonagh as he crashed into Lundqvist. New York failed to get off a shot, and with 13 seconds left on the man advantage, Richards was called for tripping.
Washington didn't get off a shot on its power play, either.
The Capitals outshot New York 13-10 during a scoreless first period in which Washington had the lone power play. Lundqvist denied Marcus Johansson on a shot from the low end of the right circle with just over 13 minutes elapsed, and seconds later Ovechkin was leveled by Staal after unleashing a wrist shot from the left circle.
New York's first power play provided the game's initial goal. With Brooks Laich off for hooking, Rangers defenseman Michael Del Zotto took a shot from the left circle that hit Carlson and Washington's Matt Hendricks. Callahan was in position to sweep the bouncing puck into the right side of the net.
Washington killed 27 of 30 penalties in the postseason before Callahan's goal. It was bad omen for the Capitals, who were 5-1 in the playoffs when scoring first and 0-3 when falling behind 1-0.
Carlson tied it at 11:10, deftly skating from left to right around three Rangers in the New York zone before launching a wrist shot that whizzed past Lundqvist's right shoulder into the top of the net. Stralman got caught up ice, and Carlson skated around Gaborik to get free.
NOTES: Visiting teams are 13-6 in overtime this postseason. ... Rangers C Brandon Dubinsky was scratched for a third straight game with an unspecified injury. ... Washington had won five straight home playoff games against the Rangers, dating to 2009 and including last season. ... It was the third-longest game in Capitals history and the fifth-longest for the Rangers.
Watch Live: Boston looks to finish the job and eliminate New York with a win in Game 5. Can the Rangers hold off the Bruins once again?
Video: NHL from NBC Sports
Highlights: Penguins crush Senators to move on
The Pittsburgh Penguins squashed any concept of an upset by a massive underdog in the Ottawa Senators. James Neal led the way for the Pens with a hat trick as Pittsburgh now moves on to the Eastern Conference finals after a 6-2 victory in Game 5.
Check out photos from the Kings' Stanley Cup victory parade in LA.
Stanley Cup playoffs
Check out photos from the NHL postseason action.
Stanley Cup winners
A look at the teams that have earned the right to hoist Lord Stanley's prize since 1965.
Some of Hollywood's hottest celebrities take in NHL games.
Check out the ice girls from around the National Hockey League.