OWINGS MILLS, Md. - Baltimore Ravens coach John Harbaugh wondered aloud Monday whether New England Patriots star Tom Brady was treated differently by the officials than his quarterback.

The Ravens (3-1) twice were flagged for roughing the passer on Sunday, and each penalty set up a touchdown in New England's 27-21 victory. The first call was against Haloti Ngata; the second against Terrell Suggs.

Baltimore quarterback Joe Flacco was also harassed in the pocket, but the only time the Patriots received a penalty was when Mike Wright was called for a helmet-to-helmet blow.

"I know Joe got hit (six) different times hard, and there was one call," Harbaugh said. "There were five that weren't called, and the one that was called with the sixth. Tom didn't get hit five times. We want him to be hit more than he was hit, but when he did sort of get hit, it was called. That goes to the credibility of the whole thing."

Harbaugh said the Ravens intended to submit film of the questionable calls to the league.

Asked if the Baltimore defense might be scrutinized more than other teams because of its surly reputation, Harbaugh replied, "That's an interesting question. I sure hope not, because that goes back to the credibility of the league and the credibility of the game."

Harbaugh had the same opinion when asked if Brady is being protected by the officials because he's one of the league's marquee quarterbacks.

"I sure hope not," Harbaugh said. "I'd like to think it's not engrained in their subconscious in some way. If it is, I would like to think they're professional enough to not take it that way. That would be very important that it's not the case."

Harbaugh was flagged for unsportsmanlike conduct Sunday for complaining to the officials, and afterward the Baltimore defense was livid over the roughing the passer calls.

"It's embarrassing to the game," linebacker Ray Lewis said. "Did that win or lose the game? No, but it got them 14 points. ... A personal foul and he isn't even touched. He's a man. They can be hit, just like us. We stop them and then you look back and see a flag or a personal foul and Tom Brady is laughing. It wasn't no personal foul if he's still smiling."

Suggs said, "Maybe next year it'll be two-hand touch to get a sack."

Brady, however, said, "Are you kidding me? We're holding the ball, we're unprotected, just sitting there defenseless, so they've got to stay away from me. They deserve to get flagged."

Slideshow   The Week in Sports Pictures A kayaker flips out, a racehorse eyes the Triple Crown and more. more photos

The loss knocked the Ravens from the unbeaten ranks, but they can't lament the defeat because they host Cincinnati (3-1) on Sunday in a duel of AFC North leaders.

"You can't let the emotions linger," center Matt Birk said. "You can't afford to do anything else but move on and be in tune for the next one. Otherwise, it can snowball on you."

Also on NBCSports.com NHL: Devils outs Rangers, reach Stanley Cup finals  |  Highlights NBA: Why the Celtics will beat the 76ers in Game 7   PFT Live: Will Teblow push Sanchez, or take the QB's job?   French Open: Isner is the dark horse in Paris   Indy 500: Will Franchitti break tradition if he wins third title? Follow us on Twitter: @NBCSports  |  And Facebook