First they have to get their record back to .500.

All that stands between the high-powered Saints and that modest goal is a struggling Oakland Raiders team that has allowed 97 points the past two weeks and matched a franchise-worst for points allowed in last week’s 55-20 loss at Baltimore.

“Man, if Baltimore can put up 55, you don’t even want to see what New Orleans can do,” Raiders defensive tackle Tommy Kelly said.

The Saints (4-5) have done quite a bit since the 0-4 start under a cloud from the bounty allegations that led to a season-long suspension for coach Sean Payton and other punishments that have been a distraction all year. With four wins in the past five games, including a 31-27 victory last week over previously unbeaten Atlanta, New Orleans has worked its way back into contention.

But there is little margin for error. The schedule gets much tougher after Sunday’s game in Oakland (3-6) with the following three games against division leaders, meaning the Saints can ill-afford a slipup against the struggling Raiders.

“When you dig yourself a hole like we have, every game you play is going to be critical,” interim coach Joe Vitt said. “Anything other than our best effort and we’re going to have a long Sunday.”

The Saints have been close to their best in recent weeks. After uncharacteristically throwing five interceptions the first three games, Drew Brees has completed 71 percent of his passes the last two weeks with five TDs and only one interception. The running game, energized by Chris Ivory, has produced 288 yards on the ground the past two weeks.

And even the porous defense has stepped up of late, holding Philadelphia to 13 points two weeks ago and coming up with the late goal-line stand that sealed the win against the Falcons.

“They’re back in the groove,” Raiders cornerback Ron Bartell said. “They’re doing what they normally do. … He’s putting up huge numbers. They’re doing a better job of protecting him. He’s getting the ball out of his hands. His receivers are making plays. Basically the normal New Orleans Saints offense.”

Which is what’s so scary for the Raiders.

The Raiders have been up-and-down defensively this season, getting gashed on the ground early in the season by Miami and then getting overwhelmed by Peyton Manning and Denver before a bye week.

Oakland then put together a fairly strong three-week stretch, holding down Matt Ryan and the Falcons to one offensive touchdown and beating one-win Jacksonville and Kansas City in back-to-back weeks.

But the last two weeks have been as bad as it’s ever been defensively in Oakland. Tampa Bay rookie Doug Martin ran for 251 yards in a 42-32 win two weeks ago. That was followed by the drubbing in Baltimore when Joe Flacco picked the Raiders apart for 341 yards and three touchdowns as the Ravens matched the most points ever allowed by the Raiders.

“I know the team that we’re going to face is not the team that gave up 55 points last week or 42 points against Tampa,” Brees said.

“It’s a play here, it’s a play there, it’s a big play here, a big play there that can typically affect the outcome of a game. This defense has a lot of very talented players on it. They have played very, very well at times. I know that, for us, we’re going to have to play our best game and worry about our execution, and that’s what we’re focused on.”

That Oakland is struggling so much on defense comes as a bit of a surprise for the Saints, who know Oakland first-year coach Dennis Allen so well. Allen spent five years as a defensive assistant in New Orleans, helping the team win the Super Bowl following the 2009 season as defensive backs coach.

After spending one year as defensive coordinator in Denver the 40-year-old Allen got his first head coaching gig this year in Oakland.

“He deserves it, man,” Saints safety Roman Harper said. “He’s a great coach. He understands everything it takes to win and I know he’ll get those guys going. They’ve had some ups and downs but at the end of the day that’s going to happen, especially when you’re a new coach somewhere. He’s going to have them just fine though.”

Allen coached four years in Atlanta before joining Payton’s first staff on the Saints in 2006. He credited that experience with getting him to where he is now.

“I started coaching in the NFL in Atlanta, but I grew up in the NFL in New Orleans,” he said. “I got a lot of good memories there, and we were able to win a championship. So it was a big part of my development as a coach.”