Patriots are playing so much better than any other team in the league right now it isn't even close.
Does it get under anyone else's skin when national people state how bad the Pat's defense is calling one of the worst in the league because of yardage given up yet they will probably be a top 15 defense in points allowed per game?
Isn't it more important to not give up points that it is to give up yards?
Patriots were playing so much better than every other team in 2007, too. Nothing matters except the Super Bowl. In one game, any team can win.
To address your question, yes, it does kind of bother me when people say the Pats defense is so bad. They have a huge turnover advantage (I think it's +15 or +16 now), which suggests the offense takes care of the ball AND the defense is good at creating turnovers. They have won many games by large margins because they both score a lot of points AND prevent the other team from scoring when it matters.
The Pats defense is at least average, I think. In the last few weeks, it's been pretty incredible.