I don't know if I'd put a majority of the blame on Peyton. The Colts made the playoffs 10 straight years due to the strength of the offense. The defense was always the weak point of the team. Even worse, the Colts kept drafting skill position players and ignored areas of need including offensive line.
Similar to the Colts, I don't want the Packers to have to score on every possession to make up for the lack of defense. The Packers should/could make the playoffs every year until Aaron Rodgers retires. Give him a defense and he'll win you Super Bowls.
http://www.pro-football-reference.com/players/M/MannPe00/gamelog/post/
Take a look. Every playoff loss they have minus one the offense has failed to score more than 18 points.