That is okay. Granite Armor is really the best defense and resistance providing toggle in the game, so there are penalties attached to it. Also keep in mind it was originally designed in Issue 1 during the legacy days of the game, before set bonuses, IOs, temporary powers, or Incarnates were around. Now the penalties can largely be offset while maintaining all of the benefits. That's why some of the changes were made to the set recently.