Right, but you'll still be spending most of your time summoning/buffing them, and pets can't meatshield you if they're dead. This feels like it'd be a very slow-paced and unfun AT to play unless the secondary MM sets are reworked into fire-and-forget recharge intensive pets ala VEATs. In which case, VEATs lose 50% of the reason that people play them (the other half being the crab backpack.)
This really is a lose-lose situation.
If you REALLY want to make a unique AT, I recommend reworking the pets into toggles. One is automatically summoned every X seconds, up to a cap of 3/2/1 per pet tier. This would save you the headache of having to constantly break your attack chain to re-summon and re-equip. Of course, they'll have to be adjusted to do less damage than Mastermind pets, so you can't just sit there AFK while your pets magically come back and clear a map.