I usually only click someone on ignore if they're spamming BS over and over.
I put a dude on ignore on a mothership raid once because he kept spamming his RP shtick over and over. It was probably his F10 battle cry. After the raid, I unignored him. A day or two ago (all days run together now) he joined a team i was on. He threw out his shtick when he joined the team and then again when he had to leave.
Notes and stars, on the other hand, I'll use a bit. PvP a-holes (not PvPers in general, just the real a-holes) get one star. Jackasses get two stars. People who want to run off solo while on teams get three stars. Eda gets five stars - so I can spot her more easily at MSRs, and because she's a real trooper to run that twice nightly. (Thanks, Eda!)