I voted for "yes". Let me explain why.
The group colors pretty much correlate with the group's userbar in most cases. For example, the background color of the "Kings" userbar is purple, so is the username. The diamond in the userbar for "Onyx" is gray, so is the username. The shield in the userbar for the group "Superior" is blue, so is the username. You shouldn't take away something that isn't harming anybody. Unless it made the site lag, caused downtime, or fucked up the database, I would say keep it. Besides, the group owners payed $75 dollars for this. It wouldn't be fair to them to take it away. I don't think it makes FK look bad at all, I think it makes FK look like a more diverse, and optional community.
Just my opinion.