I've seen it fail a few times cause teams where already balanced...
thing is its seems to look at the top ranked players (so if both teams have a player on 24) it will view the teams as balanced...
the farther down in rank you go the less it matters (this is also based on the fact that a level 5 player should have no problem taking down someone with a pistol).