Can't you just type in /kick in chat and then select the player to kick?