As a Guild master of a guild that had over 600 members, I had to do this lots of times. If you are unable to kick people when the time comes, then you may not be the right person to lead the clan/guild/team.
There was a time though I had to kick a member for things he would do, say, and...