You can always ask them to stop. Also, you can put up a vote and see if any other players agree with you.