Just click the "reply to thread" button and click the "manage attachments" button below the text box. You can delete them from there.

Doing from settings page may only result in one check box.