Is it a Hotmail account? If so try this solution that was posted by a Verizon employee:
Hi there! I'm sure this can get frustrating. What I recommend is logging into your Hotmail account from a computer and removing the emails from your inbox, then empty the trash to ensure they do not re-appear. The Hotmail server must be seeing these are new and pushing them back through each time.