The problems you have described would be very irritating. It would be my pleasure to work with you on this! Which email accounts are you experiencing this issue with? Are these emails set up thru the mail application or a downloaded application?
Please try deleting any non gmail account then readd the account and turn off the notification and retest.
Please let me know if the issue continues, I will troubleshoot further with you.
Please follow us on twitter @vzwsupport