Be sure to actually close the accounts by contacting the bank. (fidelity.com)
To help your case, you should have contacted your bank for help when you had the difficulties. (moneysavingexpert.com)
It's a hassle because you have to keep contacting the bank about the bad charges, but it won't cost you more than time and a phone call or letter. (money.stackexchange.com)