Definitely English. There is no requirements about where your bank is located. You do not need to coordinate your bank location with any residence certification.
Just a wild guess but the name on your statement would be the same as your passport, English, and the numbers reflecting your balance are numbers not language. Just highlight those 2 items and pray.
Who knows, but on the face of it I can't see any issues. Make sure you provide adequate proof of his passport and DTV approval letter as well as marriage documents and your 500K funds