Change banks if it'll make you feel more secure but don't put your money under your mattress where it could be stolen, destroyed, etc., as such monies aren't going to be covered under your homeowner's policy.
All you're doing is contributing to the panic.