You should check out Everbank at:
http://www.everbank.com
They are a web based US bank, however, they offer foreign currency banking products such checking accounts denominated in foreign and foreign currency CDs. Having your accounts denominated in foreign currency hedges your risk if the dollar collapses, however, since they are a US bank, you have no guarantees that the US government will not implement currency/banking controls should such a collapse occur.
One thing to keep in mind is that the dollar is trending up against foreign currencies due to the Fed’s raising of short-term interest rates. I’d stay out of foreign currencies until the Fed has appeared to stop their rate raises. I’m guessing this will happen within the first quarter of 2006. After that, I expect the dollar to drop against all other currencies.
As for foreign bank account, IRS law requires that you report all foreign accounts.
A gray area is an account with Goldmoney.com. Goldmoney allows you to purchase gold that is held in your name in a bank vault in the British Virgin Islands. They are not really a bank, by definition, they are a holding company for your personal gold. I have a Goldmoney account and during the registration process your not even required to provide a social security number. Also note that the British Virgin Islands are a UK territory, but have their own government separate from the UK and is a well known international tax haven.
It will be interesting when I go to do my 2005 federal taxes what my account says to do with my Goldmoney account.