You may take on one-time account setup fees, annual management fees and even separate storage fees for the custodian that keeps your gold bullion. However, fees for gold IRAs and silver IRAs can ...