As a long-term investment, gold has offered small overall returns with high volatility. But there is still an argument for keeping a sliver of it in a portfolio.