Bitcoin, once the unruly child of finance, is showing signs of maturity as its wild swings fade, forcing speculative traders to hunt for a new playground.