Most large services use a split wallet system where the money is divided into a small "hot" wallet which does day to day activity, and a "cold" wallet which stores the bulk of the money offline and behind physical security. A cold wallet can be both physically protected, and have divided spending responsibility between multiple parties to avoid internal theft. This has the advantage of minimizing losses if the hot wallet is compromised, but will delay extremely high amounts of rates of withdraws as there is a human element (possibly several) in the chain. There is a trade off with the amount of money you have in which side of the split, more in the hot wallet has a higher risk of internet directed thefts, but higher convenience.
Most companies don't disclose how they make their keys, but one can assume they are hardened BIP32 child keys, or individually produced Bitcoin addresses made on a dedicated system. Usually in this sort of setup everybody will use the standard RNG /dev/urandom which is a cryptographically secure random number generator designed explicitly for this task.
What do you mean by "JBOK key management"? specifically what does JBOK stand for? – Bilthon – 2015-10-06T21:45:09.787
Not a standard phrase, but they mean "just a bunch of keys", a non deterministic collection of individually generated random ECDSA private keys. – Anonymous – 2015-10-07T00:31:33.480