While correct in principle, consider that mining difficulty has a pretty strong upward trend. This indicates that your relative hashing power (you compared to the difficulty/whole network) is greatest when you first start mining and it decreases over time. With some very rough estimates at the present difficulty of 10 million, 1 gigahash of computing should average one block solution every 16 months or so. But that's if the difficulty doesn't increase, which it will. As the difficulty increases, that extends the number of days it will take, on average, to solve a block.
It is certainly possible that you will solve the first block you attempt. But you also may not solve a block for a year or more. If you're on the unlucky side, you will have nothing to show for the duration of time when your relative hashing power was greatest. Consider somebody who engaged in CPU mining back near the beginning. Once the GPUs came on board, his chance of solving a block became miniscule. With ASICs joining the fray, the CPU miner has a completely unprofitable situation. If he was solo mining and didn't get lucky early on, at this point, he's probably never going to pay for his mining investment.
Bottom line: pool mining is a way to nearly guarantee that you will profit from your mining equipment's most profitable days. If your solo mining setup is such that your average block solution can be measured in days rather than months, you may come out ahead by solo mining.
Another consideration: solo mining involves running a node, which is good for the network. It is also good for the network to have hashing power spread out among many pools, and solo mining is a pool of 1.
1"The more mining hashpower you have, the more bandwidth pool mining will use" - that's no longer true with variable difficulty mining and template-based mining (GBT and Stratum) which pools have implemented to prevent them from being overwhelmed by the new ASIC hardware. – Dr.Haribo – 2013-05-10T15:15:03.227
@Dr.Haribo, thanks, I've updated my answer. – Highly Irregular – 2013-05-13T09:14:13.273