A Markov chain is a mathematical model for a random process that has only short-term dependence on its history: if you know the current state of the system (or perhaps its recent history), any further historical information will not improve any predictions about its future.
This could be a useful model for analyzing a (flawed) lottery in which there is some dependence between today's number and tomorrow's; it could help you determine the nature of that dependence, and let you use today's number to make a prediction about tomorrow's number that would improve your chances of winning.
However, in a truly fair and random lottery, no such dependence should exist. Each number should be chosen in a manner that is not biased or affected in any way by past numbers. In such a case, a prediction based on a Markov chain would be no better than a random guess; and indeed, given enough data, Markov chain techniques would tend to confirm that there is no dependence. (In the short term, such techniques might appear to detect some dependence, but this would be erroneous.) So if the lottery is in fact fair, you can't improve your odds using a Markov chain analysis or any other method.
My understanding is that the cryptographic community believes, based on all current evidence, that the Bitcoin mining algorithm behaves like a fair lottery. Of course, the output of the SHA256 hash function does in fact depend on its input data, but it is believed that there is no computationally feasible way to describe or gain information about this dependence short of actually computing the function. If so, then SHA256 outputs are effectively independent of their inputs, and past history of Bitcoin hashing gives you no useful information about the future; it does not help you improve your odds compared to trying nonces in sequence or at random.
If you, or anyone else, is able to "improve Bitcoin mining" via Markov chain techniques, or any other method, it would mean that SHA256 is seriously flawed and should be abandoned. Fortunately, as far as I know, there is no evidence to suggest that this is the case.
1The probably distributions of hash algorithms are assumed to be completely uniform. I can't imagine how past information could in any way predict future outcomes. – Greg Hewgill – 2014-05-16T01:00:54.733