Why Markov Processes Do Not Need To Have Hidden States

It has been suggested that it is necessary for Markov processes to have hidden states when transitioning from one state to another. The argument used is that in order to “flip” a bit, in a computer memory circuit for example, an intermediary state must exist to retain the data while the bit is being re-written. However, this is not the case.

The diagram shown above illustrates a simple two state Markov process.

Consider PUMP A being able to pump fluids twice as fast as PUMP B. If PUMP A and PUMP B pump fluids in opposite directions to one another, too, and are also driven by the same electric motor, then reversing the electric motor will cause the left hand reservoir to become the right hand reservoir, and vice versa. In other words, a “bit flip” will have occurred without hidden states.