Extension of the Class of Markov Models