Skip to content

Markov Chain

Statistical Glossary

Markov Chain:

A Markov chain is a series of random values x1, x2, … in which the probabilities associated with a particular value xi depend only on the prior value xi-1. For this reason, a Markov chain is a special case of “memoryless” random processes.

The index “i” usually corresponds to discrete values of time or another unidimensional argument. The values themselves can be of any nature and dimension. For example, the random value could be a behavior category (physical interaction, no physical interaction) and the sequence would be a set of simulated behaviors in which the probability of a given behavior depends on the prior behavior.

This property of “memorylessness” fostered the development of a rich probabilistic theory of Markov chains and related statistical methods as well. Thus, if a Markov chain is an adequate model for your data, you can use a wide variety of well-developed mathematical and statistical tools.

The concept of Markov process is the extension of the concept of Markov chain into the case of continuous argument (usually, time). Markov fields is the further extension of Markov processes into multidimensional space.

 

If the symbols do not display properly, try
the graphic version of this page

Browse Other Glossary Entries

Test Yourself

Planning on taking an introductory statistics course, but not sure if you need to start at the beginning? Review the course description for each of our introductory statistics courses and estimate which best matches your level, then take the self test for that course. If you get all or almost all the questions correct, move on and take the next test.

Data Analytics

Considering becoming adata scientist, customer analyst or our data science certificate program?

Analytics Quiz

Advanced Statistics Quiz

Statistics Quiz

Statistics

Looking at statistics for graduate programs or to enhance your foundational knowledge?

Statistics 1 Quiz

Regression Quiz

Regression Quiz

Biostatistics

Entering the biostatistics field? Test your skill here.

Biostatistics Quiz

Advanced Statistics Quiz

Statistics 2 Quiz

Stay Informed

Our Blog

Read up on our latest blogs

Certificates

Learn about our certificate programs

Courses

Find the right course for you

Contact Us

We'd love to answer your questions

Our mentors and academic advisors are standing by to help guide you towards the courses or program that makes the most sense for you and your goals.

300 W Main St STE 301, Charlottesville, VA 22903

(434) 973-7673

ourcourses@statistics.com

By submitting your information, you agree to receive email communications from Statistics.com. All information submitted is subject to our privacy policy. You may opt out of receiving communications at any time.