massOfai

Markov Chain

Math & Statistics

Sequence of events where next state depends only on current state

What is Markov Chain?

Used to model stochastic processes in time series, reinforcement learning, and probabilistic models.

Real-World Examples

  • PageRank
  • Hidden Markov Models