Questions tagged [markov-chains]

Markov chains are systems which transition from one state to another based only upon their current state. They are used widely in various statistical domains to generate sequences based upon probabilities.

Markov chains (named after their creator, Andrey Markov) are systems which transition from one state to another based only upon their current state. They are memoryless processes which are semi-random, i.e. where each state change having an associated probability.

Due to their statical nature, Markov chains are suitable for simulating complex real-life processes where probabilities are well known. They are used in a wide variety of fields, with uses too in-depth to list here; an exhaustive list can be found on the associated Wikipedia page.

In programming, they are especially popular for manipulating human languages - Markov text generators are especially popular applications of Markov chains.

577 questions
-3
votes
1 answer

R repeat function until result met and can obtain number of iterations it took to achieve result

MY following function denotes n as days and initial value x1. I'm trying to find the number of days it takes from any value or rmicro<30 to reach rmicro>=40.
-3
votes
2 answers

What is the probability that mouse with reach state A before state B

Maze I have a maze as shown above(use the link) and state 3 contains prize while state 7 contains shock. a mouse can be placed in any state from 1 to 9 randomly and it move through the maze uniformly at random Pi denote the probability that mouse…
-3
votes
4 answers

double brackets arrays into an array

I have a matrix of steady state distributions and this is how the results are coming out. [[ 0.43397114, 0.00939583, 0.55663303] [ 0.43397114, 0.00939583, 0.55663303] [ 0.43397114, 0.00939583, 0.55663303]] I want to select one of them as…
Eric Enkele
  • 183
  • 1
  • 7
  • 17
-3
votes
1 answer

this program throws infinity for values of m above 120 ?.. can it be solved?

for(int i=n+1;i<=m;i++){ double r = (lm/mu); // double res = (Math.pow(r, i))*(fact(m)/(fact(m-i)*fact(i)))*((Math.pow(n, n-i)*fact(i))/fact(n)) formulae BigDecimal lr= new BigDecimal(Math.pow(r, i)); …
shravan
  • 11
  • 4
-3
votes
1 answer

what is the condition under which the markov chain converge?

I'm programming some program which calculates the limit of markov chain. if the markov matrix diverges, I should transform it into the form dA + (1-d)E, where both A and E are n * n matrix, and all of the elements of E are 1/n. But if I apply…
glast
  • 383
  • 1
  • 4
  • 17
1 2 3
38
39