Questions tagged [stochastic-process]

A stochastic process is a collection of related random variables, often used as a model for a quantity that varies over time or space with some degree of smoothness.

In probability theory, a stochastic process, or sometimes random process (widely used) is a collection of random variables; this is often used to represent the evolution of some random value, or system, over time. This is the probabilistic counterpart to a deterministic process (or deterministic system). Instead of describing a process which can only evolve in one way (as in the case, for example, of solutions of an ordinary differential equation), in a stochastic or random process there is some indeterminacy: even if the initial condition (or starting point) is known, there are several (often infinitely many) directions in which the process may evolve.

In the simple case of discrete time, a stochastic process amounts to a sequence of random variables known as a time series (for example, see Markov chain). Another basic type of a stochastic process is a random field, whose domain is a region of space, in other words, a random function whose arguments are drawn from a range of continuously changing values. One approach to stochastic processes treats them as functions of one or several deterministic arguments (inputs, in most cases regarded as time) whose values (outputs) are random variables: non-deterministic (single) quantities which have certain probability distributions. Random variables corresponding to various times (or points, in the case of random fields) may be completely different. The main requirement is that these different random quantities all have the same type. Type refers to the co-domain of the function. Although the random values of a stochastic process at different times may be independent random variables, in most commonly considered situations they exhibit complicated statistical correlations.

Familiar examples of processes modeled as stochastic time series include stock market and exchange rate fluctuations, signals such as speech, audio and video, medical data such as a patient's EKG, EEG, blood pressure or temperature, and random movement such as Brownian motion or random walks. Examples of random fields include static images, random terrain (landscapes), wind waves or composition variations of a heterogeneous material.

143 questions
2
votes
1 answer

How to calculate the balancing of a matrix in python?

I would like to perform a matrix balancing in python. I thought to use linalg.matrix_balance in order to make the input matrix a doubly stochastic matrix: from scipy import linalg import numpy as np x = np.array([[1,2,7], [9,1,1],…
0x90
  • 39,472
  • 36
  • 165
  • 245
2
votes
2 answers

Matlab simulation error

I am completely new to Matlab. I am trying to simulate a Wiener and Poisson combined process. Why do I get Subscripted assignment dimension mismatch? I am trying to simulate Z(t)=lambda*W^2(t)-N(t) Where W is a wiener process and N is a poisson…
syys
  • 63
  • 7
2
votes
1 answer

Pure birth process inference using JAGS

I am trying to use JAGS to infer the birth rate in a (Stochastic) pure birth process. In the language of chemistry, this model is equivalent to the reaction: X->2X with rate alpha*X (also can be seen as a model of a chain reaction) This is the R…
2
votes
1 answer

Understanding term deterministic and non random

I am confused about a situation which is presented on the following slide: Last sentences says that: It is important to note that deterministic does not mean that xt is non-random. What does this mean? If A and B are random variable, then x must…
user466534
2
votes
1 answer

Casino game with matrix different probabilities

This is my task: Peter goes to the Casino with 1 dollar. With the chance of p, Peter wins 1 dollar and the chance of (1-p) he looses 1 dollar. The process can be seen as a markov chain. If Peter reaches 0 dollars he goes home bankrupt, if he…
PeterNiklas
  • 75
  • 1
  • 9
2
votes
1 answer

How can I obtain stationary distribution of a Markov Chain given a transition probability matrix

I'm trying to write mpow(P, 18) in vector form & matrix form. Can anyone help me with that? Also, I'm trying to find the stationary distribution of each state. Pi_0 = ? Pi_1 = ? Pi_2 = ? ... Pi_5 = ? Here is the code I've written: P <- matrix(c(0,…
PeterNiklas
  • 75
  • 1
  • 9
2
votes
2 answers

How to choose one element based on its probability?

Let's say I have a vector containing N elements, each being its probability. For example, v = [0.01 0.01 0.09 0.82 0.07] So I want a function f(v) that returns 4 at 82% of the time, 3 at 9% of the time etc. The input vector v is always normalized so…
jeff
  • 13,055
  • 29
  • 78
  • 136
2
votes
2 answers

Ergodic Markov chain stationary distribution: solving eqns

I am trying to solve a set of equations to determine the stationary distribution of an ergodic Markov matrix. Namely, the matrix is P=[0 0 0 0.5 0 0.5; 0.1 0.1 0 0.4 0 0.4; 0 0.2 0.2 0.3 0 0.3; 0 0 0.3 0.5 0 0.2; 0…
Winston
  • 143
  • 1
  • 4
2
votes
2 answers

How to find a function that can approximate another blackbox function programmatically?

I have two functions m1 = f1(w, s) m2 = f2(w, s) f1() and f2() are all blackboxs. Given w and s, I can get m1 and m2. Now, I need to design or find a function g, such that m2' = g(m1) Also, the difference between m2 and m2' must be…
user2420472
  • 1,127
  • 1
  • 12
  • 20
2
votes
0 answers

Coding of Ito Stochastic Process

I am trying to implement a routine in mathematica/matlab for a stochastic process. Any code written here is for mathematica, but if someone can help me with encoding this in matlab (if they're more familiar with that) then that would be fine as…
1
vote
1 answer

Stochastic sample using randsample?

I'd like to make a stochastic step simulation for P and I with randsample like this simple one below. P=zeros(1,5); I=zeros(1,5) %easy way for i=1:5 X=rand; dt=0.01; a=randi(50,1); b=randi(50,1); c=randi(50,1); d=randi(50,1); if X<=a*dt, …
HCAI
  • 2,213
  • 8
  • 33
  • 65
1
vote
0 answers

Solve system of differential equations with time dependent variable in Python

I have following system of differential equations x'(t) = (10+σ(t))(y(t)-x(t)) y'(t) = ρx(t)-y(t)-x(t)z(t) z'(t) = x(t)y(t)-βz(t) where ρ and β are constants and σ is Ornstein-Uhlenbeck process. In fact, the system is Lorenz system embedded in…
1
vote
1 answer

How to solve Matrix Riccati ODE in python

I want to solve the following Matrix Riccati ODE. My Matrix Riccati ODE After searching on the Internet, I found that there is something called continuous-time algebraic Riccati equation (CARE)…
Kaitao Qiu
  • 11
  • 1
1
vote
1 answer

Average time in a restaurant in R

I am visiting a restaurant that has a menu with N dishes. Every time that I visit the restaurant I pick one dish at random. I am thinking, what is the average time until I taste all the N dishes in the restaurant? I think that the number of dishes…
Homer Jay Simpson
  • 1,043
  • 6
  • 19
1
vote
1 answer

Stochastic parameter estimation

I have made a pandemic stochastic simulator which takes probabilities of an infection, recovery or neither and uses a gillespie algorithm with vectors to determine the number of people in each category at each time. I want to carry out a simulation…
1 2
3
9 10