Questions tagged [stochastic-process]

A stochastic process is a collection of related random variables, often used as a model for a quantity that varies over time or space with some degree of smoothness.

In probability theory, a stochastic process, or sometimes random process (widely used) is a collection of random variables; this is often used to represent the evolution of some random value, or system, over time. This is the probabilistic counterpart to a deterministic process (or deterministic system). Instead of describing a process which can only evolve in one way (as in the case, for example, of solutions of an ordinary differential equation), in a stochastic or random process there is some indeterminacy: even if the initial condition (or starting point) is known, there are several (often infinitely many) directions in which the process may evolve.

In the simple case of discrete time, a stochastic process amounts to a sequence of random variables known as a time series (for example, see Markov chain). Another basic type of a stochastic process is a random field, whose domain is a region of space, in other words, a random function whose arguments are drawn from a range of continuously changing values. One approach to stochastic processes treats them as functions of one or several deterministic arguments (inputs, in most cases regarded as time) whose values (outputs) are random variables: non-deterministic (single) quantities which have certain probability distributions. Random variables corresponding to various times (or points, in the case of random fields) may be completely different. The main requirement is that these different random quantities all have the same type. Type refers to the co-domain of the function. Although the random values of a stochastic process at different times may be independent random variables, in most commonly considered situations they exhibit complicated statistical correlations.

Familiar examples of processes modeled as stochastic time series include stock market and exchange rate fluctuations, signals such as speech, audio and video, medical data such as a patient's EKG, EEG, blood pressure or temperature, and random movement such as Brownian motion or random walks. Examples of random fields include static images, random terrain (landscapes), wind waves or composition variations of a heterogeneous material.

143 questions
0
votes
0 answers

Markov Process (Using R programming)

Consider Markov Process Xt on 5 states{1,2,3,4,5} with associated rate matrix Q <- matrix( c(-3,3,0,0,0,0,-2,2,0,0,0,1,-1,0,0,0,0,0,-3,3,1,0,2,0,-3), nrow=5, ncol=5, byrow = TRUE) How to produce R code to estimate the probability that this process…
John Tan
  • 1
  • 1
0
votes
1 answer

What are the possible reasons if Kalman filter can not calculate a stabilizing Kalman gain?

I have a question about Kalman filter. I am using Kalman filter for a state space model as following: X(k+1) = A(k)x(k)+B(k)u(k)+w(k), w(k) ∼ N(0,Q) Y(k) = C(K)x(k)+D(k)u(k)+v(k), v(k) ∼ N(0,R) Which the state space matrixes (A(k),B(k),C(k),D(k))…
0
votes
1 answer

Variance of Brownian motion increments in MATLAB

I'm simulating a Brownian motion in MATLAB, however I'm getting a strange outcome where the variance of the increments of the Brownian motion grow over time when it should stay constant. For example I construct a Brownian motion system, brown_drift…
0
votes
1 answer

Extract the values for some parameters from stochastic differential equation solution

I am solving stochastic differential equation in matlab. For example: consider the stochastic differential equation dx=k A(x,t)dt+ B(x,t)dW(t) where k is constants, A and B are functions, and dW(t) is Wiener process. I plot the solution for all t…
David
  • 77
  • 8
0
votes
1 answer

Plotting realizations of a stochastic process in the same plot

I want to plot multiple realizations of a stochastic process in matlab. For a single realization I have the following code: N = 80; T = dt*N; dWt = zeros(1,N); S= repmat(S0,1,N); S(1) = S0; dWt = sqrt(dt) * randn; for t=2:N dWt(t)…
user137425
  • 429
  • 6
  • 17
0
votes
0 answers

How to implement a function of time in an equation with R

I have a function that I need to draw with R using a daily step of 1 for 3 years. S(t)= S(0)exp(0.06t+0.20w(t)) #(1) with S(0) =20 w(t) = standard Brownian movement I am kinda blocked. I know this code should work but I don't know how to have the…
alison monroe
  • 21
  • 1
  • 1
  • 7
0
votes
1 answer

Comparing estimates of Ripley's K function using Matlab and R

I am using the following Matlab code to estimate Ripley's K function. a = 0; b = 50; C_x = a + (b-a).*rand(100,1); C_y = a + (b-a).*rand(100,1); locs = zeros(length(C_x),2); locs(:,1) = C_x; locs(:,2) = C_y; dist = a:1:b; K_t = RipleysK(locs,…
0
votes
1 answer

How to debug parallelized stochastic software?

I am looking for concrete advice for dealing with a rather high-level problem: how to debug software (a Genetic Algorithm in case you are interested) that: Runs tasks across multiple threads (I don't control which thread runs which task) Each…
Gili
  • 86,244
  • 97
  • 390
  • 689
0
votes
1 answer

Local volatility model Matlab

I am trying to do a Monte Carlo simulation of a local volatility model, i.e. dSt = sigma(St,t) * St dWt . Unfortunately the Matlab package class sde can not be applied, as the function is rather complex. For this reason I am simulating this SDE…
Mathin
  • 1
  • 1
0
votes
1 answer

What is the state space of this markov chain?

Consider a system where two persons sit at a table and share three books. At any point in time both are reading a book, and one book is left on the table. When a person finishes reading his/her current book, he/she swaps it with the book on the…
Undisputed007
  • 639
  • 1
  • 10
  • 31
0
votes
0 answers

For loop issues for a Markov chain Monte Carlo

So here is my next problem. I am trying to to loop through and find out how many of the entries in State_Space have a 1 as their 25th entry yet it keeps telling me that the answer is 0. Here is the code. import random import…
0
votes
1 answer

Simulating stochastic integrals

I'm using the Sim.DiffProc package in R to simulate a Stratonovich stochastic integral. Using the following code I can simulate 5 paths of the stochastic integral from t=0 to t=5: fun=expression(w) strat=st.int(fun, type="str", M=5, lower=0,…
Egodym
  • 453
  • 1
  • 8
  • 23
0
votes
1 answer

Simulating a stochastic marble in a bathtub. e

I am a biology graduate student, and trying to code a certain behavior into a model in R, and having some "lost in translation" issues. The code I have follows the post. I am trying to model this system: Imagine a bathtub with a vibrating marble.…
0
votes
2 answers

How do I sum intervals in a deterministic Poisson Process?

I'm making an app that needs to generate deterministic random events. They need to be deterministic so I can compute which events happened when the app was closed. I would like to find a function f(time1, time2) that tells me how many events…
Nathan Breit
  • 1,661
  • 13
  • 33
0
votes
1 answer

From ODE Hill kinetics to stochastic mass action

I am facing a problem translating a model with ODE to a stochastic model. The original model contains two expressions: 1) k6f2*PKB_S473P^n6/(km6^n6+PKB_S473P^n6))*AS160 2) k9f1*S6K*mTORC1a^n9/(km9^n9+mTORC1a^n9) that are described with Hill…
1 2 3
9
10