Questions tagged [stochastic-process]

A stochastic process is a collection of related random variables, often used as a model for a quantity that varies over time or space with some degree of smoothness.

In probability theory, a stochastic process, or sometimes random process (widely used) is a collection of random variables; this is often used to represent the evolution of some random value, or system, over time. This is the probabilistic counterpart to a deterministic process (or deterministic system). Instead of describing a process which can only evolve in one way (as in the case, for example, of solutions of an ordinary differential equation), in a stochastic or random process there is some indeterminacy: even if the initial condition (or starting point) is known, there are several (often infinitely many) directions in which the process may evolve.

In the simple case of discrete time, a stochastic process amounts to a sequence of random variables known as a time series (for example, see Markov chain). Another basic type of a stochastic process is a random field, whose domain is a region of space, in other words, a random function whose arguments are drawn from a range of continuously changing values. One approach to stochastic processes treats them as functions of one or several deterministic arguments (inputs, in most cases regarded as time) whose values (outputs) are random variables: non-deterministic (single) quantities which have certain probability distributions. Random variables corresponding to various times (or points, in the case of random fields) may be completely different. The main requirement is that these different random quantities all have the same type. Type refers to the co-domain of the function. Although the random values of a stochastic process at different times may be independent random variables, in most commonly considered situations they exhibit complicated statistical correlations.

Familiar examples of processes modeled as stochastic time series include stock market and exchange rate fluctuations, signals such as speech, audio and video, medical data such as a patient's EKG, EEG, blood pressure or temperature, and random movement such as Brownian motion or random walks. Examples of random fields include static images, random terrain (landscapes), wind waves or composition variations of a heterogeneous material.

143 questions
0
votes
1 answer

How to implement a Markov Chain in python for a squared spatial grid?

I'd like to understand how to implement in python a Markov Chain on a 2D grid (a 2D numpy array) given the values for all the states (positions) of the grid and also the transition matrix between all states. Here I will use some figures to better…
Mirko
  • 115
  • 1
  • 9
0
votes
0 answers

Stochastic Integration with Python (Numerical Methods)

I wonder if there are some numerical methods besides methods similar to Monte Carlo simulation to solve the below integral with Python. \int_a^b f(x_t,t)dx_t where dx_t=c(x_t,t)dt+d(x_t,t)dw_t where dw_t is the Wiener dynamics. Thank you :) P.S.: Is…
0
votes
0 answers

Stochastic modelling for rickshaw rides

How can I solve this problem? i want my code not error and please provide easy to understand explanations. this is about stochastic models rickshaw rides. from scipy.stats import poisson #Parameter lamda = 2 #rata-rata turis yang datang per 2…
0
votes
0 answers

Exponential moments of the linear SDE with bounded coefficients

How to estimate the exponential moments of linear SDE with bounded coefficients? I try to prove that the p-th moments of the linear process is bounded by the p-th power of a constant, but it seem to be impossible.
Wei Yan
  • 1
  • 1
0
votes
1 answer

Is hitting time of Brownian motion independent

Suppose that $B_t$ is a standard Brownian Motion. And $T_a$ $T_b$ are the hitting time whereas $a<0$, $b>0$. Then are these two random variables independent?
Julie
  • 101
  • 1
0
votes
1 answer

Stochastic cake eating problem with Matlab

I'm trying to work on a dynamic cake-eating problem with MATLAB. I am trying to compute a value function and policy funtion graph. The code has no errors, but when I try to plot the graphs, they have constant values and appear as a flat line instead…
0
votes
1 answer

Limit the appear of the draw using code logic

The ideals are: Draw red area on the screen when K is over 80 - no new red area will be drawing until K is reached under 20 before that Draw green area on the screen when K is under 20 - no new green area will be drawing until K is reached under 80…
0
votes
0 answers

Python (S)ARIMA models completely wrong

I have some time series, like this one: I want to predict future values, so I splitted in train/test (70/30) and I created several ARIMA models, however they are all completely wrong (or maybe I am wrong). First of all, considering differentiation,…
CasellaJr
  • 378
  • 2
  • 11
  • 26
0
votes
0 answers

Simulate an Integral of a Brownian Bridge Process

Alright, so I am trying to simulate a value and its not working out the way I expect. I think I narrowed down my an issue to me simulating the integral of brownian bridge process. I know that 1000 iid random variables were used to approximate the…
kpr62
  • 522
  • 1
  • 4
  • 11
0
votes
1 answer

Octave out of bound error while trying to calculate mean value of a vector

I generated random values using following function : P = floor(6*rand(1,30)+1) Then, using T=find(P==5), I got values where outcome is 5 and stored them in T. The output was : T = 10 11 13 14 15 29 Now, I want to calculate the mean…
0
votes
1 answer

Simulating a process n times in R

I've written an R script (sourced from here) simulating the path of a geometric Brownian motion of a stock price, and I need the simulation to run 1000 times such that I generate 1000 paths of the process Ut = Ste^-mu*t, by discretizing the law of…
0
votes
1 answer

How to add white noise process term for a couple of ODEs, assuming the Gaussian distribution?

This question has already confused me several days. While I referred to senior students, they also cannot give a reply. We have ten ODEs, into which each a noise term should be added. The noise is defined as follows. since I always find that I…
0
votes
0 answers

fatal error in Gillespie alg -*tmp* error - R

I have the following variation of the Gillespie algorithm which is used to model stochastic systems: gillespie_counter_two <- function(N,n,...) { tt = 0 x = N$M S = t(N$Post - N$Pre) u = nrow(S) v = ncol(S) …
0
votes
1 answer

simple animation with matplotlib

I am trying to make a simple animation for a stochastic process (just black and white dots randomly changing their colors). To simulate that, I have basically plotted the dots over a grid. However, the important parameter for me being the rate of…
0
votes
1 answer

What is a possible R code to simulate a one-dimensional Brownian Motion path with each step explained?

n <- 1000 t <- 100 bm <- c(0, cumsum(rnorm(n,0,sqrt(t/n)))) steps <- seq(0,t,length=n+1) plot(steps,bm,type="l",xlab="Time",ylab="B(t)") This is what I have managed to do but the steps do not make total sense. Why must we define n and t? Why do we…
A797
  • 1
  • 2