Questions tagged [stochastic-process]

A stochastic process is a collection of related random variables, often used as a model for a quantity that varies over time or space with some degree of smoothness.

In probability theory, a stochastic process, or sometimes random process (widely used) is a collection of random variables; this is often used to represent the evolution of some random value, or system, over time. This is the probabilistic counterpart to a deterministic process (or deterministic system). Instead of describing a process which can only evolve in one way (as in the case, for example, of solutions of an ordinary differential equation), in a stochastic or random process there is some indeterminacy: even if the initial condition (or starting point) is known, there are several (often infinitely many) directions in which the process may evolve.

In the simple case of discrete time, a stochastic process amounts to a sequence of random variables known as a time series (for example, see Markov chain). Another basic type of a stochastic process is a random field, whose domain is a region of space, in other words, a random function whose arguments are drawn from a range of continuously changing values. One approach to stochastic processes treats them as functions of one or several deterministic arguments (inputs, in most cases regarded as time) whose values (outputs) are random variables: non-deterministic (single) quantities which have certain probability distributions. Random variables corresponding to various times (or points, in the case of random fields) may be completely different. The main requirement is that these different random quantities all have the same type. Type refers to the co-domain of the function. Although the random values of a stochastic process at different times may be independent random variables, in most commonly considered situations they exhibit complicated statistical correlations.

Familiar examples of processes modeled as stochastic time series include stock market and exchange rate fluctuations, signals such as speech, audio and video, medical data such as a patient's EKG, EEG, blood pressure or temperature, and random movement such as Brownian motion or random walks. Examples of random fields include static images, random terrain (landscapes), wind waves or composition variations of a heterogeneous material.

143 questions
0
votes
1 answer

Python: Integral and funcion nested in another integral using scipy quad

I have managed to write a few lines of code using scipy.integrate.quad for my stochastic process class I have the Markov transition function for standard Brownian motion import numpy as np def p(x,t): return…
Yes
  • 3
  • 3
0
votes
1 answer

Monte Carlo simulation for Geometric Brownian motion in R giving negative numbers

I was under the impression that simulations involving geometric brownian motion are not supposed to yield negative numbers. However, I was trying the following Monte Carlo simulation in R for a GBM, where my initial asset price is: $98.78$, $\mu =…
Thomas Moore
  • 941
  • 2
  • 11
  • 17
0
votes
1 answer

Loop for Stochastic equations

I would like to generate a sequence of stochastic equations for 100 different seed using the following expression: set.seed(123) N <- 100 T <- 1 x <- 10 theta <- c (0 , 5 , 3.5) Dt <- 1 /N Y <- numeric (N +1) Y [1] <- x Z <- rnorm (N) …
0
votes
0 answers

solving Langevins dimensionless stochastic differential equation where the stochastic force varies as Sqrt(tao) in mathematica

i need help with solving Langevins dimensionless stochastic differential equation where the stochastic force varies as Sqrt(tao) in mathematica.
Maine
  • 9
  • 1
0
votes
4 answers

Computing autocorrelation of vectors with numpy

I'm struggling to come up with a non-obfuscating, efficient way of using numpy to compute a self correlation function in a set of 3D vectors. I have a set of vectors in a 3d space, saved in an array a = array([[ 0.24463039, 0.58350592, …
Ferdinando Randisi
  • 4,068
  • 6
  • 32
  • 43
0
votes
1 answer

Why doesn't this toy gradient descent need a different learning rate for the intercept parameter?

In the below example, it's able to find the correct slope (m) but whiffs completely on the intercept (b), which always comes out to near zero. Unless I give b a 1000x learning rate. Why does this happen? Do different types of parameters need…
ʞɔıu
  • 47,148
  • 35
  • 106
  • 149
0
votes
1 answer

Following action a from state s, is the outcome probablisitc or deterministic?

I am struggling to understand one aspect of the Markov Decison Process. When I am in state s and do action a, is it deterministic or stochastic to arrive in state s+1? In most examples it seems to be deterministic. However I found one example in the…
0
votes
1 answer

Clustering with PAM not isolating clusters but T-SNE shows well formed clusters

I am building a clustering algorithm for use with data I have not yet seen, so I'm using some psuedo data in the mean time. The results from PAM show that I do not have any isolated clusters but the ggplot using TSNE shows I have well-formed…
0
votes
1 answer

Plotting Trajectories of GBM with VBA

Goodmorning. I'm new here. Before posting I've searched similar questions, but I found something similar only with different programming language, and however the question found were incomplete. Ok, my problem is to find a VBA code which, once…
Joe
  • 121
  • 2
  • 6
0
votes
1 answer

Nonlinear equation involving summations in R

I am having the hardest time trying to implement this equation into a nonlinear solver in R. I am trying both the nleqslv and BB packages but so far getting nothing but errors. I have searched and read documentation until my eyes have bled, but I…
Lompoc42
  • 55
  • 5
0
votes
1 answer

What is the significance of the stationary distribution of a markov chain given it's initial state?

Let X_n be a MC, P not regular Say we have a stationary dist (pi_0, ..., pi_n) and P(X_0 = i) = 0.2, does this say anything? To be more clear: I ask because Karlin says when a stationary dist is not a limiting dist, P(X_n = i) is dependent on the…
0
votes
1 answer

When computing with the Ornstein Uhlenbeck Model for millisecond data, what should dt equal?

The ornstein uhlenbeck is the following SDE: dx_{t}=\theta (\mu -x_{t})\,dt+\sigma \,dW_{t} generally dt is in years, but is this necessary?
user6437583
  • 75
  • 1
  • 1
  • 10
0
votes
1 answer

Random Walk in Matlab

I am trying to create a simple random walk. This is the code that I wrote. n=50; p=0.5; Y=zeros(n,1); X=zeros(n,1); X(1)=0; for i=1:length(n) Y(i,1)=(rand(1)<=p); end for i=1:length(n) …
sam_rox
  • 739
  • 3
  • 14
  • 29
0
votes
1 answer

Variable Column Index for GnuPlot Data

I wrote a program that generates N trajectories of Brownian motion with increments I~N(0,dt). I'm testing them for a condition W(1)>=1 && W(2)>=2. As an output I'm, of course, saving the time-point data in a file "Wiener_data.dat". Now points that…
Martin
  • 141
  • 1
  • 11
0
votes
1 answer

How to check Artificial Neural Network results not due to chance

I fully understand the theory behind an ANN (in this case, feed forward with back propagation). As the network learns, the weights are adjusted accordingly in order to give the correct results. However, due to the stochastic element involved i.e…
user7190127