Questions tagged [stochastic-process]

A stochastic process is a collection of related random variables, often used as a model for a quantity that varies over time or space with some degree of smoothness.

In probability theory, a stochastic process, or sometimes random process (widely used) is a collection of random variables; this is often used to represent the evolution of some random value, or system, over time. This is the probabilistic counterpart to a deterministic process (or deterministic system). Instead of describing a process which can only evolve in one way (as in the case, for example, of solutions of an ordinary differential equation), in a stochastic or random process there is some indeterminacy: even if the initial condition (or starting point) is known, there are several (often infinitely many) directions in which the process may evolve.

In the simple case of discrete time, a stochastic process amounts to a sequence of random variables known as a time series (for example, see Markov chain). Another basic type of a stochastic process is a random field, whose domain is a region of space, in other words, a random function whose arguments are drawn from a range of continuously changing values. One approach to stochastic processes treats them as functions of one or several deterministic arguments (inputs, in most cases regarded as time) whose values (outputs) are random variables: non-deterministic (single) quantities which have certain probability distributions. Random variables corresponding to various times (or points, in the case of random fields) may be completely different. The main requirement is that these different random quantities all have the same type. Type refers to the co-domain of the function. Although the random values of a stochastic process at different times may be independent random variables, in most commonly considered situations they exhibit complicated statistical correlations.

Familiar examples of processes modeled as stochastic time series include stock market and exchange rate fluctuations, signals such as speech, audio and video, medical data such as a patient's EKG, EEG, blood pressure or temperature, and random movement such as Brownian motion or random walks. Examples of random fields include static images, random terrain (landscapes), wind waves or composition variations of a heterogeneous material.

143 questions
0
votes
1 answer

Using CPnest to calculate Bayes Theorem evidence, receiving AttributeError: 'MetropolisHastingsSampler' object has no attribute 'thread_id'

I am currently trying to use CPnest to calculate some evidences for given a data set (Bayesian statistics) Upon my first running of the code, I received the error RuntimeError: Attempt to start a new process before the current process …
0
votes
2 answers

Simple Gaussian Process Simulation on R

How to simulate a Gaussian process X(t), t = 1, . . . , 200, with mean value function m(t) = 0 and covariance function r(h) = Cov(t, t + h) = exp(-|h|). I Know that this process is sometimes referred to as the Ornstein-Uhlenbeck process but how to…
Ticktock
  • 3
  • 3
0
votes
1 answer

KeyError with a poisson process using pandas

I am trying to create a function which will simulate a poison process for a changeable dt and total time, and have the following: def compound_poisson(lamda,mu,sigma,dt,T): points = pd.Series(0) out = pd.Series(0) inds =…
W M Seath
  • 113
  • 5
0
votes
1 answer

Is there some seed for choice from np.random distributions?

I want to model wiener process and I want to add some implementation of elementary result, so I want to write something like this: # w is elementary result def W(T, w = 0, dt = 0.001): x = [0] for t in np.arange(0, T, dt): …
Nourless
  • 729
  • 1
  • 5
  • 18
0
votes
1 answer

Animating a 2D plot (2D brownian motion) not working in Python

I am trying to plot a 2D Brownian motion in Python but my plot plots the grid but does not animate the line. Attempted at performing this plot is below, !apt install ffmpeg import matplotlib matplotlib.use("Agg") import matplotlib.pyplot as…
user4933
  • 1,485
  • 3
  • 24
  • 42
0
votes
1 answer

simulate a possion process from another poisson process

I am wondering how to simulate a Poisson process from another one with a Bernoulli random variable of parameter p. To simulate the first Poisson process with parameter \lambda over the interval [0,t], generally pois = rpois(1, \lambda) v =…
user008
  • 23
  • 4
0
votes
2 answers

Systematic error in Python stochastic simulation

I want to simulate a simple birth death process using the Gillespie algorithm (https://en.wikipedia.org/wiki/Gillespie_algorithm) in python. At each instant, there is a probability a of birth and a probability b of death per indiviudal. I believe…
kevinkayaks
  • 2,636
  • 1
  • 14
  • 30
0
votes
1 answer

How to change seed number in Fortran stochastic simulator code

I'm running a Fortran code which performs a stochastic simulation of a marked Poisson cluster process. In practice, event properties (eg. time of occurrences) are generated by inversion method, i.e. by random sampling of the cumulative distribution…
Roland
  • 427
  • 1
  • 4
  • 15
0
votes
1 answer

Calculate effective diffusion coefficient

I need to compute the drift velocity ( v=d/dt[r(t)] ) and the effective diffusion coefficient (Deff=d/dt[r(t)^2]-d/dt[r(t)]^2 ) from random trajectories for the case of Brownian motion over a periodic potential. As a mere example assume I have an…
0
votes
1 answer

What is the difference between Stochastic Gradient Descent and LightGBM?

Although I have individually researched these concepts, I am confused on whether one or the other can be chosen for a solution, or can both of these be used simultaneously to improve results? Any guidance you can provide will be much appreciated.
0
votes
0 answers

Discretization simulation of a Wiener Process

I got some problems with this homework which I have totally no idea, never got into this field before and I really need some help. First, we have a wiener process like Which means the probability of the process drops beneath -3 within the time…
recon
  • 157
  • 9
0
votes
1 answer

Is there a way to pre-specify multiple initial Markov states when using rmarkovchain in the marckovchain library?

I'm using rmarkovchain from library("markovchain"). In this function we have the option to specify time 0. For example: rmarkovchain(n = 10, #number of time moments eg. 10 days object = dtmcA, t0 =…
0
votes
0 answers

Tensorflow: Modify datapoints used in loss function evaluation after each gradient step using tf optimizer

Typically a tf optimizer flow is as follows: # Create an optimizer. opt = GradientDescentOptimizer(learning_rate=0.1) # Compute the gradients for a list of variables. grads_and_vars = opt.compute_gradients(loss, ) #…
0
votes
1 answer

python plot with mean/standard deviation (maybe R?)

Hi I'm trying to produce a plot with the mean and standard deviation marked for a single realization of a random process as in the linked diagram. I've looked at python charting but can't find any packages that produce a similar plot.
user171006
  • 13
  • 1
  • 5
0
votes
0 answers

Simulating Ogata's Thinning Algorithm in R

I am trying to implement Ogata's Thinning Algorithm exactly as given in Algorithm 3 in https://www.math.fsu.edu/~ychen/research/Thinning%20algorithm.pdf with the parameters they specify to generate Figure 2. This is the code that replicates it…
user2167741
  • 277
  • 1
  • 10