Questions tagged [derivative]

In calculus, a derivative is a measure of a function's rate of change as its input changes.

Loosely speaking, a derivative can be thought of as how much one quantity is changing in response to changes in some other quantity; for example, the derivative of the position of a moving object with respect to time is the object's instantaneous velocity.

The derivative of a function at a chosen input value describes the best linear approximation of the function near that input value. For a real-valued function of a single real variable, the derivative at a point equals the slope of the tangent line to the graph of the function at that point. In higher dimensions, the derivative of a function at a point is a linear transformation called the linearization.1 A closely related notion is the differential of a function.

The process of finding a derivative is called differentiation. The reverse process is called antidifferentiation. The fundamental theorem of calculus states that antidifferentiation is the same as integration. Differentiation and integration constitute the two fundamental operations in single-variable calculus.

enter image description here

845 questions
12
votes
1 answer

List of activation functions in C#

I can find a list of activation functions in math but not in code. So i guess this would be the right place for such a list in code if there ever should be one. starting with the translation of the algorithms in these 2…
Rottjung
  • 493
  • 1
  • 5
  • 15
11
votes
2 answers

Derivative of a softmax function explanation

I am trying to compute the derivative of the activation function for softmax. I found this : https://math.stackexchange.com/questions/945871/derivative-of-softmax-loss-function nobody seems to give the proper derivation for how we would get the…
Roshini
  • 703
  • 2
  • 8
  • 21
10
votes
1 answer

Derivatives of data structures in Agda

I am currently implementing derivatives of regular data structures, in Agda, as presented in the One-Hole Context paper by Conor McBride [5]. In implementing it straight out of the OHC paper, which has also been done by Löh & Magalhães [3,4], we are…
N. Brett
  • 171
  • 5
10
votes
2 answers

How to speed up symbolic derivatives of long functions using SymPy?

I am writing a program in Python to solve the Schrödinger equation using the Free ICI Method (well, SICI method right now... but Free ICI is what it will turn into). If this does not sound familiar, that is because there is very little information…
Shrodinger149
  • 123
  • 1
  • 7
10
votes
1 answer

Numerical derivatives of an arbitrarily defined function

I would like to find numerical derivatives of a bivariate function. The function is defined by myself I need first derivatives with respect to each argument and cross second derivative Is there a package or built-in function to do this?
user67275
  • 1
  • 9
  • 38
  • 64
9
votes
1 answer

Simplest way to determine if class x is derived from class y? (c#)

Is this the simplest way to determine if foo is the same or derived from type T bool Derives(object foo) { return foo is T; } and an exact match would be bool ExactMatch(object foo) { return foo.GetType() == typeof(T); }
maxp
  • 24,209
  • 39
  • 123
  • 201
9
votes
2 answers

How to derive with respect to a Matrix element with Sympy

Given the product of a matrix and a vector A.v with A of shape (m,n) and v of dim n, where m and n are symbols, I need to calculate the Derivative with respect to the matrix elements. I haven't found the way to use a proper vector, so I started…
9
votes
3 answers

Derivative of summations

I am using sympy from time to time, but am not very good at it. At the moment I am stuck with defining a list of indexed variables, i.e. n1 to nmax and performing a summation on it. Then I want to be able to take the derivative: So far I tried the…
Johannes
  • 161
  • 1
  • 6
9
votes
3 answers

Backpropogation activation derivative

I've implemented backpropagation as explained in this video. https://class.coursera.org/ml-005/lecture/51 This seems to have worked successfully, passing gradient checking and allowing me to train on MNIST digits. However, I've noticed most other…
Kieren Anderson
  • 508
  • 3
  • 16
9
votes
5 answers

Numpy or SciPy Derivative function for non-uniform spacing?

I was wondering if numpy or scipy had a method in their libraries to find the numerical derivative of a list of values with non-uniform spacing. The idea is to feed in the timestamps that correspond to the values and then for it to use the…
user3123955
  • 2,809
  • 6
  • 20
  • 21
9
votes
1 answer

What and why about GLSL textureGrad

So I read the OpenGL info page on textureGrad but it doesn't really explain anything. So you can explicitly specify the partial derivatives of P relative to X and Y What does this actually do? How does OpenGL calculate the derivatives when you…
Nathan Wride
  • 965
  • 1
  • 7
  • 28
8
votes
3 answers

How do I find the derivative of a function in Octave?

Inputs: Xf = and array that holds the x-values of the points Yf = an array that holds the y-values of the points method = 2-point forward difference, 2-point backward difference, 3-point central difference, 5-point central difference Outputs: X =…
TheMortiestMorty
  • 421
  • 2
  • 4
  • 12
8
votes
1 answer

how to use Savitzky-Golay smooth coefficient to calculate derivatives

Savitzky-Golay smoothing filter can be used to calculate the coefficients so as to calculate the smoothed y-values by applying the coefficients to the adjacent values. The smoothed curve looks great. According to the papers, the coefficients can…
Lin Song Yang
  • 1,936
  • 19
  • 17
8
votes
1 answer

Finding the derivative of a 2D function using FFT properties

I'm trying to use the FFT properties to get the i-th derivative of a 2D function - specifically a 2D Gaussian function. I would also like to do this numerically in MATLAB. Actually, I don't have a clue of what I'm doing, but I've read a lot on the…
Keydash
  • 83
  • 1
  • 4
7
votes
1 answer

how is Laplacian filter calculated?

I don't really follow how they came up with the derivative equation. Could somebody please explain in some details or even a link to somewhere with sufficient math explanation? Laplacian filter looks like
wisdom
  • 412
  • 2
  • 5
  • 20
1
2
3
56 57