Questions tagged [mathematical-optimization]

Mathematical optimization deals with maximizing or minimizing an objective function by choosing values from within an allowed feasible set of possible values. Mathematical optimization is often also referred to as mathematical programming or simply as optimization.

Mathematical optimization deals with maximizing or minimizing a real function by choosing values from within an allowed feasible set of possible values. Mathematical optimization is often also referred to as mathematical programming or simply as optimization.

Thus, the study of Mathematical optimization includes formulating the problem (as a set of mathematical equations), and developing several solution techniques. These techniques exploit the underlying structure of the problem. Different optimization algorithms are suited for different types of problems and vary in solution times and computational complexity.

The goal (to be maximized or minimized) is called the "Objective Function." The set of equations that limit the solution space are the "constraints" and the possible solution space is the "feasible region." In some problems, the aim is to just find any acceptable solution, and these are called "constraint satisfaction problems" in which case there is no real objective function to be minimized or maximized.

Broadly, Mathematical Optimization falls under the area of "Applied Mathematics."

3356 questions
11
votes
1 answer

Linear programming - dual simplex variable meanings?

I have just learned the simplex method for solving linear programs, and I'm trying to understand what it's dual problem represents. I understand the mechanics of solving a dual problem - I do not need help with that. What I can't get (even after…
penelope
  • 8,251
  • 8
  • 45
  • 87
11
votes
7 answers

Neural Net Optimize w/ Genetic Algorithm

Is a genetic algorithm the most efficient way to optimize the number of hidden nodes and the amount of training done on an artificial neural network? I am coding neural networks using the NNToolbox in Matlab. I am open to any other suggestions of…
11
votes
2 answers

Linear algebra library for the D programming language

I'm looking for a package to do matrix math with matrices of up to about 100 x 100. I need to, at a minimum, do inverses, multiplication and transposition. I'd prefer a more encapsulated interface over higher performance.
BCS
  • 75,627
  • 68
  • 187
  • 294
11
votes
4 answers

constrained nonlinear optimization in Microsoft Solver foundation vs Matlab fmincon

can anyone show me examples or reviews for constrained nonlinear optimization in Microsoft Solver foundation 3.0? How's it compared to Matlab's fmincon? Or is there any better .net library for constrained nonlinear optimization? thanks,
ahala
  • 4,683
  • 5
  • 27
  • 36
11
votes
4 answers

Maximum volume inscribed ellipsoid in a polytope/set of points

Later Edit: I uploaded here a sample of my original data. It's actually a segmentation image in the DICOM format. The volume of this structure as it is it's ~ 16 mL, so I assume the inner ellipsoid volume should be smaller than that. to extract the…
RMS
  • 1,350
  • 5
  • 18
  • 35
11
votes
5 answers

Solving nonlinear equations numerically

I need to solve nonlinear minimization (least residual squares of N unknowns) problems in my Java program. The usual way to solve these is the Levenberg-Marquardt algorithm. I have a couple of questions Does anybody have experience on the different…
11
votes
1 answer

R optim(): unexpected behavior when working with parent environments

Consider the function fn() which stores the most recent input x and its return value ret <- x^2 in the parent environment. makeFn <- function(){ xx <- ret <- NA fn <- function(x){ if(!is.na(xx) && x==xx){ cat("x=", xx, ",…
11
votes
1 answer

Implementation of Particle Swarm Optimization Algorithm in R

I'm checking a simple moving average crossing strategy in R. Instead of running a huge simulation over the 2 dimenional parameter space (length of short term moving average, length of long term moving average), I'd like to implement the Particle…
Eva
  • 917
  • 4
  • 18
  • 23
11
votes
2 answers

Fit plane to a set of points in 3D: scipy.optimize.minimize vs scipy.linalg.lstsq

Given a set of points in 3D, the general problem is to find the a, b, c coefficients of a plane equation in the form: z = a*x + b*y + c such that the resulting plane is the best fit possible to that set of points. In this SO answer, the function…
Gabriel
  • 40,504
  • 73
  • 230
  • 404
11
votes
1 answer

Scipy.optimize.minimize method='SLSQP' ignores constraint

I'm using SciPy for optimization and the method SLSQP seems to ignore my constraints. Specifically, I want x[3] and x[4] to be in the range [0-1] I'm getting the message: 'Inequality constraints incompatible' Here is the results of the execution…
Zahy
  • 367
  • 7
  • 18
11
votes
1 answer

Optimum path in a graph to maximize a value

I'm trying to come up with a reasonable algorithm for this problem: Let's say we have bunch of locations. We know the distances between each pair of locations. Each location also has a point. The goal is to maximize the sum of the points while…
Hzyf
  • 1,007
  • 2
  • 12
  • 21
11
votes
4 answers

how to minimize a function using Deap?

I need to minimize a function using genetic algorithm and PSO. Different posts suggest to use DEAP (I am using python) but I do not even understand how to start. We can consider for example f on the interval i i=arange(-10,10,0.1) def f(x): …
Donbeo
  • 17,067
  • 37
  • 114
  • 188
11
votes
2 answers

Choosing the initial simplex in the Nelder-Mead optimization algorithm

What's the best way to initialize a simplex for use in a Nelder-Mead simplex search from a user's 'guess' vertex?
craigB
  • 372
  • 1
  • 3
  • 13
11
votes
4 answers

Linear programming library for .NET / C#

I need to solve an under-determined linear system of equations and constraints, then find the particular solution that minimises a cost function. This needs to be done in purely portable managed code that will run in .NET and Mono. What freely…
Dylan
  • 1,692
  • 1
  • 13
  • 24
11
votes
7 answers

Algorithm Optimization - Shortest Route Between Multiple Points

Problem: I have a large collection of points. Each of these points has a list with references to other points with the distance between them already calculated and stored. I need to determine the shortest route that begins from an origin and…
Chris Douglass
  • 309
  • 1
  • 3
  • 11