Stack Overflow
Stack Overflow

Questions tagged [numerical]

This tag is for questions concerning problems using numbers which either cannot be exactly solved, or where the exact solution may be much more difficult to acquire than by using numerical methods.

This tag is for questions concerning problems using numbers which either cannot be exactly solved, or where the exact solution may be much more difficult to acquire than by using numerical methods.

It includes questions about algorithms, precision and accuracy of underlying numbers, advantages and disadvantages of several methods, error propagation, problems with the underlying numbers and data structures.

508 questions
-1
votes
1 answer

isNaN not working in Firefox

I have a textbox setup the following way: (note:…
Boba Fett
  • 133
  • 1
  • 3
  • 11
-1
votes
1 answer

c power calculation, compiler optimization

so I have recently been working with some probability distributions of order statistics. in that area it is quite common to see lots of formulas with high powers of numbers from the real interval [0, 1]. Consider numbers a ~ b ~ 0, both positive. I…
Jack
  • 195
  • 2
  • 10
-1
votes
2 answers

How to process calculations with a high digit numbers?

When I want to work with big and small digits how must I sum / compare values in C? #include #include int main(void) { if (1.0 + (1/pow (10,50)) == 1.0) printf("true"); else printf("false"); return…
cnd
  • 32,616
  • 62
  • 183
  • 313
-2
votes
1 answer

AWK Output string with variable input

I have a CSV file, for example data may come in ;0; or ;.2; or ;.23456; the output string (to a file) must in this case be 6 bytes with an Implicit decimal, so 0 would of course be 000000, .2 would be 020000, .23456 would be 023456. and 1 would be…
TimRoaix
  • 1
-2
votes
3 answers

c# organize dictionary keys in numerical order

I have a program where I am parsing sql scripts in order of the file directory. The idea from the team was that changes or additions to the sql scripts were done in order, and so the folders are named from 0 to 12. So I need to parse through these…
as.beaulieu
  • 464
  • 1
  • 10
  • 26
-2
votes
2 answers

Equivalent of numpy.nan_to_num in C/C++

How can I achieve behavior equivalent to numpy's numpy.nan_to_num function in C/C++? Specificiation for non-python programmers: Replace nan with zero and inf with finite numbers. Returns an array or scalar replacing Not a Number (NaN) with zero, …
Elliot Gorokhovsky
  • 3,610
  • 2
  • 31
  • 56
-2
votes
2 answers

Numerical transformation in javascript and math operation

Here is the code: alert(typeof(+"13t")); alert(1 + (+"13t")); Why in the first line the output is "number" And in the second line the output is "NaN"??
Experimenter
  • 2,084
  • 1
  • 19
  • 26
-2
votes
1 answer

wOODy's Numerical Keyboard in VFP

Can anybody help me to find wOOdy's numerical keyboard source files shown in below link ?…
Shafraz Khahir
  • 145
  • 1
  • 2
  • 7
-2
votes
8 answers

Anyone know where a good windows constant list lives

I'm trying to set an invalid value to -1.. But I don't like magic numbers.. Anyone know where to find a set of common constants. I'm working in VS6 (ish). I'm trying to read a file from across a network, and I need a bad value for the total file…
baash05
  • 4,394
  • 11
  • 59
  • 97
-2
votes
1 answer

How to compute an exponent in matlab without getting inf even with vpa or sym?

i have this exp function in…
ariel rahardi
  • 3
  • 2
-2
votes
1 answer

perl - sort descending numerically, then alphabetically

Ok, here is task at hand: take a flat data file and sort the contents based on the numerical value of one of the elements of an array, then sort alphabetically (while preserving the descending numerical sort order). Data file is something like…
Bob
  • 165
  • 2
  • 13
-2
votes
1 answer

high order number in computer simulation

I wrote a Fortran code to solve PDE (like continuity equation) but the initial value of unknown are in order of 1.0e20 this imply my code to give NANE (not number) of infinity because it's multiplying or dividing big number what can I do to run…
user1482636
  • 11
  • 5
-2
votes
1 answer

how to change scientific notation to numeric in a specific column in linux or perl

I have a file as follows: 1 13.00000 12.9999999183917 8.160832898340686E-008 21148294 2 16.00000 15.9999995223584 -4.760327190211910E-007 21148294 3 9.000000 8.99999979262170 2.073783047507050E-007 21148295 I want an…
user3383949
  • 3
  • 1
  • 2
-2
votes
2 answers

Give factors numerical value [R]

I want to predict a numerical variable. I have a couple of factors. For all that factors I have a numerical equivalent. Now it would be perfect to assign that numerical equivalent to the factor and use it in the prediction. Is this possible? If this…
nik
  • 2,114
  • 3
  • 22
  • 43
-2
votes
1 answer

Need help with C# function to translate smoothly between numeric ranges

I'm trying to write a function : Input: Source range, Source value, output range, curve type (Linear, smooth) Output: The output is the "source value" converted into the "output range" according to the curve type. I hope I am making sense…
Shachar Weis
  • 936
  • 2
  • 20
  • 44
1 2 3
…
33
34