Search code examples
Is there any risk of using float variables as loop counters and their fractional increment/decrement...

cloopsfloating-pointprecisionloop-counter

Read More
Ensuring C++ doubles are 64 bits...

c++typesprecisionieee-754

Read More
Precision issue of integrate function in R...

rprecisionnumerical-integration

Read More
Machine Epsilon in Python...

pythonnumpyfloating-pointprecision

Read More
How do I interpret precision and scale of a number in a database?...

sqldatabasedecimalscaleprecision

Read More
What is the approximate resolution of a single precision floating point number when its around zero...

cfloating-pointprecisionieee-754single-precision

Read More
Why does np.exp(1000) give an overflow warning but np.exp(-100000) not give an underflow warning?...

pythonnumpyprecision

Read More
PHP7.1 json_encode() Float Issue...

phpjsonprecisionphp-7.1

Read More
How to format float to omit zeros at the end of the fraction...

floating-pointformatprecisionstring-formattingmonkeyc

Read More
Print __float128, without using quadmath_snprintf...

c++cfloating-pointprecisionfloating-point-precision

Read More
C why is the DBL_MANT_DIG macro defined as 53...

cfloating-pointprecisionieee-754

Read More
Numerical instability of gradient descent in C...

cprecisionnumerical-methodsgradient-descent

Read More
Is the leftmost bit of the mantissa always 1?...

floating-pointprecisionfloating-accuracy

Read More
Misunderstanding the integration of MATLAB...

matlabfloating-pointprecisionnumerical-integration

Read More
How do I use parameter epsabs in scipy.integrate.quad in Python?...

pythonscipyprecisionnumerical-integrationquad

Read More
Largest number a floating point number can hold while still retaining a certain amount of decimal pr...

floating-pointprecision

Read More
std::floating_point concept in CUDA for all IEE754 types...

c++cudaprecisionc++-conceptshalf-precision-float

Read More
How to overcome a precision error in Python when summing a list of floating point numbers?...

pythonmathprecision

Read More
How to set double precision for elements of an array in Fortran 90...

arraysfortrandoubleprecisiongfortran

Read More
Truncate a floating point number without rounding up...

rubymathfloating-pointdecimalprecision

Read More
Can the product of two "whole" doubles always be correctly represented?...

floating-pointprecision

Read More
How many additions operation can be performed instead of single multiplication in FPGA?...

additionprecisionbitwise-operatorsfpgamultiplication

Read More
What is the best approach to deal with floating point issues when limiting the user input to 2 decim...

javascriptfloating-pointprecision

Read More
Ruby code to remove insignificant decimal places?...

rubystringdecimalprecisionrational-number

Read More
How to get the smallest numberA that is N times another numberB, and bigger or equal numberC...

floating-pointprecision

Read More
How to wait for a specific amount of time precisely in javascript...

javascriptperformancetimersettimeoutprecision

Read More
Changing precision of numeric column in Oracle...

sqloracle-databaseprecision

Read More
How to match the element of a double vector in google test in C++?...

c++unit-testingprecisiongoogletest

Read More
Next higher/lower IEEE double precision number...

floating-pointdoubleprecisionieee-754

Read More
Can the Precision, Recall and F1 be the same value?...

machine-learningscikit-learnclassificationprecisionprecision-recall

Read More
BackNext