Search code examples
I implemented my own square root function in c++ to get precision upto 9 points but it's not wor...

c++floating-pointprecisionsqrt

Read More
Less than or equal to operator for numpy floating points?...

pythonnumpyfloating-point

Read More
How does SQL Server store integer values of over 2^24 in a FLOAT(53) column?...

sql-serverfloating-pointfloating-accuracy

Read More
Representation of fixed point numbers...

mathfloating-pointbinary

Read More
How do I remove trailing zeros when printing a floating-point number?...

c++floating-pointiostream

Read More
Tolerant key lookup in std::map...

c++dictionarystlfloating-point

Read More
assert (!isnan(x)) succeeds but printf("%f",x) shows -nan...

cfloating-pointocamlnan

Read More
regular expression for finding decimal/float numbers?...

javascriptregexfloating-pointdecimal

Read More
1 / 0.2 should be 5, so why is the result 4?...

c++floating-point

Read More
`std::uniform_real_distribution` lacking diversity in exponent...

c++randomfloating-point

Read More
entry widget validation with tkinter for both integers and floating point values...

validationtkinterfloating-pointintegerwidget

Read More
Does equality check for floats in python check against machine epsilon tolerances?...

pythonfloating-pointprecision

Read More
How can I remove ".0" of float numbers?...

floating-pointintpython-3.5

Read More
How to prevent the program from returning 'inf'?...

c++floating-pointnumeric

Read More
Why does division (3/5) result in zero despite being stored as a double?...

c++floating-pointdivisioninteger-division

Read More
Can a IEEE 754 real number "cover" all integers within its range?...

mathfloating-pointieee-754

Read More
Testing if given number is integer...

c++floating-pointnumbers

Read More
How can I check whether a double has a fractional part?...

c++floating-pointdouble

Read More
Why does modulus (%) operator work for char but not for floating types?...

cfloating-pointoperatorsmodulus

Read More
Random float number generation...

c++randomfloating-point

Read More
Storing ASCII code point value in a float prevents its interpretation as a character (in C)...

cfloating-pointcharacterprecisionsystem-calls

Read More
Function to determine if two numbers are nearly equal when rounded to n significant decimal digits...

pythonmathfloating-pointnumpy

Read More
how to present uint16 as float16...

pythonfloating-pointuint16

Read More
In Python, what expression is equivalent to `0x1.0p-53`?...

pythonfloating-pointinteger

Read More
Why the C standard library haven't isequal?...

cfloating-pointcompare

Read More
When creating a nan which contains a char-sequence, how do I get the char-sequence back?...

c++floating-pointnanieee-754

Read More
Why is do Pythons sum() and Pandas sum() yield different results...

pythonpandassumfloating-pointprecision

Read More
Can I truncate 10-byte "extended" number and convert as an 8-byte double?...

rfloating-pointtype-conversion

Read More
How to manually convert fprintf hexadecimal representation of floating point to decimal...

cfloating-pointhex

Read More
How to accept both integer and float values as input?...

pythonpython-3.xfloating-pointintegeruser-input

Read More
BackNext