Search code examples
How to fix numpy floating-point operations producing inexact results?...

pythonpandasnumpycomparisonfloating-accuracy

Read More
Addition with floating point numbers in JavaScript and PHP and consistancy...

javascriptphpfloating-pointfloating-accuracy

Read More
What's the best way to avoid binary rounding errors affecting conditions?...

pythonpython-2.7floating-pointfloating-accuracy

Read More
Why 0.1 + 0.2 == 0.3 in D?...

floating-pointfloating-accuracydconstantfolding

Read More
Float number behavior...

phpnumbersfloating-accuracy

Read More
Python: When finding the product of a large array, how best to reduce floating point error?...

pythonnumpyprecisionfloating-accuracy

Read More
SQL Server float unstable last digits...

sqlsql-serverpython-3.xfloating-accuracypypyodbc

Read More
Different results with floor(a, b) and a // b...

luafloating-accuracy

Read More
Spreadsheet calculations with (at least) the accuracy of a C double...

spreadsheetprecisionfloating-accuracylibreoffice-calcarbitrary-precision

Read More
Identify actual precision of a float...

pythondecimalprecisionfloating-accuracy

Read More
Extracting decimal part of a float accurately...

c++arduinodecimalfloating-accuracy

Read More
Strange issue with floating point accuracy on ARM64...

c++floating-pointarmfloating-accuracyarm64

Read More
C# accuracy when checking float in List<float> with Contains method...

c#listcontainsfloating-accuracy

Read More
c++14 - Are DBL_Max and DBL_Min subject to round off errors?...

floating-pointdoublec++14precisionfloating-accuracy

Read More
Double precision error in R...

rprecisionfloating-accuracy

Read More
Floating Point comparison specific...

c++floating-accuracy

Read More
Discrepancy of floating representation...

pythonfloating-pointfloating-accuracy

Read More
Exponents in C#...

c#floating-pointfloating-accuracy

Read More
Why does the sum of float numbers with exact values still depend on order?...

javascriptfloating-pointfloating-accuracy

Read More
How to deal with inexact floating point arithmetic results in Rust?...

floating-pointrustprecisionfloating-accuracy

Read More
Avg of float inconsistency...

sql-servert-sqlsql-server-2012floating-accuracy

Read More
Trying to log accuracy of CNN TensorFlow on TensorBoard...

loggingtensorflowfloating-accuracytensorboard

Read More
Why 4.7 is 4.6999999 in c...

cmingwcodeblocksfloating-accuracy

Read More
Array comparison not matching elementwise comparison in numpy...

pythonarraysnumpyfloating-pointfloating-accuracy

Read More
How to define a floating-point data type larger than 16 bytes?...

cfloating-pointprecisionfloating-accuracy

Read More
Accuracy problems in overdefined linear system...

pythonlinear-algebrafloating-accuracy

Read More
Groovy vs Java - difference in floating point accuracy...

javagroovyfloating-accuracy

Read More
Swift: converting String to Float and back to String again after doing some mathematical operations...

iosswiftfloating-pointfloating-accuracy

Read More
Float comparison with zero-initialised value in C++...

c++floating-pointfloating-accuracy

Read More
Double value appending with additional 0...

javafloating-pointfloating-accuracy

Read More
BackNext