Search code examples
Matlab sin(pi) and its relation to machine epsilon...


matlabfloating-pointrounding-error

Read More
Different Rounding Results in Java 6 and Java 8...


javarounding-error

Read More
Rounding, variable from a .txt in Python 3 and extra...


pythonpython-3.xcounterdivisionrounding-error

Read More
Java Rounding to 15 decimal place...


javaroundingrounding-error

Read More
Excel VBA rounding with doubles...


excelfloating-pointdoublerounding-errorvba

Read More
Python and java package for floating point accuracy...


javapythonmathfloating-accuracyrounding-error

Read More
php intval() and floor() return value that is too low?...


phpfloating-accuracyrounding-error

Read More
Which rounding method is used in Java when operating on floating point numbers?...


javafloating-pointoperationrounding-error

Read More
If two languages follow IEEE 754, will calculations in both languages result in the same answers?...


c++floating-pointprecisionscilabrounding-error

Read More
Minimize rounding error when dividing by integers...


floating-pointdivisionnumerical-methodsrounding-error

Read More
Decimal not rounding properly...


c#decimalrounding-error

Read More
Python: weird rounding behavior of math.sqrt()...


pythonpython-2.7floating-pointrounding-error

Read More
Chaotic Pendulum Exhibiting Chaotic Behavior with the Same Initial Conditions...


pythonchipmunkrounding-errorpymunkchaos

Read More
Gamma in the Baum Welch algorithm and float precision...


chidden-markov-modelsrounding-error

Read More
SQL Server Rounding issue...


sqlsql-serversql-server-2012rounding-error

Read More
Why does MidpointRounding.AwayFromZero and MidpointRounding.ToEven do the same thing?...


c#.netmathrounding-error

Read More
C++ rounding to FE_TONEAREST...


c++c++11rounding-errorrounding

Read More
Rounding error from array -> string -> array conversion...


pythonarraysstringnumpyrounding-error

Read More
Python: rounding error distorts uniform distribution...


pythonrandomroundingrounding-error

Read More
Java Arithmetic Coding - Finding Character Ranges...


javacompressionprecisionrounding-error

Read More
Trying to use Math.floor to round numbers but it doesn't cut them off at the right point...


javamathrounding-error

Read More
Calculations being being rounded SQL Server 2012...


calculated-columnsdecimalformatrounding-error

Read More
R issue with rounding milliseconds...


rtimeroundingmillisecondsrounding-error

Read More
SSE rounds down when it should round up...


c++x86sseintrinsicsrounding-error

Read More
Avoid rounding error when manually parsing double...


parsingdoublerounding-error

Read More
Trying to mimic Excel rounding is causing me grief...


c#excelrounding-errorrounding

Read More
XSLT 2.0: Rounding result of calculation to two decimals...


xsltroundingxslt-2.0xpath-2.0rounding-error

Read More
Why is python giving large errors when dividing the results of sin()...


pythonrounding-error

Read More
Python rounding error for ints in a list (list contains ints and strings)...


python-2.7rounding-error

Read More
Handling doubles with large integer parts in C++...


c++typesdoublerounding-error

Read More
BackNext