Search code examples
SQL AVG returning an int...

sqlcastingfloating-pointaverage

Read More
Why does floating-point floor division return a different value from flooring the result of regular ...

pythonfloating-pointrounding

Read More
What's the relative speed of floating point add vs. floating point multiply...

floating-pointx86mipsnumerical-computingflops

Read More
Incrementing to the last decimal in python...

pythonpython-3.xfloating-pointdecimalincrement

Read More
intel fortran compiler crushed on triple precision...

floating-pointfortranintel-fortran

Read More
Delphi 6 Compiler Options (Pentium-safe FDIV)...

delphifloating-pointdivision

Read More
Dealing with overflow and underflow in integer and floating-point multiplication...

cfloating-pointintegeroverflowunderflow

Read More
How can i print a floating-point (VFP) number in ARM?...

assemblyprintingfloating-pointarm

Read More
Double multiplied with int has become less accurate in .NET Core...

.net.net-corefloating-pointdoubleprecision

Read More
Floating point less-than-equal comparisons after addition and subtraction...

rfloating-pointfloating-accuracyepsiloninexact-arithmetic

Read More
double precision and single precision floating point numbers?...

pythonnumpyfloating-pointprecisionsingle-precision

Read More
Dipy - Attribute Error: AttributeError: module 'numpy' has no attribute 'float'...

pythonnumpypipfloating-pointattributeerror

Read More
In C, extract mantissa of a double as a long long in portable way...

cfloating-pointbinary-datamath.h

Read More
math.h ceil not working as expected in C...

cmathfloating-point

Read More
How MAX_SAFE_INTEGER 2 ** 53 - 1...

javascriptfloating-point

Read More
Is it 52 or 53 bits of floating point precision?...

floating-pointieee-754floating-point-precision

Read More
Why is numpy's sine function so inaccurate at some points?...

pythonnumpyfloating-point

Read More
bash + sed: trim trailing zeroes off a floating point number?...

regexbashsedfloating-point

Read More
std::numeric_limits::epsilon() for double-double arithmetic...

c++floating-pointnumeric-limitsdouble-double-arithmetic

Read More
Is Serializing Floats Necessary for Cross-Platform Network Code?...

cnetwork-programmingserializationfloating-pointieee-754

Read More
Overflow while attempting to calculate the Hamming weight in C++...

c++recursionfloating-pointprecisioninteger-overflow

Read More
Why doesn't C have unsigned floats?...

ctypesfloating-pointformatunsigned

Read More
OpenGL: Is the precision of GL_R11F_G11F_B10F good for 8bit RGB images?...

imageopenglfloating-pointprecisionpixelformat

Read More
A more accurate data type than float or double?...

c++floating-pointfloating-accuracydecimal

Read More
Given two doubles, how to determine if their quotient is exact?...

javamathfloating-pointieee-754

Read More
log of unsigned long long int argument...

c++floating-pointprecisionlogarithm

Read More
How to get the lowest representable floating point value in C++...

c++floating-pointstandard-library

Read More
C++ pow unusual type conversion...

c++floating-pointtype-conversionprecisionpow

Read More
Can I guarantee the C++ compiler will not reorder my calculations?...

c++optimizationfloating-pointieee-754double-double-arithmetic

Read More
Compile-time check for -fsingle-precision-constant...

cgccfloating-pointliteralsstatic-assert

Read More
BackNext