Taming Floating Point Error
If you’ve been a software engineer for long enough, it is very likely that you’ve seen this example of floating point perfidy:
>>> 3.0 / 100.3
>>> 0.1…
Leggi tutto
The Fundamental Axiom of Floating Point Arithmetic
steven@pcgamer.com
1.9k Views
Written by steven@pcgamer.com
