Precision and CD's
Richard J. Fateman
fateman at cs.berkeley.edu
Wed Jul 21 01:26:21 CEST 1999
I believe that Mathematica 2.0 use figures like "accuracy" of
6.234 decimal digits. Presumably this corresponds to some number
of binary places. Though version 3.0 may be different.
Try
3*(1.0000000000000000000000/3.0000000000000000000)-1
I got -0.x 10^(-24), and it refused to tell me the Accuracy
or Precision of the answer. [I didn't count how many 0s. The
more the merrier.]
More information about the Om
mailing list