Precision and CD's

Richard J. Fateman fateman at cs.berkeley.edu
Wed Jul 21 01:26:21 CEST 1999


I believe that Mathematica 2.0 use figures like "accuracy" of
6.234 decimal digits.  Presumably this corresponds to some number
of binary places.  Though version 3.0 may be different.
Try
3*(1.0000000000000000000000/3.0000000000000000000)-1

I got -0.x 10^(-24), and it refused to tell me the Accuracy
or Precision of the answer.  [I didn't count how many 0s. The
more the merrier.]








More information about the Om mailing list