Mailing List Archive: 49091 messages
  • Home
  • Script library
  • AltME Archive
  • Mailing list
  • Articles Index
  • Site search
 

[REBOL] Decimal accuracy

From: chalz:earthlink at: 10-Jan-2003 22:53

Okay, I don't think I like this.
>> 261424513284453.055884726735293525 - 261424513284453.0
== 0.0625 Huh? How about this one:
>> 61424513284453.055884726735293525 - 61424513284453.0
== 0.0546875 Closer, but... Something's obviously not right here. In fact, it makes me curious as to whether or not
>> pi ** 29
== 261424513284461 .. is true. Tried it out in Windows /Core 2.5.3 and RedHat /Core 2.5.0. Am I missing something, or does REBOL just decide that, once you reach a certain value, accuracy is a moot point? (In my first example, the first value is pi ** 29 in Windows calculator, while the second is pi ** 29 in REBOL..)