Re: real comparison problems [Re: ASTest redux]
Re: real comparison problems [Re: ASTest redux]
- Subject: Re: real comparison problems [Re: ASTest redux]
- From: bill fancher <email@hidden>
- Date: Sat, 28 Sep 2002 09:14:08 -0700
On Saturday, September 28, 2002, at 07:54 AM, has wrote:
i.e. Why not apply the same rounding processes used to display 0.49
rather
than 0.48999999999 on screen when it performs the [off-screen]
comparison
operation too?
Even if you "round" 0.48999999999 to 0.49. It's still
0.4899999999999999911182158029987476766109466552734375 internally. You
*can't* realize .49 exactly in binary floating point, so you can't
compare to .49. You certainly don't want to start comparing
representations character by character.
--
bill
_______________________________________________
applescript-users mailing list | email@hidden
Help/Unsubscribe/Archives:
http://www.lists.apple.com/mailman/listinfo/applescript-users
Do not post admin requests to the list. They will be ignored.