Re: number formatting
Re: number formatting
- Subject: Re: number formatting
- From: email@hidden
- Date: Fri, 22 Feb 2002 12:29:58 +0000
Hi,
For a complete discussion of floating point precision (using IEEE 754-1985)
see the following:
http://www.math.grin.edu/~stone/courses/fundamentals/IEEE-reals.html
This is not a bug (it is a side-effect of using floating point precision).
I believe that this covers the reason why.
John
dave
<cocoadevlist@davedow To: email@hidden
ling.com> cc:
Sent by: Subject: number formatting
cocoa-dev-admin@lists
.apple.com
02/22/02 02:08 AM
i accidentally omitted the numeric formatter on a field in
IB. when i ran the app, put a one-digit decimal number in the
field (e.g., .4, .7, .2), left the record and came back, my number
was altered. .4 turned into something like .40000027785, .7 turned
into something like .699999875, etc. what is going on here? i can
use a formatter, but it seems wrong that my numbers are being
altered in this way.
any help is appreciated.
thanks.
dave dowling
free at last! how i found peace with God:
http://www.davedowling.com/steps.html
_______________________________________________
cocoa-dev mailing list | email@hidden
Help/Unsubscribe/Archives:
http://www.lists.apple.com/mailman/listinfo/cocoa-dev
Do not post admin requests to the list. They will be ignored.
_______________________________________________
cocoa-dev mailing list | email@hidden
Help/Unsubscribe/Archives:
http://www.lists.apple.com/mailman/listinfo/cocoa-dev
Do not post admin requests to the list. They will be ignored.