Lists

Open Menu Close Menu

Terms and Conditions
Lists hosted on this site
Email the Postmaster
Tips for posting to public mailing lists

float & double scanner question

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

float & double scanner question

Subject: float & double scanner question
From: Mark Dawson <email@hidden>
Date: Fri, 31 Dec 2004 13:18:23 -0800

doing a "[scanner scanDouble:&val] on the string "1.555" sets the "val" to 1.554999999…, "1.55" to 1.55.

scanFloat on "1.55" set its to 1.54999995, "1.555" to 1.5549999995

While I know there are precision issues with floats and doubles, I can't understand why a "1.55" number can't be converted "cleanly". It seems like these numbers should be way within the precision boundaries of a float precision. Am I missing something?

Thanks,

Mark
_______________________________________________
Do not post admin requests to the list. They will be ignored.
Cocoa-dev mailing list      (email@hidden)
Help/Unsubscribe/Update your Subscription:
This email sent to email@hidden


Follow-Ups:

Re: float & double scanner question
From: Clark Cox <email@hidden>


Prev by Date:
Re: multiple declarations for method `length' ?

Next by Date:
Re: float & double scanner question

Previous by thread:
Re: Arrow keyEquivalent in InterfaceBuilder

Next by thread:
Re: float & double scanner question

Index(es):

Date
Thread