Re: I am experiencing a major math error
Re: I am experiencing a major math error
- Subject: Re: I am experiencing a major math error
- From: Ricky Sharp <email@hidden>
- Date: Mon, 15 Nov 2004 13:43:34 -0600
On Monday, November 15, 2004, at 01:32PM, April Gendill <email@hidden> wrote:
>Ok, I am trying to multiply one number by another an the answer is like
>700,000,000 off.
>
>so I have
>long number1 = 2295104;
>long number2 = 2048;
>long number 3 = number1 * number2;
>
>NSLog gives me: 405405696
>
>well that is totaly wrong. In the calculator the correct answer is:
>4700372992
>
>Why is the math in my program incorrect?
Because you are overflowing your container. A long is only 32-bits. If you need to work with large values, use a 64-bit container (e.g. long long).
--
Rick Sharp
Instant Interactive(tm)
_______________________________________________
Do not post admin requests to the list. They will be ignored.
Cocoa-dev mailing list (email@hidden)
Help/Unsubscribe/Update your Subscription:
This email sent to email@hidden