AnsweredAssumed Answered

vrf is this a bug...

Question asked by fukui.yutaka on Jun 16, 2004
Hi,


I add another information.

Both fomulas 2.^32 and 2^32. run fine and give the correct

answer of 4.295G.


Regards,
FUKUI Yutaka


> Nick Evans wrote:
>
> or am I being stupid.
>
> If I insert a simple formula object with the formula 2^32  and run it,
> the formula box errors with a message saying that "INT32 value is out
> of range error number 403"  However, if I type in the formula
> asreal64(2)^32 the formula runs fine and gives the correct answer of
> 4.29G.
>
> This is really no problem for me but I am just curious why the formula
> box defaults to an INT32 calculation and if this is specified
> behaviour?
>
> Nick
> ---
> You are currently subscribed to vrf as: fukui.yutaka@jp.fujitsu.com
> To subscribe send a blank email to "join-vrf@it.lists.it.agilent.com".
> To unsubscribe send a blank email to
> "leave-vrf@it.lists.it.agilent.com".
> To send messages to this mailing list, email "vrf@agilent.com".
> If you need help with the mailing list send a message to
> "owner-vrf@it.lists.it.agilent.com".
>
> ---
> Outgoing mail is certified Virus Free.
> Checked by AVG anti-virus system (http://www.grisoft.com).
> Version: 6.0.706 / Virus Database: 462 - Release Date: 14/06/2004

--
*****************************************************************
*  $BJ!0f!!K-!J (BFUKUI Yutaka)
* E-Mail: fukui.yutaka@jp.fujitsu.com
*  $BIY;NDL3t<02q<R!!@n:j9)>l (B
*  $B$b$N$E$/$j?d?JKIt!&@8;:5;=Q3+H/E}3gIt!K7WB,@_Hw3+H/It (B
*  $B7WB,@_Hw3+H/It (BHomePage http://www.psl.fujitsu.co.jp/htd2/ksk/
*  $B@n:j;TCf866h>e>.EDCf#4 (B- $B#1 (B- $B#1!!M9JXHV9f!' (B211-8588
* TEL  $B!!30@~ (B 044-754-3657, $B!!Fb@~ (B 711-3-1966,7
* FAX  $B!!30@~ (B 044-754-3509, $B!!Fb@~ (B 711-3-5359
*****************************************************************

---
You are currently subscribed to vrf as: rsb@soco.agilent.com
To subscribe send a blank email to "join-vrf@it.lists.it.agilent.com".
To unsubscribe send a blank email to "leave-vrf@it.lists.it.agilent.com".
To send messages to this mailing list,  email "vrf@agilent.com". 
If you need help with the mailing list send a message to "owner-vrf@it.lists.it.agilent.com".

Outcomes