AnsweredAssumed Answered

AW: vrf reals

Question asked by VRFuser on Dec 6, 2001
Hello Hans,

0.7 seem to be an infinite number in binary format. Vee and no other program
can store this number. For that reason you will get a rounding error.

Regards,

Hartmut

-----Ursprngliche Nachricht-----
Von: Hans van Zwet [mailto:jvzwet@office.casema.nl]
Gesendet: Donnerstag, 6. Dezember 2001 10:37
An: vrf@lvld.agilent.com
Cc: Andre van der Velde
Betreff: vrf reals


I am exporting data from VEE 6 to Exel. The problem is dat VEE has a
different (strange) way of handling reals. (e.g. 0.7 becomes
0.699999999996).

Is there a way to overcome this problem; e.g. so to get exact 0.7 in
exel without making use of text-strings?



Thanks,
Hans van Zwet

____________________________________________________________________________

Ing. J.M. van Zwet                TCA (Technological Control and
assessment)
Tel : +31(0)15-8881211            Brassersplein 2
mailto:jvzwet@office.casema.nl    Postbus 345, 2600 AH Delft
____________________________________________________________________________



---------------------------------------------------------------------
This is the "vrf" maillist, managed by Majordomo.  To send messages to
this maillist, just email to "vrf@lvld.agilent.com".  Subscriptions and
unsubscriptions are done through the address "vrf-request@lvld.agilent.com".
If you need details, just send a message containing the text "help"
to "vrf-request@lvld.agilent.com".
---------------------------------------------------------------------
---------------------------------------------------------------------
This is the "vrf" maillist, managed by Majordomo.  To send messages to
this maillist, just email to "vrf@lvld.agilent.com".  Subscriptions and
unsubscriptions are done through the address "vrf-request@lvld.agilent.com".
If you need details, just send a message containing the text "help"
to "vrf-request@lvld.agilent.com".
---------------------------------------------------------------------

Outcomes