AnsweredAssumed Answered

vrf Round Off Accuracy Problem

Question asked by mark.goldberg on Oct 8, 2003
OK I take it back, It was more complicated then I imagined. Thanks to all
who replied, they all helped. The application is a 7 Axis positioning system
for antenna measurement and the 26009.6 represents the number of pulses
needed to move 1 degree. With the Real32 rounded to 4 Places it gives a
.0004 error. Which does not seem like much, but when at 355 degrees it
becomes 0.142 degrees of slop.  After doing the math to make sure I was not
going overboard, the error generates a measurement error greater than 3
times the measurement tolerance allowed for the part being measured. I will
play around with the variations and see how close I can really get. Special
thanks to Scott for that "Shawn like" dissertation. Made it very clear for
us dumb RF types that don't speak binary very often and especially when we
don't have to.

Shawn, the "Shawn like" reference is a good thing, and glad you are there to
support all of us!

Mark Goldberg
RF/Antenna Engineer
Millimeter Wave & RF Design
<<...OLE_Obj...>>
ATK Missile Systems Company LLC
21050 Califa Street
Woodland Hills, CA 91367
TEL:  818 887-0844 x 178
FAX:  818 887-2366
Mark.Goldberg@atk.com




---
You are currently subscribed to vrf as: rsb@soco.agilent.com
To subscribe send a blank email to "join-vrf@it.lists.it.agilent.com".
To unsubscribe send a blank email to "leave-vrf@it.lists.it.agilent.com".
To send messages to this mailing list,  email "vrf@it.lists.it.agilent.com". 
If you need help with the mailing list send a message to "owner-vrf@it.lists.it.agilent.com".

Outcomes