?
You are getting it! but in integer arithmetic. If
you convert to floating point at that part of the program you will will most
probably get the same result. You need to do division arithmetic before any
scaling and conversion to integers.
?
The fractional result of?1/X(1,1) is obviously
less than 1. It is also less than 1 when you use 3/X(1,1). this?can be only
scaled?before being?converted to a single precision integer. We
suspect you are probably trying to modify the wrong part of the program. But
without sight of the whole code we are working blind.
?
as a trial try...3000/X(1,1) and see what you
get.
?
Alan
G3NYK
?
toggle quoted message
Show quoted text
----- Original Message -----
Sent: Friday, October 09, 2015 8:43
PM
Subject: [hp_agilent_equipment] Re: I
need a SINT value!
So.....?
how do I get the value of??? (1/x(1,1,))*3? that I need?