Oconv Math bug (OpenInsight)
At 31 JAN 2000 04:59:57PM David Pociu wrote:
Try the following code:
x=2/60
a=oconv( x , 'MD60')
b=oconv( x * 100 , 'MD62')
The variables will contain:
X: 3.33333333333333E-2
A: 3.333333
B: .033333
Now obviously A should equal B, and the correct result should be .033333 ( the value of B)
When can we get this nasty bug fixed? ( This is using OI 3.72)
Thanks,
Dave
At 02 FEB 2000 09:16AM Revelation Technical Support wrote:
You are quite right, this is a known bug. There is supposed to be a workaround involving scaling and custom conversion. I will talk to our developers and post the work around. We have also determined to increase the priority of a permanent fix.
At 02 FEB 2000 11:32AM David Pociu wrote:
Thank you for your response.
The workaround is quite simple:
If there's an E detected in the number, then multiply the number by 10^n enough so that the E notation goes away. Then convert by reducing using then same 10^n scale. A simple wrapper around oconv can take care of all the above.
It would be nice though to not have to replace all the oconvs in my code with the new wrapper function. Hope this makes it in 3.8 or 3.9.
Thanks
Dave
At 02 FEB 2000 03:33PM Revelation Technical Support wrote:
I talked to our developers and they recognize it is a bug that should be fixed. I am raising the priority status on the original Software Problem Report so that it can be fixed. Sorry about the headaches this has caused.
At 02 FEB 2000 06:40PM [url=http://www.sprezzatura.com]The Sprezzatura Group[/url] wrote:
[notag]We originally reported this about 2 years ago. It is gratifying to see your response that it should be fixed. We look forward to it and thank you.
[<A HREF="http://www.sprezzatura.com" onMouseOver="window.status='Click here to visit our web site?';return(true)">The Sprezzatura Group</A>]
[<I>World Leaders in all things RevSoft</I>]
[<img src="http://www.sprezzatura.com/zz.gif">]
[<script language="javascript">function openNewPage () {window.location.href=(document.TOCNavigator.pageToGoTo.options[document.TOCNavigator.pageToGoTo.selectedIndex].value);document.TOCNavigator.pageToGoTo.selectedIndex="0";}end hiding from non-JS browsers –></script>] [<FORM ACTION "" METHOD=GET NAME="TOCNavigator" <SELECT NAME="pageToGoTo" SIZE=1 onChange="openNewPage()"> <OPTION>Pull down this menu to choose whereabouts on the Sprezz site to go <OPTION VALUE="http://www.sprezzatura.com">Home Page <OPTION VALUE="http://www.sprezzatura.com/whatsnew.htm">What's New <OPTION VALUE="http://www.sprezzatura.com/senl.htm">SENL <OPTION VALUE="http://www.sprezzatura.com/patches.htm">Download S/LIST <OPTION VALUE="mailto:[email protected]">Send mail to support at Sprezzatura <OPTION VALUE="mailto:[email protected]">Send mail to sales at Sprezzatura </SELECT> </FORM>][/notag] </QUOTE> View this thread on the Works forum...