, ,

Join The Works program to have access to the most current content, and to be able to ask questions and get answers from Revelation staff and the Revelation community

Large Values (OpenInsight 32-bit)

At 04 DEC 2012 06:30:57AM Colin Rule wrote:

I have some values stored in my database to 8 dec places, for Carbon costing.

For example : Factor * Qty = Mass * Rate = Cost

With Factor, Mass and Cost to 8 dec places.

A client has an item with 100 mill Tonnes, to 8 dec places.

When we get/set the INVALUE property it crashes.

This is outside the expected values that OI can handle.

Other factors are very small, so 8 dec places is valid, despite this being to a fraction of a gramme, something I have to live with.

To resolve I am going to implement SRP_MATH, and get/set using the ARRAY property, instead if ICONV/OCONV.

Not an easy solution.

Is there any other solution which can deal with such large values in OI.

Colin


At 04 DEC 2012 08:57AM Carl Pates wrote:

Colin,

The OI 9.3+ has high precision operators such as _addx, _divx and so on. You could use these (or the SRP math functions) with a custom Iconv/Oconv routine and still use INVALUE - as long as you're treating everything as a string rather than as a number (i.e. don't use the normal OI maths operators) then you should be OK.

Carl Pates

Sprezzatura

The Sprezzatura Blog

World leaders in all things RevSoft

View this thread on the Works forum...