Hey, quick question. I'm making some calculations using lua that require a fair amount of decimals, at least nine. While testing on onecompiler the return has all decimals, however if I call the function on a string measure I only get up to 5 decimals.
So, for a simple equation like this: (2448724.5 - 2451545.0) / 36525
I get:
Actual result: -0.07722
Expected result: -0.077221081451061
So my question is, is lua using the correct amount of decimals for calculations or is it just using 5 decimals? I know rainmeter can only use up to decimals, however the question in reality is if lua is actually using all the decimals internally for calculations or not. How can I check this?
So, for a simple equation like this: (2448724.5 - 2451545.0) / 36525
I get:
Actual result: -0.07722
Expected result: -0.077221081451061
So my question is, is lua using the correct amount of decimals for calculations or is it just using 5 decimals? I know rainmeter can only use up to decimals, however the question in reality is if lua is actually using all the decimals internally for calculations or not. How can I check this?
Statistics: Posted by RicardoTM — December 2nd, 2024, 6:52 pm — Replies 11 — Views 189