Skip to content

Fixed decimal accuracy on saved values#1133

Open
gskjold wants to merge 1 commit intomainfrom
fix/num_accuracy
Open

Fixed decimal accuracy on saved values#1133
gskjold wants to merge 1 commit intomainfrom
fix/num_accuracy

Conversation

@gskjold
Copy link
Member

@gskjold gskjold commented Feb 5, 2026

Multiplying float turns out to loose precision before it is casted to integer. Changing to double to achieve more accurate results

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant