Numerical accuracy. . .

Blitz3D Forums/Blitz3D Programming/Numerical accuracy. . .

The forum is locked. These are the original blitzbasic.com forums, kept so they can still be read. No new topics, replies or edits can be made here. To join in, head over to the Blitz3D+ forums.

Okay, I've been playing around, and it seems that I stand corrected. . .

I think y'all right about floats not being affected by debug - I am only experiencing it with pixel values which could be numerous things to do with the graphics card - I am therefore quitting using the pixels to store numbers, which was probably a dumb idea in the first place :O)

Anyway, thanks Becky - I had not realised until just now that integers are more accurate. . . but I guess that makes sense as you have to store extra info for the float in the same number of bytes (i.e. location of decimal) You have enlightened me! :O)

I guess what I really am after is a double precision type - and it does annoy me that I would have to implement all the math operations etc. . . I expect I'd do a shoddy job too, and make it a really slow implementation. Perhaps your idea of using integers will have to suffice.

Thank you all!!! :O)