Our full technical support staff does not monitor this forum. If you need assistance from a member of our staff, please submit your question from the Ask a Question page.


Log in or register to post/reply in the forum.

Data types and resolution


Clayton Nov 1, 2023 11:17 PM

I have a question regarding data types, their range, resolution, and ultimately accuracy (excuse me if I'm misusing any of these terms). I think only one of the eleven variables in my array might need to be IEEE8, but I'm not sure. If it doesn't need to be IEEE8, I'd prefer to keep the array set to Float/IEEE4 to save the unnecessary storage space, transmission, etc.. The maximum value of the variable in question is 2,139,062,263 and yes, it is an integer. The CR300 manual indicates that the resolution of Float/IEEE4 is "24 bits (about 7 digits)". So my question is (I think), once the value rises to 10 million, will it no longer be accurate (or resolved) to the ones place (and then to the tens place at 100 million, etc.)? Alternatively, and maybe better or worse, will the logger just generate an error code (like 7999 for FP2) over 10 million? 

Thanks for any guidance.

Regards,

Alex

Log in or register to post/reply in the forum.