This relates to an argument I'm having with some colleagues, but I believe it is actually a math question.
We have a specification for a material that a certain property be $\leq 0.5$. However our gauge reads to a greater precision than the specification say $0.54$. The obvious solution would be to change the specification, but the argument we're having is whether it is more mathematically consistent to round the reading on the gauge to the nearest tenth, which would indicate that the product is within specification, or to regard the specification as $[0.45, 0.55)$.
Is either method more mathematically sound than the other?
If the second option is correct, does that mean that the result of the comparison is indeterminate?