Search for question
Question

Equipment Precision Comparison

Suppose you are trying to make a difficult measurement. Fortunately there is commercial

equipment available for this purpose, although it is expensive. Your company has a large

budget and wants to obtain the best equipment, but it also does not want to waste money

needlessly. You are responsible for performing some tests to guide their decision.

You have ordered two trial samples of metering equipment to test which one is better:

Equipment A (which costs £60,000) and Equipment B (which costs £30,000). You take 10

measurements using each in a controlled environment.

Equipment A gives the following readings:

128.00, 125.04, 125.17, 128.62, 126.06, 124.54, 128.80, 129.98, 126.49, 127.16

Equipment B gives:

122.16, 127.35, 124.73, 129.51, 123.60, 132.67, 131.07, 126.20, 132.44, 126.91

You may assume that measurement errors are normally distributed.

1. The "correct" value for the measurement is supposed to be 127. Verify that both tools are

properly "calibrated" (i.e., that they provide measurements that on average are consistent

with this value) with an appropriate statistical test.

2. Suppose you did not know that the true value was 127, or there was a possibility that the

true value was not 127. Use a statistical test to evaluate whether the two tools produce

measurements that are, on average, consistent with each other.

3. Company specifications require that the calibration accuracy (the absolute difference

between the average of a very large number of measurements and the "correct" value) of

the tool must be better (less) than 5. Show that both tools meet this requirement to better

than 99% confidence under the assumptions above.

4. The most important consideration in your decision is precision: you want the tool that

produces measurements with the least variance (lowest standard deviation). Can you tell

(using an appropriate statistical test) if one tool is significantly more precise than the other?

If so, which tool? Quote a p-value, and use a confidence interval to quantify how much more

precise one tool is (or isn't) than the other.

5. Tool A is much more expensive, and your company might not want to spend the extra

money if it cannot shown to be clearly superior. Conduct a modified version of the above

hypothesis test with this information in mind, and quote a new p-value.

6. Would you recommend purchasing tool A, tool B, or would you run more tests (at a cost of

£5,000 in overheads plus £500 per test)? If you run more tests, how many more tests would

you run? Explain the basis for your decision in a few sentences or less.