How many data points
Authored by: Artel, Inc.
| "It is a deplorable misconception, based on ignorance or disregard of elementary statistical facts, that small [numbers of] samples are sufficient to obtain satisfactory estimates of variability." |
John Mandel, The Statistical Analysis of Experimental Data 
(Originally published as Artel Lab Report: Issue 1. Reprinted with permission.)
Human beings are creatures of habit. We often seek stability and continuity and are wary of change. However, inspection, evaluation, and subsequent change are often necessary for growth and improvement, both inside and outside the laboratory. A worthy project for your laboratory to undertake this year may be to evaluate your pipette checking routine.
The issue of confidence
A quantitative answer to the "how many data points" question boils down to the issue of confidence. How certain do you want to be that your pipettes are functioning correctly? Let’s step through a process which can help you evaluate your laboratory’s needs.
How do you use your pipettes in actual service?
Most laboratories have a number of different applications for pipettes, each with its own requirements. For simplicity’s sake, however, a single procedure is often used for all pipettes. If this is the case, then you need a procedure that is adequate for all applications. Choose your most demanding application and design your checking procedure around it. For this application, determine Upper Limits for percent inaccuracy (EU) and percent imprecision (CVU). These are limits that you would expect the pipette to exceed only rarely.
Know your Limits
It is very important that your test for accuracy and precision delivers results well within your Upper Limits. Choose Test Limits (ET and CVT) which you can meet consistently, given a reliable pipette.
Formulas for establishing critical values
Establish critical values using the following formulas:
- Critical Value for Inaccuracy = (EU-ET)/CVT
- Critical Value for Imprecision = CVT/CVU
Establish a Confidence Level for your testing
This is the probability of checking and passing a pipette and putting it back into service with the certainty that the pipette did not pass because of statistical chance. Many laboratories require a Confidence Level of 95%.
What pipette qualities are you testing ... accuracy, accuracy and precision, or precision alone?
The number of data points for inaccuracy testing may be different from that required for imprecision. Use the greater of the two results.
Use the charts
Finally, use the charts to find the number of data points required to assure the confidence level you require.
The charts are based on the same statistical methods which are used and presented in National Committee for Clinical Laboratory Standards (NCCLS) , American Society for Testing and Materials (ASTM), and International Organization for Standardization (ISO) documents on pipette calibration. If you wish to calculate Critical Values other than those shown on the charts, use +t/√n for accuracy critical values, and 1/√F for precision critical values. t is obtained from Student's one tailed distribution, and F from the one tailed F distribution, tables of which are available in any statistics reference Snedecor GW, Cochran WG. "Statistical Methods", Iowa State University Press, 1989.</ref>. For the imprecision calculation, it is assumed that the Upper Limit is based on a test using 30 data points.
What are the regulatory guidelines?
Several regulatory agencies, including ASTM , NCCLS , American Society for Testing and Materials (ASTM)<, and ISO &, specify taking four data points monthly for a "quick check," and ten data points quarterly for a comprehensive check. This recommendation is generalized and does not take into account the needs of individual laboratories.
Suppose that your most demanding applications cannot tolerate inaccuracy greater than 4%(EU) or imprecision greater than 2.5%(CVU). You are reliably able to achieve inaccuracy below 2%(ET) and imprecision below 1.5%(CVT) when testing good pipettes, so these are the limits you impose on all pipettes tested. You require a Confidence Level of 95%.
Calculate the Critical Value for Inaccuracy = (4% - 2%) / 1.5% = 1.33. Determine the number of data points required from Chart 1 by interpolating between the (critical value = 1.0) and (critical value = 1.5) curves at the 95% confidence level. You find that 4 data points are needed to satisfy the accuracy testing requirement. By taking 4 data points and maintaining an inaccuracy of lower than 2%, you establish with a 95% confidence level that the pipette, given a stringent test, would not fall outside the 4% upper limit of inaccuracy.
In a similar way, the Critical Value for Imprecision can be computed (1.5% / 2.5% = 0.60) and the number of data points required read from Chart 2 (9 data points at the 95% confidence level).
Overall, you need to take at least 9 data points to satisfy both the inaccuracy and imprecision requirements of the test.
Questions and Answers
Who should check our pipettes?
Often, the operator has as great an influence on results as does the pipette itself; different pipetting techniques or conditions can lead to errors of more than 5%, even when the pipette is functioning correctly. For many laboratories, this factor alone will put results outside of the desired tolerance. The most reliable way to assure that your laboratory’s results are correct is to have each operator check his or her own pipettes on a regular basis.
If a pipette fails its performance check, but is then retested and passes, can it be put back in service without further concern?
No, not necessarily. While it is possible for an accurate pipette to infrequently fail a performance check, it is likely that this failure points to a faulty pipette, a poor procedure, or operator error. At the very least, the pipette should be retested more stringently, perhaps with more data points.
If a pipette’s delivery is generally good, but some data points seem "out of line," is it OK to discard them in order to be able to pass the pipette?
The fact that some data points are not within an expected tolerance range points to a problem which should not be ignored. The only exceptions should be data points for which a good, solid, objective, defensible reason exists as to why the data point can be discarded. At the very least, the pipette should be retested using more stringent criteria. If it continues to display this behavior, then it needs to be repaired or replaced.
- ↑ 1.0 1.1 Mandel, John. "The Statistical Analysis of Experimental Data," General Publishing Company, 1964.
- ↑ 2.0 2.1 NCCLS I8-P "Determining Performance of Volumetric Equipment". (draft)
- ↑ 3.0 3.1 ASTM E1154 "Standard Specification for Piston or Plunger Operated Volumetric Apparatus"
- ↑ 4.0 4.1 ISO DIS 8655/3 "Piston and/or Plunger Operated Volumetric Apparatus(POVA) Part 3: Methods of Test". (draft)
- ↑ Pentheny, Gail. "Effects of Common Pipetting Technique Errors on Accuracy and Precision", ACL March 1997.
|Click [+] for other articles on||The Market Place for Lab Automation & Screening||The Market Place|