Submitted:
27 September 2024
Posted:
29 September 2024
You are already at the latest version
Abstract
Keywords:
1. Introduction
1.1. Three levels of conformity
1.2. Brief discussion of the relation between conformity assessment and acceptance sampling
- in CA as per JCGM 106, testing is performed on the basis of one single item
- in AS as per ISO standards, testing is performed on the basis of a sample of several discrete items taken from the lot. In inspection by variables, it is not the conformity of each item which is determined; rather, one test result is obtained per item, and the proportion nonconforming is estimated on the basis of the distribution of the test results.
- In CA, measurement uncertainty is taken into account in the decision rule2. Thus, in CA, the focus is on the measurand (in the strict metrological sense).
- In AS for inspection by variables as per ISO standards, the rule for lot acceptance or rejection takes into account the lot standard deviation, which describes how the property of interest varies in the lot, rather than variation between test results, which may reflect other effects such as analytical uncertainty, effects due to the sampling procedure, etc. Thus, in AS, the acceptance rule is expressed in terms of the statistical properties of the lot and – if at all possible – measurement uncertainty is ignored.
- Acceptance sampling can be “re-interpreted” in such a way that the entire framework is formulated in terms of a “measurand” – thus achieving a common conceptual framework with conformity assessment. In this re-interpretation, the measurand consists of the relevant summary statistics (e.g. proportion nonconforming, lot mean, lot standard deviation) for the lot.
- In the classical CA framework, conformity often requires the measurement uncertainty to be sufficiently low, e.g. in the case of a decision rule such as . Similarly, in AS, one could formulate requirements regarding sufficiently low specific producer or consumer’s risks.
- For both CA and AS, one can define both parametric versus specific risks, corresponding to precision versus measurement uncertainty.
1.3. Terminology and notation
- For lots consisting of discrete items, acceptance sampling by attributes involves taking a sample of individual items (units) from the lot and assessing the conformity of each item against a specified requirement. If the number of nonconforming items in the sample of items is greater than the acceptance number , the lot is rejected. Thus, a pair constitutes an acceptance sampling plan for lot inspection by attributes.
- The two parties to the trade are the producer and the consumer. The producer is the manufacturer or supplier who sells the lot to the consumer. The producer is mainly interested in whether the lot is accepted, whereas the consumer is mainly interested in whether the lot is conforming.
- PR denotes the producer’s risk.
- CR denotes the consumer’s risk.
- The random variable denotes the “true” quality of the lot or process. In the framework of inspection by attributes, this means that denotes either the number of defects in the lot (in which case it takes on integer values between 0 and the number of items in the lot) or the proportion nonconforming of the lot under inspection or of the underlying process (in which case it takes on values in the real number interval (corresponding to 0% and 100%). In order to avoid an inflation of symbols, we will only consider the latter case. In the discrete case, integration can be reinterpreted via a dominating measure . A realization of is denoted . This random variable corresponds to the measurand in JCGM 106. Where relevant, lot and process proportion nonconforming will be distinguished via the notation and .
- The random variable denotes the test or measurement outcome. In the case of inspection by attributes, is typically the number of nonconforming results obtained after performing tests on a sample of items. thus takes on integer values between 0 and 3. A realization of is denoted .
-
denotes the prior distribution of the proportion nonconforming .Note: the consumer and producer may have different priors, denoted and , respectively.
-
denotes the posterior distribution.Note: just as in the case of the prior, the consumer and producer may have different posteriors, denoted and , respectively.
- denotes the conformance or tolerance region for the “true” proportion nonconforming , expressed as the closed interval , where lies in and denotes a specified maximum value for . For instance, if is specified as 10%, this means that a lot whose true proportion nonconforming is greater than 10% does not comply with the criterion regarding lot quality – no matter whether or not it has been accepted.
- denotes the acceptance region, expressed as the closed interval , where lies in and denotes the acceptance number, a specified maximum value for (the number of items determined to be nonconforming during inspection). For instance, if is specified as 0 and is obtained during the lot inspection, the lot will be rejected – no matter whether or not it actually complies with the criterion regarding lot quality.
- Given a test outcome , denotes the conformance probability, i.e. the probability of lot conformance, calculated on the basis of the posterior distribution:
- For (the lot is accepted), SCR() denotes the specific consumer’s risk, defined as the complement of the conformance probability, evaluated at . Thus, for , the specific consumer’s risk is calculated as .
- CRBayes denotes the threshold for SCR(). For example, if CRBayes is chosen as 5%, this means that only plans with SCR() 5% are admissible.
2. Definition and interpretation of risks



| Conforming Quality level i.e. |
Nonconforming Quality level i.e. |
Prior information (assumption): 20% probability that the lot is nonconforming |
Prior information (assumption): 4% probability that the lot is nonconforming |
|
| Accepted Test outcome i.e. |
Accepted and conforming 95% |
Accepted and non-conforming 25% |
Specific CR: = 6.2% |
Specific CR: = 1.1% |
| Rejected Test outcome i.e. |
Rejected and conforming 5% |
Rejected and non- conforming 75% |
Specific PR: = 21.1% |
Specific PR: = 61.5% |
|
Parametric PR: 5% |
Parametric CR: 25% |
| Conforming | Nonconforming | Total | |
| Accepted | 76 lots | 5 lots | 81 lots |
| Rejected | 4 lots | 15 lots | 19 lots |
| Total | 80 lots | 20 lots | 100 lots |
| Parametric risk | PR = 5% | CR = 25% |
| Accepted | = 0 | |||||
| X | Prior | Likelihood | Prior x Likelihood | Posterior | ||
| Conforming | 5% | 80% | 95% | 76% | 93.8% | |
| Nonconforming | 75% | 20% | 25% | 5% | 6.2% | |
| Sum | 100% | 81% | 100.0% | |||
| Rejected | = 1 | |||||
| X | Prior | Likelihood | Prior x Likelihood | Posterior | ||
| Conforming | 5% | 80% | 5% | 4% | 21.1% | |
| Nonconforming | 75% | 20% | 75% | 15% | 78.9% | |
| Sum | 100% | 19% | 100.0% | |||
| Accepted | = 0 | |||||
| X | Prior | Likelihood | Prior x Likelihood | Posterior | ||
| Conforming | 5% | 96% | 95% | 91% | 98.9% | |
| Nonconforming | 75% | 4% | 25% | 1% | 1.1% | |
| Sum | 100% | 92.2% | 100.0% | |||
| Rejected | = 1 | |||||
| X | Prior | Likelihood | Prior x Likelihood | Posterior | ||
| Conforming | 5% | 96% | 5% | 5% | 61.5% | |
| Nonconforming | 75% | 4% | 75% | 3% | 38.5% | |
| Sum | 100% | 7.8% | 100.0% | |||
3. Designing acceptance sampling plans on the basis of conformance probability
| 1 | 65.1% | 11 | 87.8% |
| 2 | 68.6% | 12 | 89.1% |
| 3 | 71.8% | 13 | 90.2% |
| 4 | 74.6% | 14 | 91.1% |
| 5 | 77.1% | 15 | 92.0% |
| 6 | 79.4% | 16 | 92.8% |
| 7 | 81.5% | 17 | 93.5% |
| 8 | 83.3% | 18 | 94.2% |
| 9 | 85.0% | 19 | 94.8% |
| 10 | 86.5% | 20 | 95.3% |

4. Overview of Bayesian risks
| Risk | Notation | Definition |
|---|---|---|
| Specific PR (evaluated for test outcome ) | SPR() | How likely is it that a lot is conforming, given that it is rejected? |
| Conditional PR (conditioned on the lot quality ) | CPRx | How likely is it that a lot is rejected, given that it is conforming? |
| Conditional PR (conditioned on the test outcome ) | CPRy | How likely is it that a lot is conforming, given that it is rejected? |
| Global PR | GPR | How likely is it that a lot is both conforming and rejected? |
| Global probability of rejection | GPrej | How likely is it that a lot is rejected – no matter whether it is conforming or not? |
| Conditional on | Unconditional | ||
| Conditional on one point | SPR() |
||
| Conditional on a region | CPRx |
CPRy |
|
| Global | GPR |
||
| Global probability of rejection | GPrej |
||
| Risk | Notation | Interpretation |
|---|---|---|
| Specific CR (evaluated for test outcome ) | SCR() | How likely is it that a lot is nonconforming, given that it is accepted? |
| Conditional CR (conditioned on the lot quality ) | CCRx | How likely is it that a lot is accepted, given that it is nonconforming? |
| Conditional CR (conditioned on the test outcome ) | CCRy | How likely is it that a lot is nonconforming, given that it is accepted? |
| Global CR | GCR | How likely is it that a lot is both nonconforming and accepted? |
| Global probability of acceptance | GPacc | How likely is it that a lot is accepted – no matter whether it is conforming or not? |
| Conditional on | Unconditional | ||
| Conditional on one point | SCR() |
||
| Conditional on a region | CCRx |
CCRy |
|
| Global | GCR |
||
| Global probability of acceptance | GPacc |
||
| Risks [%] calculated with | ||||
|---|---|---|---|---|
| producer prior | consumer prior | |||
|
Producer risks |
Specific PR (evaluated for test outcome ) | SPR() | 96.57 | 82.44 |
| Conditional PR (conditioned on the lot quality ) | CPRx | 40.13 | 40.13 | |
| Conditional PR (conditioned on the test outcome ) | CPRy | 91.52 | 64.26 | |
| Global PR | GPR | 38.52 | 32.10 | |
| Global probability of rejection | GPrej | 42.09 | 49.95 | |
|
Consumer risks |
Specific CR (evaluated for test outcome ) | SCR() | 0.74 | 4.29 |
| Conditional CR (conditioned on the lot quality ) | CCRx | 10.74 | 10.74 | |
| Conditional CR (conditioned on the test outcome ) | CCRy | 0.74 | 4.29 | |
| Global CR | GCR | 0.43 | 2.15 | |
| Global probability of acceptance | GPacc | 57.91 | 50.05 | |
| Risk [%] | |||
|---|---|---|---|
|
Producer risks |
Specific PR (evaluated for test outcome ) | SPR() | 56.22 |
| Conditional PR (conditioned on the lot quality ) | CPRx | 11.75 | |
| Conditional PR (conditioned on the test outcome ) | CPRy | 52.99 | |
| Global PR | GPR | 8.81 | |
| Global probability of rejection | GPrej | 16.63 | |
|
Consumer risks |
Specific CR (evaluated for test outcome ) | SCR() | 20.61 |
| Conditional CR (conditioned on the lot quality ) | CCRx | 68.73 | |
| Conditional CR (conditioned on the test outcome ) | CCRy | 20.61 | |
| Global CR | GCR | 17.18 | |
| Global probability of acceptance | GPacc | 83.37 |
5. Taking producer’s risks into account


| Sample size | SPR |
GPR | CPRy | ||
| 20 | 0 | 95.3% | 80.1% | 31.7% | 45.9% |
| 21 | 0 | 95.8% | 81.6% | 32.5% | 46.5% |
| 22 | 0 | 96.2% | 83.0% | 33.3% | 47.0% |
| 23 | 0 | 96.6% | 84.4% | 34.1% | 47.6% |
| 24 | 0 | 96.9% | 85.6% | 34.8% | 48.0% |
| 25 | 0 | 97.2% | 86.7% | 35.5% | 48.3% |
| 26 | 0 | 97.5% | 87.8% | 36.2% | 48.7% |
| 27 | 0 | 97.7% | 88.7% | 36.8% | 49.3% |
| 28 | 0 | 98.0% | 89.6% | 37.4% | 49.6% |
| 29 | 0 | 98.2% | 90.5% | 38.0% | 49.9% |
| 30 | 0 | 98.4% | 91.2% | 38.5% | 50.1% |
| 31 | 0 | 98.5% | 92.0% | 39.1% | 50.3% |
| 32 | 0 | 98.7% | 92.6% | 39.6% | 50.7% |
| 33 | 0 | 98.8% | 93.2% | 40.1% | 51.1% |
| 34 | 0 | 98.9% | 93.8% | 40.5% | 51.3% |
| 35 | 0 | 99.0% | 94.3% | 41.0% | 51.6% |
| 36 | 0 | 99.1% | 94.8% | 41.4% | 51.8% |
| 37 | 1 | 95.2% | 85.2% | 26.5% | 41.2% |
| 38 | 1 | 95.6% | 86.2% | 27.1% | 41.8% |
| 39 | 1 | 96.0% | 87.1% | 27.7% | 42.1% |
| 40 | 1 | 96.3% | 88.0% | 28.3% | 42.5% |
| Sample size | SPR |
GPR | CPRy | ||
| 20 | 0 | 95.3% | 80.1% | 31.7% | 45.8% |
| 37 | 1 | 95.2% | 85.2% | 26.5% | 41.1% |
| 52 | 2 | 95.1% | 87.1% | 23.4% | 38.2% |
| 67 | 3 | 95.3% | 88.8% | 21.6% | 36.0% |
| 80 | 4 | 95.0% | 89.1% | 19.7% | 34.0% |
| 94 | 5 | 95.2% | 90.0% | 18.7% | 32.8% |
| 107 | 6 | 95.2% | 90.4% | 17.6% | 31.5% |
| Sample size | SPR |
GPR | CPRy | ||
| 3 | 0 | 95.3% | 80.1% | 8.1% | 78.6% |
| 20 | 1 | 95.2% | 85.2% | 13.5% | 73.4% |
| 35 | 2 | 95.1% | 87.1% | 12.8% | 70.5% |
| 50 | 3 | 95.3% | 88.8% | 12.3% | 68.3% |
6. A common framework for both parametric and Bayesian risks
| Parametric (no prior required) |
Specific is required) |
|
|---|---|---|
| PR | Probability of rejection given quality level , where is considered acceptable (=PRQ, =AQL) |
Probability of conformity given test outcome , where |
| CR | Probability of acceptance given quality level , where is considered unacceptable (=CRQ, =LQ) |
Probability of nonconformity given test outcome , where |
7. Casting a new light on ISO acceptance sampling plans
| n | ISO AQL (=PRQ) |
PR | ISO LQ (=CRQ) |
|
|---|---|---|---|---|
| 2 | 6.500% | 12.58% | 68.38% | 53.59% |
| 3 | 4.000% | 11.53% | 53.59% | 43.77% |
| 5 | 2.500% | 11.89% | 36.91% | 31.88% |
| 8 | 1.500% | 11.39% | 25.02% | 22.58% |
| 13 | 1.000% | 12.25% | 16.24% | 15.17% |
| 20 | 0.650% | 12.23% | 10.88% | 10.39% |
| 32 | 0.400% | 12.04% | 6.95% | 6.74% |
| 50 | 0.250% | 11.76% | 4.51% | 4.42% |
| 80 | 0.150% | 11.32% | 2.84% | 2.81% |
| 125 | 0.100% | 11.76% | 1.83% | 1.82% |
| 200 | 0.065% | 12.19% | 1.15% | 1.14% |
| 315 | 0.040% | 11.84% | 0.73% | 0.73% |
| 500 | 0.025% | 11.75% | 0.46% | 0.46% |
| 800 | 0.015% | 11.31% | 0.29% | 0.29% |
| 1250 | 0.010% | 11.75% | 0.19% | 0.19% |
- In these c=0 plans, the producer’s risk (PR) is consistently around 11-12%, and thus considerably greater than 5% – the intended value for PR.
- While consistently lies between AQL (PRQ) and LQ (CRQ), as the sample size increases, tends to move further away from AQL and closer to LQ.
- From sample size =13 onwards, lies very close to LQ. From size =80 onwards, the two are indistinguishable. This is undoubtedly an interesting connection between the two concepts and LQ.
| n | ISO AQL (=PRQ) |
PR | ISO LQ (=CRQ) |
|
|---|---|---|---|---|
| 2 | 6.500% | 12.58% | 68.38% | 11.76% |
| 3 | 4.000% | 11.53% | 53.59% | 7.95% |
| 5 | 2.500% | 11.89% | 36.91% | 5.29% |
| 8 | 1.500% | 11.39% | 25.02% | 3.29% |
| 13 | 1.000% | 12.25% | 16.24% | 2.07% |
| 20 | 0.650% | 12.23% | 10.88% | 1.19% |
| Prior | CPRx | CCRx | |||
| 20 | 0 | Beta(1,9) | 10% | 51.7% | 3.8% |
| Beta(1,26) | 40.1% | 6.8% |
8. Conclusions
Annex A: Prior distributions



References
- Schilling E G and Neubauer D V (2008) Acceptance sampling in quality control, Second edition, CRC Press, Taylor & Francis Group, Chapman & Hall.
- MIL-STD-105E (1989) Military standard. Sampling procedure and tables for inspection by variables.
- ASTM E2234-08. Standard practice for sampling a stream of product by attributes indexed by AQL.
- ISO 2859-1:1999 Sampling procedures for inspection by attributes. Part 1: Sampling schemes indexed by acceptance quality limit (AQL) for lot-by-lot inspection.
- ANSI/ASQ Z1.4 (2003) Sampling procedures and tables for inspection by attributes (revised in 2018).
- MIL-STD-414 (1957), Military standard. Sampling procedure and tables for inspection by variables for percent defective.
- ISO 3951-1:2022 Sampling procedures for inspection by variables. Part 1: Specification for single sampling plans indexed by acceptance quality limit (AQL) for lot-by-lot inspection for a single quality characteristic and a single AQL.
- ANSI/ASQ Z1.9 (2003) Sampling procedures and tables for inspection by variables for percent nonconforming (revised in 2018).
- Dodge H F (1969a) Notes on the evolution of acceptance sampling plans, Part I. Journal of Quality Technology 1(2): 77-88. [CrossRef]
- Dodge H F (1969b) Notes on the evolution of acceptance sampling plans, Part II. Journal of Quality Technology 1(3): 155-162. [CrossRef]
- Hald A (1960) The compound hypergeometric distribution and a system of single sampling inspection plans based on prior distributions and costs. Technometrics 2, 275-339.
- Hald A (1968) Bayesian single sampling attributed plans for continuous prior distributions. Technometrics 10:4, 667-683.
- Hald A (1981) Statistical theory of sampling inspection by attributes. Academic press, Harcourt Brace Jovanovich.
- Pfanzagl (1963) Sampling procedures based on prior distributions and costs, Technometrics 5:1, 47-61. [CrossRef]
- Lindley D V, Singpurwalla N D (1991) Evidence needed to reach agreed action between adversaries. Journal of the American Statistical Association. Vol. 86, No. 416, pp. 933-937. [CrossRef]
- Lindley D V, Singpurwalla N D (1993) Adversarial life testing. J. R. Statist. Soc. Series B. Vol. 55, No. 4, pp. 837-847. [CrossRef]
- Facchinetti S, Osmetti S A, Magagnoli U (2022) Designing acceptance single sampling plans: An optimization-based approach under generalized beta distribution. wileyonlinelibrary.com/journal/asmb. Appl Stochastic Models Bus Ind. 2022;38:830–846. [CrossRef]
- Brush G (1986) A comparison of classical and Bayes producer’s risk. Technometrics, Vol. 28, No. 1.
- Chun Y H & Rinks D B (1998) Three types of producer's and consumer's risks in the single sampling plan, Journal of quality technology, 30:3, 254-268. [CrossRef]
- Göb R (1992) a-Optimal sampling plans for lot-by-lot defects inspection. Metrika, Vol. 39, No. 5, pp. 269-317.
- JCGM 106:2012 Evaluation of measurement data – The role of measurement uncertainty in conformity assessment.
- Pennecchi F and Kuselman I (2024) Probabilities of true and false decisions in conformity assessment of a finite sample of items Meas. Sci. Technol. 35 056003. [CrossRef]
| 1 | In ISO standards, the term specification limit is reserved for criteria regarding individual items. |
| 2 | The definition of a “decision rule” (for use in conformity assessment) in ISO 17025 is as follows: Rule that describes how measurement uncertainty is accounted for when stating conformity with a specified requirement. |
| 3 | Note that may be considered a more appropriate test outcome so that the “measurand” and the “measurement” represent the same type of quantity (e.g. a proportion). Mathematically, however, the use of is more convenient (via the binomial distribution). |
| 4 | This terminology is motivated in Section 6. |

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).