Design and analysis of confirmation experiments

The statistical literature and practitioners have long advocated the use of confirmation experiments as the final stage of a sequence of designed experiments to verify that the optimal operating conditions identified as part of a response surface methodology strategy are attainable and able to achieve the value of the response desired. However, until recently there has been a gap between this recommendation and details about how to perform an analysis to quantitatively assess whether the confirmation runs are adequate. Similarly, there has been little in the way of specific recommendations for the number and nature of the confirmation runs that should be performed. In this article, we propose analysis methods to assess agreement between the mean response from previous experiments and the confirmation experiment, and suggest a strategy for the design of confirmation experiments that more fully explores the region around the optimum.