Article Article
NDE Characterization Capability Evaluation

The focus of this article is how to properly evaluate the capability of nondestructive evaluation (NDE) techniques for materials characterization. This article addresses the evaluation of characterization error (CE) for the proper-ties under test, such as crack dimensions. The article highlights the unique challenges in evaluating CE with respect to best practices for probability of detection (POD) evaluation, and examples are presented demonstrating the process.


Aldrin, J.C., C. Annis, H.A. Sabbagh, J. Knopp, and E.A. Lindgren, “Assessing the Reliability of Nondestructive Eval-uation Methods for Damage Characterization,” Review of Progress in QNDE, Vol. 33, AIP, 2014, pp. 1784–1791, published online 2015.

Aldrin, J.C., C. Annis, H.A. Sabbagh, and E.A. Lindgren,

“Best Practices for Evaluating the Capability of Nondestruc-tive Evaluation (NDE) and Structural Health Monitoring

(SHM) Techniques for Damage Characterization,” 42nd Annual Review of Progress in Quantitative Nondestructive Evaluation: Incorporating the 6th European-American Workshop on Reliability of NDE, Minneapolis, Minnesota, 26–31 July 2015, AIP Conference Proceedings, 

Vol. 1706, published online 2016.

Aldrin, J.C., J.S. Knopp, E.A. Lindgren, and K.V. Jata, “Model-assisted Probability of Detection (MAPOD) Evaluation for Eddy Current Inspection of Fastener Sites,” Review of Progress in QNDE, AIP, Vol. 28, pp. 1784–1791, 2009.

Annis, C. and L. Gandossi, ENIQ TGR Technical Document: Probability of Detection Curves: Statistical Best Practices, ENIQ Report No. 41, EUR 24429 EN, JRC Scientific and Technical Reports, 2010.

Annis, Charles, John C. Aldrin, and Harold A. Sabbagh,

“What’s Missing in Nondestructive Testing Capability Evaluation?” Materials Evaluation, Vol. 73, No. 1, 2015, pp. 38–42.

ASTM, ASTM E3023-15: Standard Practice for Probability of Detection Analysis for â Versus a Data, ASTM International, West Conshohocken, Pennsylvania, 2015.

ASTM, ASTM E2782-11, Standard Guide for Measurement Systems Analysis (MSA), ASTM International, West Conshohocken, Pennsylvania, 2011. 

Bates, Douglas M. and Donald G. Watts, Nonlinear Regres-sion Analysis and Its Applications, Wiley, Hoboken, New Jersey, 2007.

Bode, M.D., D.M. Ashbaugh, K.L. Boyce, and F.W. Spencer, “Corrosion Structured Experiment,” Review of Progress in QNDE, Vol 21, AIP, 2002, pp. 1779–1786.

Box, G.E.P. and D.R. Cox, “An Analysis of Transformations,” Journal of the Royal Statistical Society, Series B. Vol. 26, No. 2, 1964, pp. 211–252. JSTOR 2984418.

Dominguez, N., V. Feuillard, F. Jenson, and P. Willaume,

“Simulation Assisted POD of a Phased Array Ultrasonic Inspection in Manufacturing,” Review of Progress in QNDE, Vol. 31, AIP, 2012, pp. 1765–1772.

Ducharme, P., S. Rigault, I. Strijdonk, N. Feuilly, O. Diligent, P. Piché, and F. Jacques, “Automated Ultrasonic Phased Array Inspection of Fatigue Sensitive Riser Girth Welds with a Weld Overlay Layer of Corrosive Resistant Alloy (CRA),”, September 2012.

Forsyth, D.S., and B.A. Lepine, “Development and Verifica-tion of NDI for Corrosion Detection and Quantification in Airframe Structures,” Review of Progress in QNDE, Vol. 21, AIP, 2002, pp. 1787–1791.

Hoppe, W.C., “A Parametric Study of Eddy Current Response for Probability of Detection Estimation,” Review of Progress in QNDE, Vol. 29, AIP, 2010, 1895–1902.

Hoppe, W., J. Pierce, and O. Scott, Automated Corrosion Detection Program Final Report for 07 April 1997 – 06 October 2001, United States Air Force Report AFRL-MP-WP-TR-2001-4162, 2002.

Liao, M., D.S. Forsyth, J.P. Komorowski, M. Safizadeh, Z. Liu, and N. Bellinger, “Risk Analysis of Corrosion Maintenance Actions in Aircraft Structures,” ICAF 22, 2003—Fatigue of Aeronautical Structures as an Engineering Challenge, Proceed-ings of the 22nd Symposium of the International Committee on Aeronautical Fatigue, Lucern, Switzerland, 5–9 May 2003.

Lindgren, E.A., J.S. Knopp, J.C. Aldrin, G.J. Steffes, C.F. Buynak, “Aging Aircraft NDE: Capabilities, Challenges, And Opportunities,” Review of Progress in QNDE, Vol. 26, AIP, 2007, pp. 1731–1738.

Lozev, M.G., D. Hodgkinson, R.L. Spencer, and B.B. Grimmett, “Validation of Current Approaches for Pipeline Girth Weld Discontinuity Sizing Accuracy,” Materials Evaluation, Vol. 63, No.5, 2005, pp 505-510.

Moore, David G. and Floyd W. Spencer, “Interlayer Crack Detection Results Using Sliding Probe Eddy Current Proce-dures,” 10th Asia-Pacific Conference on Non-Destructive Testing, Brisbane, Australia, 17–21 September

2001,published online at

Nordtest, “Guidelines for NDE Reliability and Descriptions,” NT TR 394, Approved April 1998.

Oneida, E., E.B. Shell, J.C. Aldrin, H.A. Sabbagh, E.H. Sabbagh, R.K. Murphy, “Characterizing Surface-Breaking Cracks through Eddy Current NDE and Model-Based Inver-sion,” Materials Evaluation, (submitted, 2017).

R Core Team, R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. URL, ver. 3.3.3, 2017.

Shell, E.B., J.C. Aldrin, H.A. Sabbagh, E.H. Sabbagh, R.K. Murphy, S. Mazdiyasni, and E.A. Lindgren, “Demonstration of Model-Based Inversion of Electromagnetic Signals for Crack Characterization,” Review of Progress in QNDE, Vol. 34, AIP, 2015, pp. 484–493.

Spencer, R, E. Todorov, P. White, N. Porter, and M. Lozev,

“Advanced Technologies and Methodology for Automated Ultrasonic Testing Systems Quantification,” DOT DTPH56-07-T-000002, Reports.rdm, EWI Project 50454GTH, 2011. 

Thompson, R. Bruce, “A Unified Approach to the Model-assisted Determination of Probability of Detection,” Materials Evaluation, Vol. 66, No. 6, pp. 667-673, 2008b.

Thompson, R. Bruce, “Back to Basics: The Role of Model Based Inversion,” Materials Evaluation, Vol. 66, No. 7, 2008a, pp. 707–712.

Todorov, E., R. Spencer, and M. Lozev, “Methodologies for Automated Ultrasonic Testing Performance Quantification,” Materials Evaluation, Vol. 72, No. 76, 2014, pp. 812–824.

US Department of Defense, Handbook, Nondestructive Evaluation System Reliability Assessment, MIL-HDBK-1823A, April 7 2009.

Wirgin, Armand, “The Inverse Crime,” arXiv:math–ph/0401050, submitted on 28 January 2004.

Usage Shares
Total Views
202 Page Views
Total Shares
0 Tweets
0 PDF Downloads
0 Facebook Shares
Total Usage