NDT.net - April 2003, Vol. 8 No.4


Christina Müller, Martina Scharmach
(Federal Institute for Materials Research and Testing (BAM), Germany)
(Christina.Mueller@bam.de, Martina.Scharmach@bam.de)
Vera Konchina
(NIIM/PGUPS, St. Petersburg, Russia)
Damir Markucic
(Faculty of Mechanical Engineering & Naval Architecture, University of Zagreb, Croatia
Zeljko Piscenec
(Croation Mine Action Centre)

Paper presented at the 8th ECNDT, Barcelona, June 2002


Introduction: Background and overview of the approaches

Reliability Definition for Mine Detection Systems:

Fig 4: Modular Validation - Application of the Reliability Theory of Systems - Set up Scientific Basis & RULES for the Technical Justification, Fig 5: Combination of the individual Factors within a modular Approach.

Integral approach: ROC – Receiver operating characteristic and its relation to POD

Fig 6: The Principles of ROC (Reciver Operating Characteristic) The Possible Diagnosis Results in NDT. Fig 7: Characteristic of one NDT-System by an ROC curve.

Example 1: Reliability investigation of manual ultrasonic testing

Fig 11: Outline of Experiments. Fig 12: ROC Results: Curves.

Example 2: Results of test trials for metal detectors in ROC diagrams and conclusions for performance demonstration

Fig 13: IPPTC result in a ROC diagram (Total number of actually present mines 20 mines with IPPTC-configuration 8 mines with CMAC-configuration. Fig 14: a) Test Results of realistic trials in an highly mine effected country (Afghanistan 1999/2000) data provided by JRC Ispra b) ASME-Code (Sect. XI, App. VIII) in a ROC-Diagram (increasing number of grading units: 15 Ž 60).

Statistical Methods for evaluating performance (taken from point 7.4 of the CEN BT 126 CWA 07 document)

Example 3:

year of planning surface area of contaminated land area planned for level I survey – area reduction, km2 area planned for level II survey – reduction, km2 area planned for survey and mine clearence using classic methods (manually), km2 area planned for survey and mine clearence using machines and subsequent verification by another method, km2 fencing og mine contaminated and marking of mine suspected areas, km
 total km2 total km2 planned to be achieved     
2000.* 4.5001006020155 400
2001. 4.400 500325253020 500
2002.3.9005003002530 30 500
2004. 2.900500300253030500
2005.2.400500 28030 3040500
2006.1.900500 280303040 200
2009. 60030015025203050
2010.300 3001502520300
total 45002615280275 3253450
Table 1: table X. the plan for overall activities in the process of survey and mine clearence in Croatia for the period of 2000-2010. [The national mine action programme in the Republic of Croatia, brochure published by CroMAC – Croatian Mine Action Center, April 2001.]
*The year 2000 was shown as a starting point with defined area of total mine contamination with mines and UXO covering 4500 km2

Map of the site

On site results (Fig. 21 and table 2)

Summary and outlook



  1. C. Andrew, “Mathematical modelling of electro magnetic fields”, Transactions of Magnetism, vol. 37. No 5, 1998.
  2. G. S. Kino, Acoustic Waves: Devices, Imaging and Analog Signal Processing. Englewood Cliffs, Prentice Hall, 1987 [book]
  3. G. S. Kino, Acoustic Waves: Devices, Imaging and Analog Signal Processing. Englewood Cliffs, Prentice Hall, 1987 [book]
  4. ASNT Topical Conference Paper Summaries Book of the American-European Workshop on Nondestructive Inspection Reliability, September 21-24, 1999, NIST, Boulder, CO, USA, ISBN: 1-57117-041-3
  5. ASME Boiler and Pressure Vessel Code, Section XI “Rules for Inservice Inspection of Nuclear Power Plant Components.“ American Society of Mechanical Engineering. 1992 Edition
  6. Nockemann, C. et al., “Performance Demonstration in NDT by Statistical Methods: ROC and POD for Ultrasonic and Radiographic Testing”, Proceedings, 6th European Conference on Non Destructive Testing, pp. 37-44 (1994)
  7. Non-Destructive Evaluation System Reliability Assessment, MIL-STD-1823 (U.S. Department of Defense)
  8. Mueller, C; Fritz, T; Tillack, G.-R.; Bellon, C; Scharmach, M ,Theory and Application of the Modular Approach to NDT Reliability, Materials Evaluation, 2001, vol. 59, no. 7, pp. 871-874
  9. European methodology for qualification of non-destructive tests, second issue document: ENIQ.SC(96)2 (E970055/pl)
  10. Barlow, R. E., Fussel, J. B., Singpurvalla, N. D., eds. (1975); ‘Reliability and Fault Tree Analysis, SIAM, Philadelphia‘.
  11. Proceedings of the “European-American Workshop Determination of Reliability and Validation Methods on NDE”, Berlin, Germany, June 18-20, 1997, ISBN 3931381-18-8
  12. Zscherpel, U., “Filmdigitization systems for DIR: Standards, Requirements, Archiving and Printing” on http://www.ndt.net/article/v05n05/zscherp/zscherp.htm
  13. Nockemann, C., Heidt, H., and Thomsen, N. 'Reliability in NDT: ROC study of radiographic weld inspections', NDT&E International 24 5 (1991) pp 235-245
  14. Metz, C. E. 'Basic Principles of ROC analysis', Seminars in Nuclear Medicine 8 4 (1978)
  15. Csapo, G., Just, T., Eggers, H., Hein, E., Nimtz, R., 'Flaw Detectability of NDT on Thin Walled Austenitic Pipe Welds', Proceedings of the 6th ECNDT, Nice, October 24-28th, 1994, pp 995
  16. Erve, M., Wesseling, U., Kilian, R., Hardt, R., Brümmer, G., Maier, V., Ilg, U., 'Cracking in Stabilized Austenitic Stainless Steel Piping of German Boiling Water Reactors - Characteristic Features and Root Cause', Proceedings of the 20th MPA-Seminar, 'Safety and Reliability of Plant Technology', October 6-7, 1994, pp 29.1
  17. Tillack, G.-R., Bellon, C., Nockemann, C., 'Modeling within a global conception of Reliability of NDE', Non-Destructive Examination Practice and Results, State of the art and PISCIII Results‘, Proceedings of the Joint CEC OECD IAEA Specialists Meeting held at Petten on 8-10 March 1994, Edited by E. Borloo and P. Lemaitre, EUR 15906 EN NEA/CSNI/R (94) 23, pp 389
  18. Zscherpel, U., Nockemann, C., Heinrich, W. (Siemens AG, KWU Berlin) und Mattis, A.(Siemens AG, KWU Erlangen), ‘Neue Entwicklungen bei der Filmdigitalisierung‘, DGZfP- Berichtsband der Jahrestagung, Aachen 1995, 47 1, S. 369-376 (1995)
  19. W. D. Feist and G. R. Tillack, ‘Ultrasonic Inspection of Pores in Electron Beam Welds Evaluation of Detectability‘, Proceedings of the European-American Workshop Determination of Reliability and Validation Methods on NDE, June 18-20, 1997, BAM, Berlin, Germany, pp 291-298
  20. 3rd European-American Workshop on Reliability of NDE, September,11-13, 2002, Berlin, Germany, Organized by DGZfP, BAM and ASNT, supported by EPERC and several European NDE societies Christina.Mueller@bam.de
  21. IPPCT: International Pilot Project for Technology Co-operation Final Report, Edited by Y.Das(CA), J.T. Dean(EC), D. Lewis(UK), J.H.J. Roosenboom(NL), G. Zahaczewsky(US)

© NDT.net - info@ndt.net |Top|