Article Article
In-Motion Railroad Tie Deflection Measurement via Ultrasonic Airborne Sonar and Computer Vision Techniques

It is known in the railroad maintenance engineering community that the deflection of railroad ties is an indicator of the quality of the tie–ballast interface, whose deterioration may cause dangerous train derailments. A new technology is proposed to reconstruct the full-field deflection profile of railroad ties in-motion by means of non-contact ultrasonic testing and computer vision techniques. The sensing layout consists of an array of air-coupled capacitive transducers (operated in pulse-echo sonar-based ranging mode) and a high frame-rate camera, rigidly connected to the main frame of a moving train car. The acquisition system is programmed such that the synchronized waveforms and images are collected and saved as train car moves. In the processing stage, a supervised machine learning-based image classification approach is developed to demarcate the tie boundaries. For this purpose, the Speeded-Up Robust Features (SURF) and Bag of Visual Words (BOVW) algorithms are employed to encode images into condensed feature vectors, which are subsequently fed into the Support Vector Machine (SVM) to train a classifier. The relative deflections of the identified ties are eventually computed by tracking the time-of-flight of the reflected waves from the surfaces flagged as tie. An image processing technique is also developed to estimate the spatial resolution of the tracking system, required to reconstruct the full-field deflection profile of the scanned ties. The importance of such a technique is stressed if the test run is performed without any dedicated positioning system. The proposed ‘tie sonar’ system was prototyped and used to reconstruct the deflection profile of the ties scanned during a series of test runs conducted at slow (walking) speed at the Rail Defect Testing Facility (RDTF) of UC San Diego as well as a BNSF yard in San Diego, CA, with a realistic train load. Further developments of this system should include a performance evaluation at higher speeds (e.g., revenue speed).



1. W. W. Hay, Railroad Engineering, 2nd ed. (John Wiley & Sons, New York, NY, USA, 1991).

2. Z. Leng and I. L. Al-Qadi, Transp. Res. Record J. Transp. Res. Board. 2159 (1), 110–117 (2010). DOI: 10.3141/2159-14.

3. H. Yu, Proceedings of ASME Joint Rail Conference, Columbia, SC, USA, JRC2016-5783, 1–9 April. 2016.

4. National Transportation Safety Board, Report No. NTSB/RAB-14/11, 14 October 2014.

5. J. Riley Edwards et al., Measurement. 111, 197–207 (2017). DOI: 10.1016/j.measurement.2017.07.029.

6. M. Sysyn et al., Sensors. 21, 3609 (2021). DOI: 10.3390/s21113609.

7. M. Sysyn et al., Sustainability. 13, 7740 (2021). DOI: 10.3390/su13147740.

8. A. D. Kerr, Fundamentals of Railway Track Engineering, (Omaha, Nebraska, USA: Simmons-Boardman Books, Inc, 2003).

9. G. R. Olhoeft and E. T. Selig, 9th International Conference GPR2002, International Society for Optics and Photonics, 29 April-2 May 2002, Santa Barbara, CA, USA, 48–53 2002.

10. A. Sabato and C. Niezrecki, Measurement. 103, 93–105 (2017). DOI: 10.1016/j.measurement.2017.02.024.

11. Z. Qiu, Y. Lu, and Z. Qiu, Micromachines. 13, 520 (2022). DOI: 10.3390/mi13040520.

12. S. Wang et al., in Advances in Mechanical and Electronic Engineering. Lecture Notes in Electrical Engineering, edited by D. Jin and S. Lin (Springer , Berlin, Heidelberg, 2013). Vol. 178. pp. 109–114.

13. M. O. Khyam et al., IEEE Sens. J. 17 (2), 434–443 (2017). DOI: 10.1109/JSEN.2016.2631244.

14. A. Carullo and M. Parvis, IEEE Sens. J 1, 143–147 (2001).

15. A. Aliyu et al., 2017 IEEE 3rd International Conference on Electro-Technology for National Development (NIGERCON), Owerri, Nigeria, 7-10 November. 2017.

16. S. J. Kim and B. K. Kim, Proceedings of the International Conference on Control, Automation and Systems (ICCAS), Gyeonggi do, South Korea, 27-30 October. 2010.

17. Z. Dou et al., IEEE T. Instrum. Meas. 70, 6505012 (2021). DOI: 10.1109/TIM.2021.3120129.

18. K. Arshak and F. Adepoju, Proceedings of the 9th IEEE International Workshop Advances in Motion Control, Istanbul, Turkey , 494–499, 27-29 March. 2006.

19. G. Csurka et al., ECCV Workshop on Statistical Learning in Computer Vision, Prague, Czech Republic, 1–16. 10-16 May. 2004.

20. Y. Zhang, R. Jin, and Z. H. Zhou, Int. J. Mach. Learn. & Cyber. 1, 43–52 (2010). DOI: 10.1007/s13042-010-0001-0.

21. R. Wang et al., J. Vis. Commun. Image Represent. 40A, 24–33 (2016). DOI: 10.1016/j.jvcir.2016.05.022.

22. H. Bay et al., Comput. Vis. Image Underst. 110 (3), 346–359 (2008). DOI: 10.1016/j.cviu.2007.09.014.

23. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines and Other Kernel-based Learning Methods (Cambridge University Press, Cambridge, 2000).

24. C. Tomasi and T. Kanade, Technical Report CMU-CS-91-132, Carnegie Mellon University, Pittsburgh, PA, USA 1991.


Usage Shares
Total Views
47 Page Views
Total Shares
0 Tweets
0 PDF Downloads
0 Facebook Shares
Total Usage