doi: 10.17586/2226-1494-2022-22-3-459-471

Detection of potholes on road surfaces using photogrammetry and remote sensing methods 

S. Abd Mukti, K. Tahar

Read the full article  ';
Article in English

For citation:
Abd Mukti S.N., Tahar K.N. Detection of potholes on road surfaces using photogrammetry and remote sensing methods (review). Scientific and Technical Journal of Information Technologies, Mechanics and Optics, 2022, vol. 22, no. 3, pp. 459–471. doi: 10.17586/2226-1494-2022-22-3-459-471

An overview of methods for obtaining 2D and 3D models of defects on the pavement is given. The integrity of the pavement can be affected by factors such as temperature, humidity, weathering and loads. Potholes are one of the most common types of pavement failure. These defects are the signs of structural failures in an asphalt road. The process of collecting and analyzing data is critical to pavement maintenance. Finding and quantifying pothole geometry information is essential to understand road maintenance forecasts and to determine the right asphalt maintenance strategies. Visual detection of road defects is costly and time consuming. Today, there are quite a lot of studies in the scientific literature showing methods for automatic detection and recognition of potholes. In our work, we consider methods for automatic detection and classification of potholes using tools — sensors integrated with a positioning system. The technique of processing two-dimensional (2D) images using various methods of machine classification allows you to determine the precise geometry of the pothole. Algorithmic methods such as artificial neural networks, decision trees, support vector machines, and fuzzy classification are used to improve the accuracy of image processing and highlight the edges of potholes. A three-dimensional model of the pothole (3D) can be obtained based on laser scanning data and photogrammetry methods. The paper summarizes various methods and proposed techniques for extracting a 3D pothole model. The results of the work can be used to improve the infrastructure for maintaining road surfaces.

Keywords: classification, image, processing, model, pavement defect, pothole

Acknowledgements. The authors thank the Faculty of Architecture, Planning and Surveying of the Universiti Teknologi MARA (UiTM), the Research Management Center (RMC) and the Ministry of Higher Education (MOHE) for providing the GPK 600-RMC/GPK 5/3 (223/2020) Foundation grant, as well as FRGS for grant FRGS/1/2021/WAB07/UITM/02/2.

  1. Buza E., Omanovic S., Huseinovic A. Pothole detection with image processing and spectral clustering. Proc. of the 2nd International Conference on Information Technology and Computer Networks (ITCN '13), 2013.
  2. Cao W., Liu Q., He Z. Review of pavement defect detection methods. IEEE Access, 2020, vol. 8, pp. 14531–14544.
  3. KimT., RyuS.-K. Reviewandanalysisofpotholedetectionmethods. Journal of Emerging Trendsin Computing and Information Sciences,2014, vol. 5, no. 8, pp. 603–608.
  4. Sarie F., Bisri M., Wicaksono A., Effendi R. Types of road pavement damage for road on peatland, a study case in Palangka Raya, Central Kalimantan, Indonesia. Journal of Environmental Science, Toxicology and Food Technology, 2015, vol. 9, no. 12, pp. 53–59.
  5. WangH.-W., ChenC.-H.,ChengD.-Y.,LinC.-H.,LoC.-C. A real-time pothole detection approach for intelligent transportation system.Mathematical Problems in Engineering,2015,vol. 2015,pp. 869627.
  6. Mednis A., Strazdins G., Zviedris R., Kanonirs G.,Selavo L.Real time pothole detection using Android smartphones with accelerometers.Proc. of the 7thInternational Conference on Distributed Computing in Sensor Systems and Workshops (DCOSS),2011,pp. 86376.
  7. Gunawan F.E. Detecting road damages by using gyroscope sensor. ICIC Express Letters, 2018, vol. 12, no. 11, pp. 1089–1098.
  8. Jamakhandi H.A., Srinivasa K.G. Internet of Things based real time mapping of road irregularities. Proc. of International Conference on Circuits, Communication, Control and Computing(I4C),2014, pp. 448–451
  9. Lei T., Mohamed A.A., Claudel C. An IMU-based traffic and road condition monitoring system. HardwareX, 2018, vol. 4, pp. e00045.
  10. Strazdins G., Mednis A., Kanonirs G., Zviedris R., Selavo L. Towards vehicular sensor networks with android smartphones for road surface monitoring. The Second International Workshop on Networks of Cooperating Objects (CONET’11), Electronic Proceedings of CPSWeek'11, 2011, pp. 1-4.
  11. Rau J.Y., Hsiao K.W., Jhan J.P., Wang S.H., Fang W.C., Wang J.L. Bridge crack detection using multi-rotary UAV and object-base image analysis. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, 2017, vol. 42, no. 2W6, pp. 311–318.
  12. Eriksson J., Girod L., Hull B., Newton R., Madden S., Balakrishnan H. The Pothole Patrol: Using a mobile sensor network for road surface monitoring. MobiSys’08 – Proc. of the 6th International Conference on Mobile Systems, Applications, and Services, 2008, pp. 29–39.
  13. Chambon S., Moliard J.M. Automatic road pavement assessment with image processing: Review and comparison. International Journal of Geophysics,2011, vol. 2011, pp. 989354.
  14. Pan Y., Zhang X., Cervone G., Yang L. Detection of asphalt pavement potholes and cracks based on the unmanned aerial vehicle multispectral imagery. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2018, vol. 11, no. 10, pp. 3701–3712.
  15. Li M., Zang S., Zhang B., Li S., Wu C. A review of remote sensing image classification techniques: The role of Spatio-contextual information. European Journal of Remote Sensing, 2014, vol. 47, no. 1, pp. 389–411.
  16. Qingju T., Jingmin D.A., Chunsheng L.I.U., Yuanlin L.I.U., Chunping R.Study on defects edge detection in infrared thermal image based on ant colony algorithm. International Journal of Signal Processing, Image Processing and Pattern Recognition, 2016, vol. 9, no. 4,pp. 121–130.
  17. Luo Z.M.,Wen J. The image segmentation algorithm of region growing and Wavelet Transform Modulus Maximum. Proc. of the 5th International Conference on Instrumentation and Measurement, Computer, Communication, and Control (IMCCC),2015, pp. 1171–1174.
  18. Sultani W., Mokhtari S., Yun H. Automatic pavement object detection using superpixel segmentation combined with conditional random field. IEEE Transactions on Intelligent Transportation Systems, 2018, vol. 19, no. 7,pp. 2076–2085.
  19. Koch C., Jog G.M., Brilakis I. Automated pothole distress assessment using asphalt pavement video data. Journal of Computing in Civil Engineering, 2013, vol. 27, no. 4, pp. 370–378.
  20. Koch C., Brilakis I. Pothole detection in asphalt pavement images. Advanced Engineering Informatics, 2011, vol. 25, no. 3, pp. 507–515.
  21. Huang W., Zhang N. A novel road crack detection and identification method using digital image processing techniques. Proc. of the 7th International Conference on Computing and Convergence Technology (ICCCT), 2012, pp. 397–400.
  22. Gao M., Wang X., Zhu S., Guan P. Detection and segmentation of cement concrete pavement pothole based on image processing technology. Mathematical Problems in Engineering, 2020, pp. 1360832.
  23. Paul A., Yang C., Breitkopf U., Liu Y., Wang Z., Rottensteiner F., Wallner M., Verworn A., Heipke C. Automatic classification of aerial imagery for urban hydrological applications. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences – ISPRS Archives, 2018, vol. 42, no. 3, pp. 1355–1362.
  24. Maas A., Alrajhi M., Alobeid A., Heipke C. Automatic classification of high resolution satellite imagery – A case study for urban areas in the Kingdom of Saudi Arabia. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences – ISPRS Archives, 2017, vol. 42, no. 1W1, pp. 11–16.
  25. Jabari S., Fathollahi F., Zhang Y. Application of sensor fusion to improve UAV image classification. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences – ISPRS Archives, 2017, vol. 42, no. 2W6, pp. 153–156.
  26. Jawak S.D., Wankhede S.F., Luis A.J. Comparison of pixel and object-based classification techniques for glacier facies extraction. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences – ISPRS Archives, 2018, vol. 42, no. 5, pp. 543–548.
  27. Verma A.K., Garg P.K., Prasad K.S.H., Dadhwal V.K. Classification of LISS IV imagery using decision tree methods. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences – ISPRS Archives, 2016, vol. 41, pp. 1061–1066.
  28. Saini R., Ghosh S.K. Crop classification on single date sentinel-2 imagery using random forest and suppor vector machine. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences – ISPRS Archives, 2018, vol. 42, no. 5, pp. 683–688.
  29. Shaharum N.S.N., Shafri H.Z.M., Ghani W.A.W.A., Samsatli S., Yusuf B., Al-Habshi M.M.A., Prince H.M. Image classification for mapping oil palm distribution via support vector machine using scikit-learn module. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences – ISPRS Archives, 2018, vol. 42, no. 4/W9, pp. 139–145.
  30. Kamavisdar P., Saluja S., Agrawal S. A survey on image classification approaches and techniques. International Journal of Advanced Research in Computer and Communication Engineering, 2013, vol. 2, no. 1, pp. 1005–1009.
  31. Abdellatif M., Peel H., Cohn A.G., Fuentes R. Hyperspectral imaging for autonomous inspection of road pavement defects. Proc. of the 36th International Symposium on Automation and Robotics in Construction (ISARC), 2019, pp. 384–392.
  32. Jengo C.M., Hughes D., LaVeigne J.D., Curtis I. Pothole detection and road condition assessment using hyperspectral imager. Proc. of the Annual Conference “Geospatial Goes Global: From Your Neighborhood to the Whole Planet”, 2005, pp. 461–473.
  33. Branco L.H.C., Segantine P.C.L. MaNIAC-UAV - A methodology for automatic pavement defects detection using images obtained by Unmanned Aerial Vehicles. Journal of Physics: Conference Series, 2015, vol. 633, no. 1, pp. 012122.
  34. Herold M., Roberts D., Smadi O., Noronh V. Road condition mapping with hyperspectral remote sensing.Available at: 30.12.2021)
  35. Pascucci S., Bassani C., Palombo A., Poscolieri M., Cavalli R. Road asphalt pavements analyzed by airborne thermal remote sensing: Preliminary results of the venice highway. Sensors, 2008, vol. 8, no. 2, pp. 1278–1296.
  36. Shahi K., Shafri H.Z.M., Taherzadeh E., Mansor S., Muniandy R. A novel spectral index to automatically extract road networks from WorldView-2 satellite imagery. Egyptian Journal of Remote Sensing and Space Science, 2015, vol. 18, no. 1, pp. 27–33.
  37. Pan Y., Zhang X., Sun M., Zhao Q. Object-based and supervised detection of potholes and cracks from the pavement images acquired by UAV. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences – ISPRS Archives, 2017, vol. 42, no. 4W4, pp. 209–217.
  38. Resende M.R., Bernucci L.L.B., Quintanilha J.A. Monitoring the condition of roads pavement surfaces: proposal of methodology using hyperspectral images. Journal of Transport Literature, 2014, vol. 8, no. 2, pp. 201–220.
  39. Raziq A., Xu A., Li Y., Zhao X. Extraction of urban road network from multispectral images using multivariate kernel statistic and segmentation method. Geoinformatics & Geostatistics: An Overview, 2017, vol. 5, no. 1.
  40. Caltagirone L., Bellone M., Svensson L., Wahde M. LiDAR–camera fusion for road detection using fully convolutional neural networks. Robotics and Autonomous Systems, 2019, vol. 111, pp. 125–131.
  41. Kumar P., Angelats E. An automated road roughness detection from mobile laser scanning data. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences – ISPRS Archives, 2017, vol. 42, no. 1W1, pp. 91–96.
  42. Walters R.C., Jaselskis E. Using scanning lasers for real-time pavement thickness measurement. Proc. of the 2005 ASCE International Conference on Computing in Civil Engineering, 2005, pp. 375–385.
  43. Yu S.J., Sukumar S.R., Koschan A.F., Page D.L., Abidi M.A. 3D reconstruction of road surfaces using an integrated multi-sensory approach. Optics and Lasers in Engineering, 2007, vol. 45, no. 7, pp. 808–818.
  44. Li Q., Yao M., Yao X., Yu W., Xu B. A real-time 3D scanning system for pavement rutting and pothole detections. Proceedings of SPIE, 2009, vol. 7447, pp. 74470B.
  45. Mathavan S., Kamal K., Rahman M. A review of three-dimensional imaging technologies for pavement distress detection and measurements. IEEE Transactions on Intelligent Transportation Systems, 2015, vol. 16, no. 5, pp. 2353–2362.
  46. Zhang C., Elaksher A. 3D Reconstruction from UAV-acquired Imagery for Road Surface Distress Assessment. Proc. of the 31st Asian Conference on Remote Sensing (ACRS), 2010, pp. 386–391.
  47. Zhang A., Wang K.C.P., Li B., Yang E., Dai X., Peng Y., Fei Y., Liu Y., Li J.Q., Chen C. Automated pixel-level pavement crack detection on 3D asphalt surfaces using a deep-learning network. Computer-Aided Civil and Infrastructure Engineering, 2017, vol. 32, no. 10, pp. 805–819.
  48. Kertesz I., Lovas T., Barsi A. Measurement of road roughness by low-cost photogrammetric system.International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences ISPRS Archives,2007, vol. 36, no. 5/C55, pp. 4.
  49. Hou Z., Wang K.C.P., Gong W. Experimentation of 3D pavement imaging through stereovision. Proc. of the International Conference on Transportation Engineering (ICTE), 2007, pp. 376–381.
  50. El Gendy A., Shalaby A., Saleh M., Flintsch G.W. Stereo-vision applications to reconstruct the 3D texture of pavement surface. International Journal of Pavement Engineering, 2011, vol. 12, no. 3, pp. 263–273.
  51. Yu X., Salari E. Pavement pothole detection and severity measurement using laser imaging.Proc. of the IEEE International Conference on Electro Information Technology, 2011,pp. 5978573.
  52. Jokela M., Kutila M., Le L. Road condition monitoring system based on a stereo camera. Proc. of the IEEE 5th International Conference on Intelligent Computer Communication and Processing (ICCP), 2009, pp. 423–428.
  53. Tan Y., Li Y. UAV photogrammetry-based 3D road distress detection. ISPRS International Journal of Geo-Information, 2019, vol. 8, no. 9, pp. 409.
  54. Ragnoli A., de Blasiis M.R., Di Benedetto A. Pavement distress detection methods: A review. Infrastructures, 2018, vol. 3, no. 4, pp. 58.
  55. Wang X., Al-Shabbani Z., Sturgill R., Kirk A., Dadi G.B. Estimating earthwork volumes through use of unmanned aerial systems. Transportation Research Record, 2017, vol. 2630, pp. 1–8.
  56. Tahar K.N., Ahmad A., Akib W.A.A.W.M., Mohd W.M.N.W. A generic approach for photogrammetric survey using a six-rotor unmanned aerial vehicle.IOP Conference Series: Earth and Environmental Science, 2014,vol. 18, no. 1, pp. 012003
  57. Abd Mukti S.N., Tahar K.N. Low altitude photogrammetry for urban road mapping. Built Environment Journal, 2021, vol. 18, no. 1, pp. 31.
  58. Slimane A.B., Khoudeir M., Brochard J., Do M.T. Characterization of road microtexture by means of image analysis. Wear, 2008, vol. 264, no. 5–6, pp. 464–468.
  59. Jog G.M., Koch C., Golparvar-Fard M., Brilakis I. Pothole properties measurement through visual 2D recognition and 3D reconstruction. Proc. of the ASCE International Conference on Computing in Civil Engineering, 2012, pp. 553–560.
  60. Saad A.M., Tahar K.N. Identification of rut and pothole by using multirotor unmanned aerial vehicle (UAV). Measurement: Journal of the International Measurement Confederation, 2019, vol. 137, pp. 647–654.
  61. Biçici S., Zeybek M. An approach for the automated extraction of road surface distress from a UAV-derived point cloud. Automation in Construction, 2021, vol. 122, pp. 103475.

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License
Copyright 2001-2022 ©
Scientific and Technical Journal
of Information Technologies, Mechanics and Optics.
All rights reserved.