(Publisher of Peer Reviewed Open Access Journals)

International Journal of Advanced Technology and Engineering Exploration (IJATEE)

ISSN (Print):2394-5443    ISSN (Online):2394-7454
Volume-11 Issue-111 February-2024
Full-Text PDF
Paper Title : Automated road crack classification using a novel forest optimization algorithm for otsu thresholding and hybrid feature extraction
Author Name : Shivangi Mishra, Sanjeev Kumar Suman and L. B. Roy
Abstract :

Cracks in asphalt pose significant safety risks to roads and highways, necessitating effective and efficient inspection methods. Manual inspection approaches are not only costly but also prone to errors. To address these challenges, this paper introduced an integrated model for automated road crack classification. The methodology comprised four key steps: image segmentation, noise reduction, feature extraction, and crack classification. In the initial stages, the paper presented a novel forest optimization algorithm (FOA) tailored for optimizing the Otsu thresholding method. Leveraging a forest-based optimization approach, this algorithm harnessed the collective decision-making power of multiple trees to identify the optimal threshold value for image segmentation. Subsequently, a hybrid feature extraction approach was proposed, combining histograms of oriented gradients (HOG) and Harris corner detection. HOG captures texture information through the analysis of local gradients, while Harris corner detection identifies distinctive features. The fusion of these techniques enhanced the discriminative power of the extracted features, providing a robust image representation for subsequent classification tasks. To fine-tune the hyperparameters of the k-nearest neighbors (kNN) classifier, the paper incorporated Bayesian optimization. This approach efficiently explored the hyperparameter space, identifying optimal parameter settings that enhance the classification performance of the model. By combining the optimized kNN classifier with the extracted features, the integrated model aimed to achieve accurate image classification for segmented regions. Experimental results indicate the efficacy of the proposed hybrid model, demonstrating the highest accuracy at 98.10%. This outcome signified the model's effectiveness in precisely detecting and classifying cracks in asphalt roads. The achieved accuracy, coupled with the systematic integration of novel algorithms and approaches, validated the potential of the proposed model to significantly improve the efficiency of crack detection processes. The integrated model showcased promise for automating road crack classification, reducing reliance on manual inspection, and providing accurate results crucial for road safety and maintenance.

Keywords : Bayesian optimization, Forest optimization algorithm, Harris corner, Histograms of oriented gradients, kNN.
Cite this article : Mishra S, Suman SK, Roy LB. Automated road crack classification using a novel forest optimization algorithm for otsu thresholding and hybrid feature extraction. International Journal of Advanced Technology and Engineering Exploration. 2024; 11(111):219-242. DOI:10.19101/IJATEE.2023.10102010.
References :
[1]Liang S, Jianchun X, Xun Z. An extraction and classification algorithm for concrete cracks based on machine vision. IEEE Access. 2018; 6:45051-61.
[Crossref] [Google Scholar]
[2]Munawar HS, Hammad AW, Haddad A, Soares CA, Waller ST. Image-based crack detection methods: a review. Infrastructures. 2021; 6(8):1-20.
[Crossref] [Google Scholar]
[3]Cao W, Liu Q, He Z. Review of pavement defect detection methods. IEEE Access. 2020; 8:14531-44.
[Crossref] [Google Scholar]
[4]Sarsam SI. Pavement maintenance management system: a review. Trends in Transport Engineering and Applications. 2016; 3(2):19-30.
[Google Scholar]
[5]Kheradmandi N, Mehranfar V. A critical review and comparative study on image segmentation-based techniques for pavement crack detection. Construction and Building Materials. 2022; 321:126162.
[Crossref] [Google Scholar]
[6]Heitzmann P. A computer vision-assisted approach to automated real-time road infrastructure management. arXiv preprint arXiv:2202.13285. 2022.
[Google Scholar]
[7]Aashto BD. American association of state highway and transportation officials. Washington, DC. 2010; 4.
[Google Scholar]
[8]Peraka NS, Biligiri KP. Pavement asset management systems and technologies: a review. Automation in Construction. 2020; 119:103336.
[Crossref] [Google Scholar]
[9]Yang B, Qin Z, Zhou Q, Li H, Li L, Yang X. Pavement damage behaviour of urban roads in seasonally frozen saline ground regions. Cold Regions Science and Technology. 2020; 174:103035.
[Crossref] [Google Scholar]
[10]Sari Y, Prakoso PB, Baskara AR. Road crack detection using support vector machine (SVM) and OTSU algorithm. In 6th international conference on electric vehicular technology 2019 (pp. 349-54). IEEE.
[Crossref] [Google Scholar]
[11]Chun PJ, Ujike I, Mishima K, Kusumoto M, Okazaki S. Random forest-based evaluation technique for internal damage in reinforced concrete featuring multiple nondestructive testing results. Construction and Building Materials. 2020; 253:119238.
[Google Scholar]
[12]Ghaemi M, Feizi-derakhshi MR. Forest optimization algorithm. Expert Systems with Applications. 2014; 41(15):6676-87.
[Crossref] [Google Scholar]
[13]Yang P, Song W, Zhao X, Zheng R, Qingge L. An improved otsu threshold segmentation algorithm. International Journal of Computational Science and Engineering. 2020; 22(1):146-53.
[Crossref] [Google Scholar]
[14]Sun Z, Caetano E, Pereira S, Moutinho C. Employing histogram of oriented gradient to enhance concrete crack detection performance with classification algorithm and Bayesian optimization. Engineering Failure Analysis. 2023; 150:107351.
[Crossref] [Google Scholar]
[15]Karthikeyan A, Pavithra S, Anu PM. Detection and classification of 2D and 3D hyper spectral image using enhanced Harris corner detector. Scalable Computing: Practice and Experience. 2020; 21(1):93-100.
[Crossref] [Google Scholar]
[16]Lubis A, Iskandar I, Panjaitan ML. Implementation of KNN methods and GLCM extraction for classification of road damage level. IAIC Transactions on Sustainable Digital Innovation. 2022; 4(1):1-7.
[Crossref] [Google Scholar]
[17]Cheng HD, Chen JR, Glazier C, Hu YG. Novel approach to pavement cracking detection based on fuzzy set theory. Journal of Computing in Civil Engineering. 1999; 13(4):270-80.
[Crossref] [Google Scholar]
[18]Chen C, Seo H, Jun CH, Zhao Y. Pavement crack detection and classification based on fusion feature of LBP and PCA with SVM. International Journal of Pavement Engineering. 2022; 23(9):3274-83.
[Crossref] [Google Scholar]
[19]Islam MM, Hossain MB, Akhtar MN, Moni MA, Hasan KF. CNN based on transfer learning models using data augmentation and transformation for detection of concrete crack. Algorithms. 2022; 15(8):1-17.
[Crossref] [Google Scholar]
[20]Hoang ND, Nguyen QL. Computer vision-based recognition of pavement crack patterns using light gradient boosting machine, deep neural network, and convolutional neural network. Journal of Soft Computing in Civil Engineering. 2023; 7(3):21-51.
[Crossref] [Google Scholar]
[21]Li D, Duan Z, Hu X, Zhang D. Pixel-level recognition of pavement distresses based on U-Net. Advances in Materials Science and Engineering. 2021; 2021:1-11.
[Crossref] [Google Scholar]
[22]Fan Z, Lin H, Li C, Su J, Bruno S, Loprencipe G. Use of parallel ResNet for high-performance pavement crack detection and measurement. Sustainability. 2022; 14(3):1-21.
[Crossref] [Google Scholar]
[23]Yu Y, Samali B, Rashidi M, Mohammadi M, Nguyen TN, Zhang G. Vision-based concrete crack detection using a hybrid framework considering noise effect. Journal of Building Engineering. 2022; 61:105246.
[Crossref] [Google Scholar]
[24]Elhariri E, El-bendary N, Taie SA. Using hybrid filter-wrapper feature selection with multi-objective improved-salp optimization for crack severity recognition. IEEE Access. 2020; 8:84290-315.
[Crossref] [Google Scholar]
[25]Matarneh S, Elghaish F, Al-ghraibah A, Abdellatef E, Edwards DJ. An automatic image processing based on hough transform algorithm for pavement crack detection and classification. Smart and Sustainable Built Environment. 2023.
[Crossref] [Google Scholar]
[26]Ashraf A, Sophian A, Shafie AA, Gunawan TS, Ismail NN, Bawono AA. Efficient pavement crack detection and classification using custom YOLOv7 model. Indonesian Journal of Electrical Engineering and Informatics. 2023; 11(1):119-32.
[Google Scholar]
[27]Guo F, Qian Y, Liu J, Yu H. Pavement crack detection based on transformer network. Automation in Construction. 2023; 145:104646.
[Crossref] [Google Scholar]
[28]Tello-cifuentes L, Marulanda J, Thomson P. Detection and classification of pavement damages using wavelet scattering transform, fractal dimension by box-counting method and machine learning algorithms. Road Materials and Pavement Design. 2023:1-9.
[Crossref] [Google Scholar]
[29]Tran TS, Tran VP, Lee HJ, Flores JM, Le VP. A two-step sequential automated crack detection and severity classification process for asphalt pavements. International Journal of Pavement Engineering. 2022; 23(6):2019-33.
[Crossref] [Google Scholar]
[30]Hammouch W, Chouiekh C, Khaissidi G, Mrabti M. Crack detection and classification in moroccan pavement using convolutional neural network. Infrastructures. 2022; 7(11):1-12.
[Crossref] [Google Scholar]
[31]Ahmadi A, Khalesi S, Golroo A. An integrated machine learning model for automatic road crack detection and classification in urban areas. International Journal of Pavement Engineering. 2022; 23(10):3536-52.
[Crossref] [Google Scholar]
[32]Hoang ND, Huynh TC, Tran XL, Tran VD. A novel approach for detection of pavement crack and sealed crack using image processing and salp swarm algorithm optimized machine learning. Advances in Civil Engineering. 2022; 2022:1-21.
[Crossref] [Google Scholar]
[33]Jana S, Thangam S, Kishore A, Sai KV, Vandana S. Transfer learning based deep convolutional neural network model for pavement crack detection from images. International Journal of Nonlinear Analysis and Applications. 2022; 13(1):1209-23.
[Crossref] [Google Scholar]
[34]Liu C, Xu B. A night pavement crack detection method based on image‐to‐image translation. Computer‐Aided Civil and Infrastructure Engineering. 2022; 37(13):1737-53.
[Crossref] [Google Scholar]
[35]Ali R, Chuah JH, Talip MS, Mokhtar N, Shoaib MA. Structural crack detection using deep convolutional neural networks. Automation in Construction. 2022; 133:103989.
[Crossref] [Google Scholar]
[36]Lahmiri S. Integrating convolutional neural networks, KNN, and bayesian optimization for efficient diagnosis of Alzheimers disease in magnetic resonance images. Biomedical Signal Processing and Control. 2023; 80:104375.
[Crossref] [Google Scholar]
[37]https://www.kaggle.com/datasets/lakshaymiddha/crack-segmentation-dataset. Accessed 23January 2024.
[38]Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation. In proceedings of the conference on computer vision and pattern recognition 2015 (pp. 3431-40). IEEE.
[Google Scholar]
[39]Liu W, Huang Y, Li Y, Chen Q. FPCNet: fast pavement crack detection network based on encoder-decoder architecture. arXiv preprint arXiv:1907.02248. 2019.
[Crossref] [Google Scholar]
[40]Chen FC, Jahanshahi MR. NB-CNN: deep learning-based crack detection using convolutional neural network and naïve bayes data fusion. IEEE Transactions on Industrial Electronics. 2017; 65(5):4392-400.
[Crossref] [Google Scholar]
[41]Escalona U, Arce F, Zamora E, Sossa H. Fully convolutional networks for automatic pavement crack segmentation. Computación y Sistemas. 2019; 23(2):451-60.
[Crossref] [Google Scholar]
[42]Cheng J, Xiong W, Chen W, Gu Y, Li Y. Pixel-level crack detection using U-Net. In TENCON region 10 conference 2018 (pp. 462-6). IEEE.
[Crossref] [Google Scholar]
[43]Oliveira H, Correia PL. Automatic road crack detection and characterization. IEEE Transactions on Intelligent Transportation Systems. 2012; 14(1):155-68.
[Crossref] [Google Scholar]
[44]Shi Y, Cui L, Qi Z, Meng F, Chen Z. Automatic road crack detection using random structured forests. IEEE Transactions on Intelligent Transportation Systems. 2016; 17(12):3434-45.
[Crossref] [Google Scholar]
[45]Liu Y, Cheng MM, Hu X, Wang K, Bai X. Richer convolutional features for edge detection. In proceedings of the conference on computer vision and pattern recognition 2017 (pp. 3000-9). IEEE.
[Google Scholar]
[46]Anand S, Gupta S, Darbari V, Kohli S. Crack-pot: autonomous road crack and pothole detection. In digital image computing: techniques and applications 2018 (pp. 1-6). IEEE.
[Crossref] [Google Scholar]