Years: Keywords:

Co-CrackSegment: A New Collaborative Deep Learning Framework for Pixel-Level Semantic Segmentation of Concrete Cracks

  • Nizar Faisal Alkayem, Ali Mayya, Lei Shen, Xin Zhang, Panagiotis G. Asteris, Qiang Wang, Maosen Cao
  • semantic segmentation; crack identification; ensemble learning; deep learning; Co-CrackSegment
  • Hits 66

In an era of massive construction, damaged and aging infrastructure are becoming more common. Defects, such as cracking, spalling, etc., are main types of structural damage that widely occur. Hence, ensuring the safe operation of existing infrastructure through health monitoring has emerged as an important challenge facing engineers. In recent years, intelligent approaches, such as data-driven machines and deep learning crack detection have gradually dominated over traditional methods. Among them, the semantic segmentation using deep learning models is a process of the characterization of accurate locations and portraits of cracks using pixel-level classification. Most available studies rely on single-model knowledge to perform this task. However, it is well-known that the single model might suffer from low variance and low ability to generalize in case of data alteration. By leveraging the ensemble deep learning philosophy, a novel collaborative semantic segmentation of concrete cracks method called Co-CrackSegment is proposed. Firstly, five models, namely the U-net, SegNet, DeepCrack19, DeepLabV3-ResNet50, and DeepLabV3-ResNet101 are trained to serve as core models for the ensemble model Co-CrackSegment. To build the ensemble model Co-CrackSegment, a new iterative approach based on the best evaluation metrics, namely the Dice score, IoU, pixel accuracy, precision, and recall metrics is developed. Results show that the Co-CrackSegment exhibits a prominent performance compared with core models and weighted average ensemble by means of the considered best statistical metrics.

Mathematics 12 03105 g001

Figure 1. The general crack semantic segmentation framework.


Mathematics 12 03105 g002

Figure 2. Sample images of the DeepCrack dataset [63].


Mathematics 12 03105 g007


Figure 3. The DeepLabV3 with backbones architecture.


Mathematics 12 03105 g013

Figure 4. The evaluation metrics of the Co-CrackSegment frameworks for dataset1.


Mathematics 12 03105 g016b

Figure 5. Visual evaluation of the compared models using image samples of dataset 2.


Mathematics 12 03105 g018


Figure 6. The heatmaps of metrics across sample images of dataset2.





DOI:https://doi.org/10.3390/math12193105