|
|
Multiple Feature Fusion and Visualization of Pavement Distress Images Based on Manifold Learning |
SHI Lu-kui1,2, ZHOU Hao1, LIU Wen-hao1 |
1. School of Computer Science and Engineering, Hebei University of Technology, Tianjin 300401, China;
2. Hebei Provincial Key Laboratory of Big Data Calculation, Tianjin 300401, China |
|
|
Abstract For multi-feature fusion in automatic recognition of pavement distress images, we proposed a multi-feature fusion method based on manifold learning. In this method, the intrinsic features of pavement distress images are extracted through mapping the high dimensional data combing projection, mixture density factor and second order moment invariant into the low dimensional space. The multiple features are fused and the visualization of pavement distress images is implemented. In the experiments, we applied the multi-feature fusion method in the detection of pavement distress images. Two-dimensional features are firstly extracted from the 8 combining features, then the recognition effects on the 2D features of 4 methods including ELM, KNN, SVM and BP network are compared. The experiment result shows that the proposed method effectively improved the detection accuracy of pavement distress images. Simultaneously, the physical meaning of the 2D features is obtained through visualizing, one feature preliminary denotes the complexity and damaged extent of the cracks in images, the other describes the direction of the cracks.
|
Received: 15 May 2016
|
Fund:Supported by the Tianjin Research Project of Application Foundation and Advanced Technology of China (No. 14JCZDJC31600);the Natural Science Foundation of Hebei Province of China (No. F2016202144). |
Corresponding Authors:
SHI Lu-kui,E-mail address:shilukui@scse.hebut.edu.cn
E-mail: shilukui@scse.hebut.edu.cn
|
|
|
|
[1] CHU Xiu-min, WANG Rong-ben, CHU Jiang-wei, et al. Asphalt Pavement Surface Distress Image Recognition Based on Moment Invariant Feature[J]. Journal of Jilin University:Engineering and Technology Edition, 2003,33(1):1-7. (in Chinese)
[2] XIAO Wang-xin, YAN Xin-ping, ZHANG Xue. Research on the Automatic Pavement Distress Recognition Based on Synthetical Distress Density Factor[J]. Journal of Transportation Engineering and Information, 2005, 3(2):19-26. (in Chinese)
[3] YING L, SALARI E. Beamlet Transform-Based Technique for Pavement Crack Detection and Classification[J]. Computer-Aided Civil and Infrastructure Engineering, 2010, 25(8):572-580.
[4] FUJITA Y, HAMAMOTO Y. A Robust Automatic Crack Detection Method from Noisy Concrete Surfaces[J]. Machine Vision and Applications, 2011, 22(2):245-254.
[5] NEJAD F M, ZAKERI H. An Expert System Based on Wavelet Transform and Radon Neural Network for Pavement Distress Classification[J]. Expert Systems with Applications, 2011, 38(6):7088-7101.
[6] YU Yong-bo, LI Wan-heng, ZHANG Jin-quan, et al. Bridge Cracks Extraction Method Based on Image Connection Domain[J]. Journal of Highway and Transportation Research and Development, 2011, 28(7):90-93. (in Chinese)
[7] MA Rong-gui, XU Kun, LIU Fei-fei. Highway Surface Crack Images Identifying Algorithm[J]. Journal of Transport Information and Safety, 2014, 32(2):90-94. (in Chinese)
[8] RONG Jing, PAN Yu-li. Digital Image Based Crack Detection of Grooved Cement Concrete Pavement[J]. Journal of Highway and Transportation Research and Development, 2012,29(3):45-50. (in Chinese)
[9] OLIVEIRA H, CORREIA P L. Automatic Road Crack Detection and Characterization[J]. IEEE Transactions on Intelligent Transportation Systems, 2013, 14(1):155-168.
[10] SHEN Zhao-qing, PENG Yu-hua, SHU Ning. A Road Damage Identification Method Based on Scale-span Image and SVM[J]. Geomatics and Information Science of Wuhan University, 2013, 38(8):993-997. (in Chinese)
[11] SUN Chao-yun, ZHAO Hai-wei, LI Wei, et al. 3D Pavement Crack Identification Method Based on Dual-phase Scanning Detection[J]. China Journal of Highway and Transport, 2015, 28(2):26-32. (in Chinese)
[12] HUANG G B, ZHOU H, DING X, et al. Extreme Learning Machine for Regression and Multiclass Classification[J]. IEEE Transactions on Systems, Man & Cybernetics Part B:Cybernetics, 2012, 42(2):513-529.
[13] ZUO Y X, WANG G Q, ZUO C C. The Segmentation Algorithm for Pavement Cracking Images Based on the Improved Fuzzy Clustering[J]. Applied Mechanics and Materials, 2013, 319:362-366.
[14] RADUCANU B, DORNAIKA F. A Supervised Non-linear Dimensionality Reduction Approach for Manifold Learning[J]. Pattern Recognition, 2012, 45(6):2432-2444.
[15] SUN B Y, ZHANG X M, LI J, et al. Feature Fusion Using Locally Linear Embedding for Classification[J]. IEEE Transactions on Neural Networks, 2010, 21(1):163-168.
[16] HU Jian-zhong, WU Yao, XIE Xiao-xin. A Method for Fault Recognition Based on LLE Feature Fusion[J]. China Mechanical Engineering, 2013, 24(24):3345-3348. (in Chinese)
[17] CRIMINISI A, SHOTTON J, KONUKOGLU E. Decision Forests:A Unified Framework for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised Learning[J]. Foundations and Trends in Computer Graphics and Vision, 2012, 7(2/3):81-227.
[18] TENENBAUM J B, DE SILVA V, LANGFORD J C. A Global Geometric Framework for Nonlinear Dimensionality Reduction[J]. Science, 2000, 290(5500):2319-2323.
[19] ROWEIS S T, SAUL L K. Nonlinear Dimensionality Reduction by Locally Linear Embedding[J]. Science, 2000, 290(5500):2323-2326.
[20] BELKIN M, NIYOGI P. Laplacian Eigenmaps for Dimensionality Reduction and Data Representation[J]. Neural Computation, 2003, 15(6):1373-1396.
[21] ZHANG Z Y, ZHA H Y. Principal Manifolds and Nonlinear Dimensionality Reduction via Local Tangent Space Alignment[J]. Journal of Shanghai University, 2004, 26(4):406-424.
[22] XIAO Wang-xin, ZHANG Xue, HUANG Wei, et al. One New Algorithm of Automatic Classification for Pavement Distress[J]. Journal of Highway and Transportation Research and Development, 2005, 22(11):75-78. (in Chinese)
[23] LIU Guo-hai, JIANG Zhi-jia. Recognition of Porcelain Bottle Crack Based on Modified ART-2 Network and Invariant Moment[J]. Chinese Journal of Scientific Instrument, 2009, 30(7):1420-1425.(in Chinese) |
[1] |
LI Ning, MA Biao, LI Rui, SI Wei. Performance of Unbound Aggregate Materials under Single-stage and Multi-stage Loading Modes Based on Precision Unbounded Material Analyzer[J]. Journal of Highway and Transportation Research and Development, 2019, 13(2): 1-12. |
[2] |
XU Hai-liang, REN He-huan, HE Zhao-cai, HE Lian. Time-domain Analysis of Deformation Characteristics of Asphalt Concrete Pavement Considering Vehicle-pavement Coupled Effect[J]. Journal of Highway and Transportation Research and Development, 2019, 13(2): 13-19. |
[3] |
DU Jian-huan, AI Chang-fa, HUANG Chao, GUO Yu-jin, JIANG Yun-bing. Effect of Interfacial Water on the Fatigue Performance of Composite Asphalt Mixture Beams[J]. Journal of Highway and Transportation Research and Development, 2019, 13(1): 1-7. |
[4] |
YAO Guo-qiang, YAN Zhi-xin, LONG Zhe, ZHAI Ju-yun. Simulation Experimental Study on Shear Stress Distribution of Rock Slope Anchoring Interface[J]. Journal of Highway and Transportation Research and Development, 2019, 13(1): 8-15. |
[5] |
LIU Ze, HE Fan, HUANG Tian-qi, JIANG Mei-dong. Additional Earth Pressure of Retaining Wall Caused by Vehicle Load[J]. Journal of Highway and Transportation Research and Development, 2019, 13(1): 16-23. |
[6] |
QIU Xin, XU Jing-xian, TAO Jue-qiang, YANG Qing. Asphalt Pavement Icing Condition Criterion and SVM-based Prediction Analysis[J]. Journal of Highway and Transportation Research and Development, 2018, 12(4): 1-9. |
|
|
|
|