YANG Chunyu，SONG Ziru，ZHANG Xin. A stereo matching algorithm for coal mine underground images based on threshold and weight under Census transform[J]. Coal Science and Technology，2024，52（6）：216−225
. DOI: 10.12438/cst.2023-1169| Citation: |
YANG Chunyu，SONG Ziru，ZHANG Xin. A stereo matching algorithm for coal mine underground images based on threshold and weight under Census transform[J]. Coal Science and Technology，2024，52（6）：216−225 . DOI: 10.12438/cst.2023-1169
|
Binocular image stereo matching is a key technology to realize autonomous obstacle avoidance and visual reconnaissance of unmanned auxiliary transport vehicles in coal mines. However, factors such as high dust and unstable lighting conditions in coal mines can lead to Salt-and-pepper noise in the images collected by the visual sensor, resulting in a high stereo matching error rate. Therefore, a Census stereo matching algorithm based on the combination of threshold and weight is proposed to reduce the impact of Salt-and-pepper noise on stereo matching. The main contributions include: ① threshold processing is carried out on the gray values of all pixels in the support window to remove the pixels with maximum and minimum gray values in the support window and solve the impact of outlier on the weighted fusion; ② the four diagonal pixels corresponding to the center point are weighted and fused to replace the center point pixel. Select pixel points along the four diagonal lines intersecting at the center pixel, with step sizes ranging from 1 to 3. According to the corresponding steps, weights of 0.7, 0.2, and 0.1 are assigned. Multiply the valid pixel points among these 12 points by their respective weights, then divide by the sum of the valid weights. This process yields the reference value of the center pixel point after weighted processing, addressing the issue of traditional algorithms' dependency on the center pixel of the Census transform window. Consequently, this approach enhances matching precision. The experimental results show that the average error rate calculated by the proposed algorithm is reduced by 5.64% compared to traditional Census algorithms, and reduced by 1.71% compared to the mean-based Census algorithm. What's more, the average error rate under different noise levels calculated by the proposed algorithm is reduced by 15.93% compared to the traditional Census algorithm, and reduced by 16.62% compared to the mean-based one. In non-occluded areas, the error matching rate of our algorithm is reduced by 17.19% compared to the traditional Census algorithm and 18.11% compared to the mean-based Census algorithm. The proposed Census stereo matching algorithm, which combines threshold and weight, effectively enhances the robustness against noise, reduces the error rate, and improves matching accuracy.
| [1] |
李首滨. 煤炭智能化无人开采的现状与展望[J]. 中国煤炭,2019,45(4):5−12.
LI Shoubin. Present situation and prospect on intelligent unmanned mining at work face[J]. China Coal,2019,45(4):5−12.
|
| [2] |
陈龙,王晓,杨健健,等. 平行矿山:从数字孪生到矿山智能[J]. 自动化学报,2021,47(7):1633−1645.
CHEN Long,WANG Xiao,YANG Jianjian,et al. Parallel mining operating systems:from digital twins to mining intelligence[J]. Acta Automatica Sinica,2021,47(7):1633−1645.
|
| [3] |
周李兵. 煤矿井下无轨胶轮车无人驾驶系统研究[J]. 工矿自动化,2022,48(6):36−48.
ZHOU Libing. Research on unmanned driving system of underground trackless rubber-tyred vehicle in coal mine[J]. Journal of Mine Automation,2022,48(6):36−48.
|
| [4] |
龙霄潇,程新景,朱昊,等. 三维视觉前沿进展[J]. 中国图象图形学报,2021,26(6):1389−1428.
LONG Xiaoxiao,CHENG Xinjing,ZHU Hao,et al. Recent progress in 3D vision[J]. Journal of Image and Graphics,2021,26(6):1389−1428.
|
| [5] |
郑太雄,黄帅,李永福,等. 基于视觉的三维重建关键技术研究综述[J]. 自动化学报,2020,46(4):631−652.
ZHENG Taixiong,HUANG Shuai,LI Yongfu,et al. Key techniques for vision based 3D reconstruction:a review[J]. Acta Automatica Sinica,2020,46(4):631−652.
|
| [6] |
徐磊,宋慧慧,刘青山. 多层次融合注意力网络的双目图像超分辨率重建[J]. 中国图象图形学报,2023,28(4):1079−1090. doi: 10.11834/jig.211119
XU Lei,SONG Huihui,LIU Qingshan. Super-resolution reconstruction of binocular image based on multi-level fusion attention network[J]. Journal of Image and Graphics,2023,28(4):1079−1090. doi: 10.11834/jig.211119
|
| [7] |
连丽容,罗文婷,秦勇,等. 双目机器视觉及RetinaNet模型的路侧行人感知定位[J]. 中国图象图形学报,2021,26(12):2941−2952.
LIAN Lirong,LUO Wenting,QIN Yong,et al. Roadside pedestrian detection and location based on binocular machine vision and RetinaNet[J]. Journal of Image and Graphics,2021,26(12):2941−2952.
|
| [8] |
LI L C,ZHANG S L,YU X,et al. PMSC:PatchMatch-based superpixel cut for accurate stereo matching[J]. IEEE Transactions on Circuits and Systems for Video Technology,2018,28(3):679−692. doi: 10.1109/TCSVT.2016.2628782
|
| [9] |
ZHU S P,XU H,YAN L N. A stereo matching and depth map acquisition algorithm based on deep learning and improved winner takes all-dynamic programming[J]. IEEE Access,2019,7:74625−74639. doi: 10.1109/ACCESS.2019.2921395
|
| [10] |
ZENG K,WANG Y N,WANG W,et al. Deep confidence propagation stereo network[J]. IEEE Transactions on Intelligent Transportation Systems,2023,24(8):8097−8108. doi: 10.1109/TITS.2023.3264705
|
| [11] |
仲伟波,姚旭洋,冯友兵,等. 双目区域视差快速计算及测距算法[J]. 中国图象图形学报,2019,24(9):1537−1545.
ZHONG Weibo,YAO Xuyang,FENG Youbing,et al. Rapid calculation and ranging algorithm based on binocular region parallax[J]. Journal of Image and Graphics,2019,24(9):1537−1545.
|
| [12] |
黄超,赵华治. 根据灰度值信息自适应窗口的半全局匹配[J]. 中国图象图形学报,2019,24(8):1381−1390.
HUANG Chao,ZHAO Huazhi. Semi-global stereo matching with adaptive window based on grayscale value[J]. Journal of Image and Graphics,2019,24(8):1381−1390.
|
| [13] |
VÁZQUEZ-DELGADO H D,PÉREZ-PATRICIO M,AGUILAR-GONZÁLEZ A,et al. Real-time multi-window stereo matching algorithm with fuzzy logic[J]. IET Computer Vision,2021,15(3):208−223. doi: 10.1049/cvi2.12031
|
| [14] |
WAN X,LIU J G,LI S Y,et al. Phase correlation decomposition:the impact of illumination variation for robust subpixel remotely sensed image matching[J]. IEEE Transactions on Geoscience and Remote Sensing,2019,57(9):6710−6725. doi: 10.1109/TGRS.2019.2907933
|
| [15] |
JI S,KIM S W,LIM D,et al. Quaternary census transform based on the human visual system for stereo matching[J]. IEEE Access,1926,8:116501−116514.
|
| [16] |
智宁,毛善君,李梅. 基于照度调整的矿井非均匀照度视频图像增强算法[J]. 煤炭学报,2017,42(8):2190−2197.
ZHI Ning,MAO Shanjun,LI Mei. Enhancement algorithm based on illumination adjustment for non-uniform illuminance video images in coal mine[J]. Journal of China Coal Society,2017,42(8):2190−2197.
|
| [17] |
范伟强,刘毅. 基于自适应小波变换的煤矿降质图像模糊增强算法[J]. 煤炭学报,2020,45(12):4248−4260.
FAN Weiqiang,LIU Yi. Fuzzy enhancement algorithm of coal mine degradation image based on adaptive wavelet transform[J]. Journal of China Coal Society,2020,45(12):4248−4260.
|
| [18] |
邓森,徐进轩,梁鹿鸣,等. 自适应深度残差椒盐噪声滤除算法[J]. 计算机辅助设计与图形学学报,2020,32(8):1248−1257.
DENG Sen,XU Jinxuan,LIANG Luming,et al. Adaptive salt-and-pepper denoising based on deep residual network[J]. Journal of Computer-Aided Design & Computer Graphics,2020,32(8):1248−1257.
|
| [19] |
范海瑞,杨帆,潘旭冉,等. 一种改进Census变换与梯度融合的立体匹配算法[J]. 光学学报,2018,38(2):0215006. doi: 10.3788/AOS201838.0215006
FAN Hairui,YANG Fan,PAN Xuran,et al. Stereo matching algorithm for improved census transform and gradient fusion[J]. Acta Optica Sinica,2018,38(2):0215006. doi: 10.3788/AOS201838.0215006
|
| [20] |
HIRSCHMULLER H,SCHARSTEIN D. Evaluation of stereo matching costs on images with radiometric differences[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2009,31(9):1582−1599. doi: 10.1109/TPAMI.2008.221
|
| [21] |
MEI X,SUN X,ZHOU M C,et al. On building an accurate stereo matching system on graphics hardware[C]//2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops). Barcelona,Spain. IEEE,2011:467−474.
|
| [22] |
祝世平,闫利那,李政. 基于改进Census变换和动态规划的立体匹配算法[J]. 光学学报,2016,36(4):0415001.
ZHU Shiping,YAN Lina,LI Zheng. Stereo matching algorithm based on improved census transform and dynamic programming[J]. Acta Optica Sinica,2016,36(4):0415001.
|
| [23] |
TATAR N,AREFI H,HAHN M. High-resolution satellite stereo matching by object-based semiglobal matching and iterative guided edge-preserving filter[J]. IEEE Geoscience and Remote Sensing Letters,2021,18(10):1841−1845. doi: 10.1109/LGRS.2020.3008268
|
| [24] |
程德强,李海翔,寇旗旗,等. 融合边缘保持与改进代价聚合的立体匹配算法[J]. 中国图象图形学报,2021,26(2):438−451.
CHENG Deqiang,LI Haixiang,KOU Qiqi,et al. Stereo matching algorithm based on edge preservation and improved cost aggregation[J]. Journal of Image and Graphics,2021,26(2):438−451.
|
| [25] |
SU L,LUO L,DONG K S,et al. Binocular stereo matching algorithm based on multi-feature aggregation[C]//2022 International Conference on Algorithms,Data Mining,and Information Technology (ADMIT). Xi’an,China. IEEE,2022:50−55.
|
| [26] |
YAN T,ZHANG F,MAO Y M,et al. Depth estimation from a light field image pair with a generative model[J]. IEEE Access,2019,7:12768−12778. doi: 10.1109/ACCESS.2019.2893354
|
Supported by: Beijing Renhe Information Technology Co., Ltd. 
DownLoad: