高级检索

基于点线特征的煤矿井下机器人视觉SLAM算法

Visual SLAM algorithm for underground robots in coal mines based on point-line features

  • 摘要: 煤矿井下视觉同步定位与地图构建SLAM(Simultaneous Localization and Mapping)应用中,光照变化与低纹理场景严重影响特征点的提取和匹配结果,导致位姿估计失败,影响定位精度。提出一种基于改进定向快速旋转二值描述符ORB (Oriented Fast and Rotated Brief)-SLAM3算法的煤矿井下移动机器人双目视觉定位算法SL-SLAM。针对光照变化场景,在前端使用光照稳定性的SuperPoint特征点提取网络替换原始ORB特征点提取算法,并提出一种特征点网格限定法,有效剔除无效特征点区域,增加位姿估计稳定性。针对低纹理场景,在前端引入稳定的线段检测器LSD (Line Segment Detector) 线特征提取算法,并提出一种点线联合算法,按照特征点网格对线特征进行分组,根据特征点的匹配结果进行线特征匹配,降低线特征匹配复杂度,节约位姿估计时间。构建了点特征和线特征的重投影误差模型,在线特征残差模型中添加角度约束,通过点特征和线特征的位姿增量雅可比矩阵建立点线特征重投影误差统一成本函数。局部建图线程使用ORB-SLAM3经典的局部优化方法调整点、线特征和关键帧位姿,并在后端线程中进行回环修正、子图融合和全局捆绑调整BA (Bundle Adjustment)。在EuRoC数据集上的试验结果表明,SL-SLAM的绝对位姿误差APE (Absolute Pose Error)指标优于其他对比算法,并取得了与真值最接近的轨迹预测结果:均方根误差相较于ORB-SLAM3降低了17.3%。在煤矿井下模拟场景中的试验结果表明,SL-SLAM能适应光照变化和低纹理场景,可以满足煤矿井下移动机器人的定位精度和稳定性要求。

     

    Abstract: In the application of visual SLAM(Simultaneous Localization and Mapping) in coal mines, lighting changes and low-texture scenes seriously affect the extraction and matching of feature points, resulting in the failure of pose estimation and affecting the positioning accuracy. Therefore, a binocular vision localization algorithm SL-SLAM for underground mobile robots in coal mines based on the improved ORB (Oriented Fast and Rotated Brief)-SLAM3 algorithm is proposed. For the lighting change scenario, the original ORB feature point extraction algorithm is replaced by the SuperPoint feature point extraction network with lighting stability at the front end, and a feature point grid limitation method is proposed to effectively eliminate the invalid feature point area and increase the stability of pose estimation. For the low-texture scene, a stable LSD(Line Segment Detector) line feature extraction algorithm is introduced at the front end, and a point-line joint algorithm is proposed, which groups the line features according to the feature point grid, and matches the line features according to the matching results of the feature points, so as to reduce the matching complexity of the line features and save the pose estimation time. The reprojection error model of point features and line features is constructed, the angle constraints are added to the line feature residual model, the Jacobian matrix of the pose increment of point features and line features is derived, the unified cost function of the reprojection error of point features and line features is established, the local mapping thread uses the ORB-SLAM3 classic local optimization method to adjust the pose of points, line features and keyframes, and performs loop correction, subgraph fusion and global BA(Bundle Adjustment) in the back-end thread. The experimental results on the EuRoC dataset show that the APE(Absolute Pose Error) index of SL-SLAM is better than other comparison algorithms, and the trajectory prediction results closest to the true value are obtained, and the root mean square error is reduced by 17.3% compared with ORB-SLAM3. The experimental results of simulating the underground scene of coal mine show that SL-SLAM can adapt to the scene of light change and low texture, and can meet the positioning accuracy and stability of the mobile robot in the underground coal mine.

     

/

返回文章
返回