高级检索

融合多标靶和平面约束的掘进装备机载多相机外参标定

Multi-camera extrinsic calibration for mine heading equipment fusing multi-target and planar constraints

  • 摘要: 多相机融合是实现掘进工作面全面感知的一项关键技术,而多相机的外参标定是多相机融合的前提。但是由于掘进工作面空间受限和装备遮挡,掘进装备机载多相机间的视野往往重叠很小甚至无重叠,这给多相机外参标定带来极大挑战。对此,提出一种融合多标靶和平面约束的掘进装备机载多相机外参标定方法。首先,设计基于多标靶因子图的多相机外参初值获取方法,利用标靶作为桥梁,通过构建多标靶因子图,将移动辅助相机对标靶的观测与标靶间的先验几何关系转化为因子约束,解决掘进装备机载多相机图像因缺少共视特征而无法建立关联关系的问题,实现机载多相机外参初值的有效获取;其次,提出基于多平面约束的多相机外参全局优化方法,通过融合标靶位姿与点云平面的一致性约束,对多相机外参进行全局优化,进一步提高外参标定的精度。最后,进行了大量的仿真实验和煤矿井下真实实验,对不同相机布置方式、平均重叠视野比例及干扰条件下的方法有效性进行验证。实验结果表明所提标定方法的精度在视野重叠不足而缺少共视特征情况下明显优于传统双目标定方法。具体地,所提方法的平移距离误差为0.0229 m、角度误差为4.60°、距离相对误差为0.84%,而传统双目标定方法的平移距离误差为0.6188 m、角度误差为17.07°、距离相对误差为23.01%。

     

    Abstract: Multi-camera fusion is a critical technology for achieving comprehensive perception of coal mine heading faces, and extrinsic calibration of multi-camera systems is a fundamental prerequisite for multi-camera fusion. However, due to the confined space and equipment occlusion in heading faces, the fields of view of multi-cameras mounted on heading equipment often have minimal or even no overlap, which poses significant challenges to multi-camera extrinsic calibration. To address this issue, an extrinsic calibration method fusing multi-target and planar constraints is proposed for on-board multi-cameras of heading equipment. Firstly, an initialization method for multi-camera extrinsic parameters based on a multi-target factor graph is designed. By using calibration targets as a bridge, a multi-target factor graph model is constructed, which converts the observations of the moving auxiliary camera on the targets and the prior geometric relationships between targets into factor constraints. This solves the problem that the on-board multi-cameras of heading equipment cannot establish correspondences due to the lack of common-view features, and achieves the effective acquisition of initial values of on-board multi-camera extrinsic parameters. Secondly, a global optimization method for multi-camera extrinsic parameters based on multi-planar constraints is proposed. By fusing the consistency constraints between target poses and point cloud planes, the multi-camera extrinsic parameters are globally optimized to further improve the accuracy of extrinsic calibration. Finally, abundant simulation experiments and real underground coal mine experiments are conducted to verify the effectiveness of the method under different camera arrangements, overlapping field of view ratios, and interference conditions. The experimental results show that the proposed calibration method significantly outperforms the traditional stereo calibration method in terms of accuracy when the field of view overlap is insufficient and common-view features are lacking. Specifically, the proposed method achieves a translation distance error of 0.0229 m, an angular error of 4.60°, and a relative distance error of 0.84%, while the traditional stereo calibration method yields a translation distance error of 0.6188 m, an angular error of 17.07°, and a relative distance error of 23.01%.

     

/

返回文章
返回