高级检索

基于YOLO11与时空图卷积网络的煤矿钻杆操作行为识别与计数方法研究

Research on coal mine drill rod operation behavior recognition and counting method based on YOLOv11 and spatio-temporal graph convolutional network

  • 摘要: 随着浅层煤炭资源的日渐枯竭,煤矿开采深度不断增加,伴随而来的煤层气含量升高显著加剧了瓦斯灾害风险。大量研究表明,井下作业人员的不安全行为是煤矿事故频发的主要诱因之一。现有煤矿行为监管仍依赖人工视频监控,存在智能化水平低、识别准确率差、资源消耗大等问题,难以满足井下作业过程的实时安全管理需求。为解决煤矿井下钻杆更换过程复杂、光照条件差、行为识别困难等问题,构建一套融合目标检测、目标跟踪、姿态估计与行为识别的钻杆作业检测与计数系统。系统采用YOLO11模型实现高精度的目标检测,结合轻量化ByteTrack算法增强跟踪的稳定性,引入YOLO-Pose完成人员骨骼关键点的提取,并融合时空图卷积网络(Spatio-Temporal Graph Convolutional Network, ST-GCN)实现作业动作的分类识别。在自建数据集上,YOLO11模型F1值达到93.64%,在公开数据集上F1值为67.89%和63.10%,均优于YOLO系列对比模型;在目标跟踪任务中,MOTA和IDF1分别达到70.7%和65.8%,相较于DeepSORT表现更优。在卸杆动作识别方面,采用空间区域划分策略后识别准确率达87.5%,较传统方法提升4.17%;通过语义判断实现钻杆自动计数,计数准确率达95%。研究结果表明,该系统在煤矿井下低照度、多遮挡、背景复杂的环境下具备良好的鲁棒性与实时性,可为钻杆作业过程的智能监管提供有效技术支撑。

     

    Abstract: With the gradual depletion of shallow coal resources, coal mining operations are moving to greater depths. This increases the methane content of coal seams and significantly raises the risk of gas-related disasters. Numerous studies have shown that unsafe behaviors of underground workers are one of the major causes of frequent coal mine accidents. However, current behavior supervision in coal mines still relies on manual video monitoring. This approach suffers from low levels of automation, poor recognition accuracy, and high resource consumption, making it difficult to meet the requirements of real-time safety management during underground operations.To address the challenges of complex drill rod replacement, poor lighting conditions, and difficulties in behavior recognition in underground mines, we developed an integrated detection and counting system for drill rod operations. The system combines object detection, object tracking, pose estimation, and action recognition. Specifically, the YOLO11 model is employed to achieve high-precision object detection. A lightweight ByteTrack algorithm is introduced to improve tracking stability. YOLO-Pose is used to extract human skeletal keypoints, which are then analyzed with a Spatio-Temporal Graph Convolutional Network (ST-GCN) for action classification.Experimental results on a self-constructed dataset show that YOLO11 achieves an F1-score of 93.64%. On two public datasets, the F1-scores reach 67.89% and 63.10%, outperforming other YOLO series models. In object tracking tasks, the system achieves a Multiple Object Tracking Accuracy (MOTA) of 70.7% and an IDF1 score of 65.8%, both higher than those obtained with DeepSORT. For rod-unloading action recognition, the adoption of a spatial partitioning strategy increases accuracy to 87.5%, representing an improvement of 4.17% over conventional methods. In addition, semantic-based judgment enables automatic drill rod counting with an accuracy of 95%.These results demonstrate that the proposed system exhibits strong robustness and real-time performance under conditions of low illumination, heavy occlusion, and complex backgrounds in underground coal mines. The system provides effective technical support for intelligent monitoring and safety management of drill rod operations.

     

/

返回文章
返回