高级检索

基于数字孪生系统的具身感知电铲机器人

Autonomous excavation method for electric shovel robots based on embodied perception

  • 摘要: 为提高电铲自动化水平,推动露天矿采运模式从“有人电铲+无人矿卡”向“无人电铲+无人矿卡”转型,提出一种基于数字孪生系统的具身感知电铲机器人自主挖掘方法。基于时空一致性与可变形注意力机制构建Transformer模型,输入多视角图像识别周围目标并对环境进行三维重建,结合激光雷达点云补偿图像深度以提高重建精度;基于并行混合神经网络构建提升电机电流、推压电机电流与挖掘阻力的代理模型,实现电铲机器人实时挖掘阻力感知;构建融合建模、具身感知、自主挖掘与学习的数字孪生系统,基于数字孪生系统进行虚拟挖掘训练深度强化学习(DQN)自主挖掘模型,为保证模型的泛用性和可迁移性,提出一种目标驱动的DQN模型;为了补偿虚拟挖掘样本训练的DQN自主挖掘模型在真实应用中的效率损失,提出一种基于力感调控的控制策略,基于实时挖掘阻力感知不断优化控制指令,提高挖掘效率。试验发现,三维视觉重建物体与真实物体的位置、角度误差分别为5.3%与1.1%,预测挖掘阻力的切向力、法向力与真实值均方根误差分别为1.9%与1.2%。在数字孪生系统中,基于DQN模型的自主挖掘相比匀速挖掘能耗降低了约10%,且DQN模型迁移到电铲样机可以根据期望满斗率挖掘相应物料。力感调控方法可以在DQN模型基础上将挖掘性能指标提升约5%,进一步提高挖掘效率。结果表明:具身感知电铲机器人可以有效感知周围环境,在与环境的虚拟交互中不断学习实现自主挖掘,同时可以在挖掘中不断提升自身挖掘性能。

     

    Abstract: To enhance the automation level of electric shovels and promote the transition of open-pit mining from “manned shovel + unmanned haul truck” to “unmanned shovel + unmanned haul truck,” this paper proposes an embodied-perception–driven autonomous excavation method for electric-shovel robots based on a digital twin system. A Transformer model is developed using spatiotemporal consistency and deformable attention mechanisms to recognize surrounding targets from multi-view images and perform 3D environmental reconstruction, while LiDAR point clouds are integrated to compensate for image depth and improve reconstruction accuracy. A parallel hybrid neural network is then constructed to model the relationships among hoist-motor current, crowd-motor current, and excavation resistance, enabling real-time resistance perception during excavation. A digital twin system integrating modeling, embodied perception, autonomous excavation, and continual learning is established, within which a deep reinforcement learning (DQN)-based excavation policy is trained through virtual excavation simulations. To ensure generalization and transferability, a goal-driven DQN model is introduced. Furthermore, to address efficiency degradation when deploying the virtually trained DQN model to real machines, a force-sensing control strategy is proposed. This strategy continuously optimizes control commands based on real-time excavation resistance, thereby improving excavation efficiency. Experiments show that the 3D reconstruction error in object position and orientation is 5.3% and 1.1%, respectively, while the root-mean-square error in predicting tangential and normal excavation forces is 1.9% and 1.2%. In the digital twin environment, the DQN-based autonomous excavation reduces energy consumption by approximately 10% compared with constant-speed excavation, and the trained DQN model can be successfully transferred to a physical electric-shovel prototype to achieve the target bucket-fill rate. The proposed force-sensing control strategy further improves excavation performance by about 5% on top of the DQN model. These results demonstrate that the embodied-perception electric-shovel robot can effectively sense its surroundings, learn through virtual interaction within the digital twin system, achieve autonomous excavation, and continually improve its excavation performance in real scenarios.

     

/

返回文章
返回