基于双目立体匹配的露天矿爆堆炮孔三维精确定位方法

Accurate three-dimensional positioning of blast holes in open-pit mine muck piles based on binocular stereo matching

  • 摘要: 露天矿爆堆验孔机器人在保障爆破作业的安全性与推动矿山智能化发展方面具有重要作用。传统人工验孔方式存在效率低、精度不足以及作业风险高等问题,已经难以满足当前露天矿大规模高效开采的需求。针对上述问题,提出了一种基于双目视觉的炮孔三维定位方法,旨在为验孔机器人提供高精度、实时性和鲁棒性的技术支持。在方法设计方面,首先针对训练过程中深度标签稀疏和噪声严重的难点,提出了基于引导图的加权拉普拉斯方程填充策略,通过对无效深度区域的全局一致性补全,有效提升了训练数据的完整性与可靠性,为后续模型优化提供了高质量输入。其次,采用了目标检测网络以实现炮孔区域的快速检测与识别,从而保证了后续立体匹配过程的效率与准确性。在立体匹配阶段,将通道注意力机制ECANet引入到迭代几何编码体IGEV−Stereo双目立体匹配网络中,显著增强了特征提取能力。同时结合Canny边缘掩码设计了边缘感知损失函数,有效约束了边界区域的特征匹配,在不增加推理计算开销的前提下降低了立体匹配的边界误差。最后结合相机标定参数,完成了炮孔在空间中的三维精确定位。实验结果表明,该方法在自建炮孔数据集上,目标检测算法的精度可达93.9%,改进后的立体匹配算法的平均端点误差(EPE)较基准模型降低了20.36%;目标检测单帧推理时延为1.8 ms,立体匹配单帧推理时延为77.44 ms,端到端总时延为79.24 ms,能够满足实际应用的实时性要求。在真实露天矿场景的测试验证中,炮孔三维深度信息误差可达25 mm,充分体现了该方法在复杂爆堆环境下的高精度与强鲁棒性。研究成果为露天矿验孔机器人提供了新的研究思路和有效技术支撑,对提升矿山爆破作业的智能化和安全性具有重要的工程应用价值。

     

    Abstract: Blast hole inspection robots in open-pit mining play a vital role in ensuring the safety of blasting operations and advancing intelligent mining. Traditional manual inspection methods suffer from low efficiency, limited accuracy, and high operational risk, making them inadequate for large-scale and efficient open-pit mining. To address these challenges, a binocular vision-based three-dimensional localization method for blast holes is proposed to provide high accuracy, real-time performance, and robustness for inspection robots. In the method design, a weighted Laplacian equation filling strategy guided by reference images is introduced to overcome the sparsity and severe noise of depth labels during training. This strategy achieves globally consistent completion of invalid depth regions, thereby improving the integrity and reliability of training data. A target detection network is then used to enable rapid detection and identification of blast hole regions, ensuring efficiency and accuracy in the subsequent stereo matching process. During stereo matching, an ECANet channel attention mechanism is incorporated into the iterative geometry encoding volume (IGEV−Stereo) network to enhance feature extraction capability. In addition, an edge-aware loss function based on Canny edge masks is designed to constrain boundary feature matching, effectively reducing matching errors at edges without increasing inference overhead. Finally, precise three-dimensional localization of blast holes is achieved using camera calibration parameters. Experimental results show that, on our self-constructed blast hole dataset, the target detection algorithm achieves an accuracy of 93.9%, and the improved stereo matching algorithm reduces the average end-point error (EPE) by 20.36% compared with the baseline. The single-frame inference latency is 1.8 ms for target detection and 77.44 ms for stereo matching, yielding an end-to-end latency of 79.24 ms, meeting real-time application requirements. In field tests conducted in real open-pit mining scenarios, the 3D depth error of blast holes reached up to 25 mm, highlighting high accuracy and strong robustness under complex blasting conditions. These findings provide new insights and effective technical support for the intelligent development of blast hole inspection robots and offer significant engineering application value for improving the safety and automation of mining operations.

     

/

返回文章
返回