基于深度学习的煤矿钻进机器人送钻位姿测量方法

Pose measurement method for coal mine drilling robot based on deep learning

  • 摘要: 井下钻孔是一种常用的施工方式,需要反复进行钻杆的装卸。为了实现钻杆的智能装卸,送钻位姿的测量尤为重要。然而,煤矿井下的复杂环境中,存在多尘多雾且光照多变的情况,使得传统方法的识别能力难以满足要求。此外,送钻时钻杆并没有安装在钻机上,直接测量不切实际。针对煤矿井下送钻位姿难以测量的问题,提出了一种基于深度学习的送钻位姿测量方法。该方法由基于改进的PointNet++分割模型和基于动力头与夹持器点云配准两部分组成。首先,为应对目前公开的钻机点云数据集规模不足的问题,搭建钻机点云获取平台,使用3D相机在夜间采集钻机点云数据。采集时,光照完全来自LED灯,以模拟井下光照不均的情况。为了模拟多尘多雾的井下环境,在点云数据中增加椒盐噪声,并在建立标签时将噪声单独分类,以达到去噪效果。其次,在PointNet++的基础上集成生成对抗网络以捕捉更复杂和微细的点云特征;同时,采用聚焦损失函数,提高模型对动力头和夹持器的关注度,并使用贝叶斯参数优化算法进行超参数调整。然后,使用点特征直方图(FPFH)和迭代最近点(ICP)算法对被测点云进行配准,以得到被测点云至源点云的转换矩阵;最终,确定送钻位置和方向向量,并以此定义送钻位姿。为了对所提方法的测量精度进行评估,采集6组钻杆安装在钻机上的钻进场景点云,通过Cloud compare软件手动分割,测量钻杆位姿。在自建数据集上的实验结果表明,改进的PointNet++模型在交并比(IoU)和分割精度(Precision)方面分别提升了17.7%和37.8%。其中,对于动力头和夹持器的IoU分别提升了34.9%和60.3%。在送钻位姿测量方面,平均距离误差为6.39 mm,径向距离误差为5.34 mm,平均角度误差为1.6°。因此,所提出的送钻位姿测量方法是可行的,在煤矿钻杆装卸的智能化领域具有潜在的应用价值。

     

    Abstract: Underground drilling is a commonly used construction method that requires repeated loading and unloading of drill pipes. To achieve intelligent loading and unloading of drill pipes, the measurement of the drilling position is particularly important. However, the complex environment in underground coal mines, characterized by dust, fog, and variable lighting conditions, makes traditional recognition methods inadequate. Additionally, since the drill rod is not installed on the drilling rig during delivery, direct measurement is impractical. To address the challenge of measuring the drilling position in underground coal mines, a deep learning-based method is proposed. This method consists of two parts: a segmentation model based on an improved PointNet++ and a point cloud registration process using the drill head and gripper. First, to address the current insufficiency of publicly available drilling rig point cloud datasets, we have established a platform for acquiring point cloud data from drilling rigs. A 3D camera is utilized to capture point cloud data at night, with illumination solely provided by LED lights to simulate the uneven lighting conditions found underground. To simulate the dusty and foggy underground environment, salt-and-pepper noise was added to the point cloud data, and noise was separately classified when creating labels to achieve a denoising effect. Next, a generative adversarial network was integrated into the PointNet++ to capture more complex and detailed point cloud features. A focal loss function was employed to enhance the model's focus on the drill head and gripper, and Bayesian parameter optimization was used for hyperparameter tuning. Then, the measured point cloud is registered using the Fast Point Feature Histogram (FPFH) and Iterative Closest Point (ICP) algorithms to obtain the transformation matrix from the measured point cloud to the source point cloud. Finally, the drilling position and direction vectors were determined, thereby defining the drilling position. To evaluate the measurement accuracy of the proposed method, six sets of point cloud data of the drilling scene with the drill pipe mounted on the rig were collected. The drill pipe’s position and orientation were then measured by manually segmenting the data using Cloud Compare software. Experimental results on the self-built dataset show that the improved PointNet++ model achieved a 17.7% and 37.8% improvement in Intersection over Union (IoU) and Precision, respectively. Specifically, the IoU values for the drill head and gripper increased by 34.9% and 60.3%, respectively. In terms of drilling position measurement, the average distance error was 6.39 mm, the radial distance error was 5.34 mm, and the average angle error was 1.6°. Therefore, the proposed measurement method for drill pipe delivery posture is feasible and has potential application value in the field of intelligent coal mine drill pipe loading and unloading.

     

/

返回文章
返回