基于GCDB-YOLOv8的矿用无人车井下运输巷道工作人员检测方法

Detection method of mining unmanned vehicles underground transportation roadway workers based on GCDB-YOLOv8

  • 摘要: 针对煤矿井下辅助运输巷道中环境复杂,存在低光照、多粉尘等干扰因素,且工作人员检测时存在反射光干扰,导致使用车载摄像头的矿用无人驾驶车辆对巷道内工作人员检测精度低、实时性差,并且现有基于深度学习的目标检测器存在参数量大、模型计算复杂度高的问题,提出了一种基于YOLOv8的矿用无人驾驶车辆井下辅助运输巷道内工作人员检测模型,即GCDB-YOLOv8。首先,在特征提取网络中引入轻量级模块幻影卷积(GhostConv和GhostC2f),以实现网络轻量化设计,降低模型参数量和计算复杂度。其次,设计C2f-EMA模块并使用其替换颈部的C2f模型,增强对低光照、复杂背景中重点区域注意程度,使模型高效利用工作人员的特征信息;同时,设计DicPSA模块并使用其替换主干网络中的空间金字塔池化模块(SPPF),增强模型对关键特征信息的捕获、提取、利用能力;最后,设计改进了加权双向特征金字塔机制(BiFPN)并使用其替换原始的FPN+PAN结构以降低特征信息丢失问题,实现深层特征图目标语义信息和浅层特征图目标位置信息的充分融合和利用,提高检测精度。实验结果表明,在井下运输巷道工作人员检测数据集上,相较于基线模型YOLOv8n,GCDB-YOLOv8模型的检测精度达到80.64%,提高了6.06%;检测速度达到112 f/s,比基线模型更快,满足检测实时性要求;模型参数数量为2.70 M,计算复杂度为7.50 GFLOPs,分别较基线模型减少0.31 M和0.70 GFLOPs。与Faster R-CNN、SSD、YOLOv3-tiny、YOLOv5s、YOLOv7-tiny、YOLOv8s、YOLOv9s、IAT-YOLO、RT-DETR、MLFE-YOLOX、CDD-YOLO、YOLO_GD检测模型比较,GCDB-YOLOv8在检测精度、检测速度、参数数量和计算复杂度方面均优于其他对比模型。在煤矿工人动作数据集上,GCDB-YOLOv8的mAP@0.5和mAP@0.5~0.95分别达到87.69%和64.77%,较基线模型YOLOv8n分别提高3.43%和2.26%。GCDB-YOLOv8模型提高井下运输巷道内工作人员检测精度的同时,兼顾模型轻量化和实时性,便于部署在矿用无人驾驶车辆上,能够满足矿用无人驾驶车辆对巷道中工作人员的检测需求,降低安全隐患。此外,GCDB-YOLOv8对井下运输巷道内工作人员的精确实时检测能够为矿用无人车后续自主避障、路径规划、决策控制等任务提供安全保障,促进无人驾驶技术在智慧煤矿领域的应用。

     

    Abstract: In view of the complex environment, low light, dust and other interference factors in the auxiliary transportation roadway in the coal mine, and the reflected light interference in the detection of workers, the mining unmanned vehicles using vehicle-mounted cameras have low detection accuracy and poor real-time detection of workers in the roadway. In addition, existing target detectors based on deep learning have the problems of large number of parameters and high computational complexity of the model. A detection model of mine unmanned vehicle assisted transportation roadway workers based on YOLOv8, namely GCDB-YOLOv8, was proposed. Firstly, lightweight modules Ghost Convolution (GhostConv and GhostC2f) are introduced into the feature extraction network to achieve lightweight network design and reduce the number of model parameters and computational complexity. Secondly, the C2F-EMA module is designed and used to replace the C2f model of the neck, so as to enhance the attention of key areas in low light and complex background, so that the model can make efficient use of the feature information of the staff. At the same time, the DicPSA module is designed and used to replace the spatial pyramid pooling module (SPPF) in the backbone network to enhance the ability of the model to capture, extract and utilize key feature information. Finally, the weighted bidirectional feature pyramid (BiFPN) mechanism is designed and improved, and the original FPN+PAN structure is replaced by BIFPN to reduce the problem of feature information loss, achieve the full fusion and utilization of deep feature map target semantic information and shallow feature map target location information, and improve the detection accuracy. On the Underground Transportation Roadway Workers Detection Dataset, the experimental results show that compared with YOLOv8n, the detection accuracy of GCDB-YOLOv8 model reaches 80.64%, which is improved by 6.06%. The detection speed reaches 112 f/s, which is faster than the baseline model and meets the requirement of real-time detection. The number of model parameters is 2.70 M, and the computational complexity is 7.50 GFLOPs, which is 0.31 M and 0.70 GFLOPs less than the baseline model, respectively. Compared with Faster R-CNN, SSD, YOLOv3-tiny, YOLOv5s, YOLOv7-tiny, YOLOv8s, YOLOv9s, IAT-YOLO, RT-DETR, MLFE-YOLOX, CDD-YOLO, YOLO_GD detection models, GCDB-YOLOv8 is superior to other comparison models in terms of detection accuracy, detection speed, number of parameters, and computational complexity. On the Miner Action Detection Dataset, the mAP@0.5 and the mAP@0.5~0.95 of GCDB-YOLOv8 reach 87.69% and 64.77%, respectively, which are 3.43% and 2.26% higher than that of the baseline model YOLOv8n. GCDB-YOLOv8 model improves the detection accuracy of underground transportation roadway workers while taking into account the lightweight and real-time performance of the model, which is easy to deploy on mining unmanned vehicles. The model can meet the detection requirements of mining unmanned vehicles for workers in the roadway and reduce safety hazards. In addition, the accurate real-time detection of the workers in the underground transportation roadway by GCDB-YOLOv8 can provide security for the subsequent autonomous obstacle avoidance, path planning, decision control and other tasks of the mining unmanned vehicle, and promote the application of unmanned driving technology in the field of intelligent coal mines.

     

/

返回文章
返回