融合对抗增强与Proxy注意力的井下低照度煤岩图像识别方法

Dual-stage recognition method for low-light underground coal-rock images integrating adversarial enhancement and Proxy attention

  • 摘要: 针对煤矿井下低照度、高噪声、边界模糊等复杂成像环境导致的煤岩图像识别精度低的问题,提出一种融合对抗增强与代理注意力(Proxy Attention)机制的煤岩图像识别方法。该方法构建了一种双U形网络结构,形成从图像增强到语义分割的完整处理流程。第1个U形结构为Coal−Enhance GAN质量强化模块,采用 U−Net 结构作为生成器,并在其跳跃连接中引入 SRA−SA 门控注意力机制。自正则化注意力(SRA)依据图像亮度分布自适应增强暗部区域并抑制过曝噪声,实现全局亮度均衡;空间注意力(SA)则强化边缘与纹理等局部细节特征。二者通过门控单元实现动态融合,确保增强结果兼具光照一致性与结构保真度。此外,引入可变形卷积与可变形 RoI 池化模块,增强网络对煤岩不规则边界的几何适应能力。判别器采用全局−局部结构与相对判别策略,进一步提升生成图像的真实性与视觉质量。第2个U形结构为Proxy Swin−UNet语义强化模块,以 Swin Transformer 为骨干,解决传统卷积网络在长程依赖建模上的不足。通过在跨层连接中嵌入代理注意力模块,引入代理令牌与空间偏置先验,促进多尺度语义特征的交互与整合。结合深度可分离卷积增强局部特征提取能力,并通过多尺度上下文建模提升模型对不同尺度煤体结构的识别稳定性。在真实井下煤岩数据集上的实验表明:增强模块的NIQE指标达3.121,较CycleGAN、RetinexNet分别提升6.6%、24.4%;分割模块在噪声干扰下(噪声比0.05)的MIoU与MPA分别为84.10%与81.91%,显著优于Swin−UNet等对比模型;消融实验验证各模块有效性,完整模型NIQE进一步降至2.874。单独使用分割模块在无噪声条件下的MIoU为85.34%,MPA为83.12%,显著低于增强后分割性能,证明了图像增强对提升识别精度的关键作用。该方法为井下智能开采系统提供了视觉感知方案,具有重要工程应用价值。

     

    Abstract: To address the low recognition accuracy of coal and rock images in underground mining environments with low illumination, high noise, and blurred boundaries, a coal and rock image recognition method integrating adversarial enhancement and Proxy Attention mechanisms is proposed. This method employs a dual U−shaped structure, forming a complete pipeline from image enhancement to semantic segmentation. The first U−shaped structure is the Coal−Enhance GAN quality enhancement module, which introduces the SRA−SA gated attention mechanism to achieve self-regularized brightness balance and spatial texture enhancement. It combines deformable convolutions and deformable RoI pooling modules to adaptively capture irregular edge structures, while a global-local discriminator with a relative discriminative strategy is used to improve the authenticity of the generated images, effectively clarifying the coal and rock images. The second U−shaped structure is the Proxy Swin−UNet semantic enhancement module, which focuses on extracting and representing high-order semantic features of the coal and rock regions from the enhanced images. The Proxy Attention module is embedded, promoting multi-scale feature interaction through proxy token bias and depthwise separable convolutions, thereby enabling precise segmentation of complex structures. Experiments on real underground coal and rock datasets show that: The enhancement module achieves an NIQE score of 3.121, improving by 6.6% and 24.4% compared to CycleGAN and RetinexNet, respectively; The segmentation module achieves an MIoU of 84.10% and an MPA of 81.91% under noise interference (noise ratio 0.05), significantly outperforming comparative models such as Swin−UNet; Ablation experiments validate the effectiveness of each module, with the complete model reducing the NIQE further to 2.874. Using the segmentation module alone under noise-free conditions, the MIoU is 85.34% and the MPA is 83.12%, which is significantly lower than the post-enhancement segmentation performance, demonstrating the crucial role of image enhancement in improving recognition accuracy. This method provides a visual perception solution for intelligent underground mining systems and holds significant engineering application value.

     

/

返回文章
返回