基于生成式的井下图像增强数据集构建方法

Construction method for underground image enhancement datasets based on generative methods

  • 摘要: “清晰–模糊”配对图像增强数据集难以获取是限制煤矿井下图像增强算法发展的核心难题,其间接限制了机器视觉技术在煤矿井下智能化发展中的应用和突破。针对当前井下“清晰–模糊”配对图像增强数据集的获取难题,提出了一种基于生成式的井下图像增强数据集构建方法:基于U–net深度神经网络学习井下多耦合因素尘雾图像的退化特征,使用生成网络将尘雾退化特征高质量地拟合至井下清晰图像数据,通过循环一致性损失函数确保生成尘雾图像与清晰图像的语义一致性;构建了用于井下尘雾图像增强算法的“清晰–模糊”配对图像增强数据集SDUcoal;提出了基于“对比度、频谱能量分布、NIQE、信息熵”的多维度指标评价方法,对生成图像数据集的真实性进行系统量化分析;提出了基于“AODnet、Dehazenet、FFAnet、GCAnet”图像增强算法的可行性测试方法,对生成图像数据集的应用可行性进行验证分析。实验结果表明,该方法生成的尘雾图像数据与井下真实的尘雾图像数据在多维度指标评价中:对比度相似度达到82.04%,高频能量占比相似度达到82.06%,NIQE相似度高达92.16%,信息熵相似度高达99.09%;在可行性测试中:SSIM分别达到0.83630.62100.84060.8401,PSNR分别达到20.62、15.36、25.29、24.51。实验表明该方法生成的“清晰–模糊”配对图像增强数据集可用于井下尘雾图像增强算法训练。

     

    Abstract: The difficulty in obtaining the “clear-blur” paired image enhancement dataset is the core problem restricting the development of image enhancement algorithms in underground coal mines, which indirectly limits the application and breakthrough of machine vision technology in the intelligent development of underground coal mines. Aiming at the problem of obtaining the current underground “clear-blur” paired image enhancement dataset, a construction method of underground image enhancement dataset based on generative is proposed: Based on the U–net deep neural network to learn the degradation features of dust and fog images caused by multiple coupling factors underground, the generation network is used to fit the high-quality degradation features of dust and fog to the clear underground image data, and the semantic consistency between the generated dust and fog images and the clear images is ensured through the cyclic consistency loss function. The “clear-blur” paired image enhancement dataset SDUcoal for the underground dust and fog image enhancement algorithm was constructed; A multi-dimensional index evaluation method based on “contrast, spectral energy distribution, NIQE, and Information entropy” was proposed to conduct a systematic quantitative analysis of the authenticity of the generated image dataset. A feasibility test method based on the “AODnet, Dehazenet” image enhancement algorithm was designed to verify and analyze the feasibility of the application of the generated image dataset. The experimental results show that in the evaluation based on multi-dimensional indicators, the dust and fog image data generated by this method and the real dust and fog image data underground: the contrast similarity reaches 82.04%, the similarity of high-frequency energy proportion reaches 82.06%, the NIQE similarity is as high as 92.16%, and the color histogram similarity reaches 65.81%. In the feasibility test: the SSIM reached 0.8363, 0.6210, 0.8406 and 0.8401 respectively, and the PSNR reached 20.62, 15.36, 25.29 and 24.51 respectively. Experiments prove that the “clear-blur” paired image enhancement dataset generated by this method can be used for the training of underground dust and fog image enhancement algorithms.

     

/

返回文章
返回