融合跨阶段局部网络与注意力的遥感图像锐化方法

Remote Sensing Image Pansharpening Algorithm Fusing Cross Stage Partial Network and Attention

摘要:

针对遥感图像全色锐化中存在光谱分布不均、空间细节缺失的问题,提出一种融合跨阶段局部网络(CSPNet)与无参数注意力(SimAM)的遥感图像锐化方法。首先,在主干结构中引入CSPNet,利用普通卷积加跳连的方式替代特征提取中的残差块,以缓解梯度冗余,提升模型学习力。其次,添加SimAM块,直接从特征中推导出三维权重,而后反向优化提取到的特征,使得模型能提取到更深层次的特征信息。最后,设计一种可学习作差参数来控制相减权重,以便突出融合图像的边缘信息。实验结果表明,所提方法不仅能改善模型的梯度冗余,还能进一步提升融合图像的空谱分辨率。

Abstract:

A remote sensing image sharpening method is proposed that combines cross stage local network (CSPNet) and parameter free attention (SimAM) to address the issues of uneven spectral distribution and missing spatial details in pansharpening of remote sensing images. Firstly, CSPNet is introduced into the backbone structure to replace the residual blocks in feature extraction with ordinary convolution and skip connections, in order to alleviate gradient redundancy and improve model learning power. Secondly, add SimAM blocks to directly derive 3D weights from the features, and then reverse optimize the extracted features to enable the model to extract deeper level feature information. Finally, design a learnable subtraction parameter to control the subtraction weights, in order to highlight the edge information of the fused image. The experimental results show that the proposed method can not only improve the gradient redundancy of the model, but also further enhance the spatial spectral resolution of the fused image.