Graph-based deep learning techniques for remote sensing applications: Techniques, taxonomy, and applications — A comprehensive review

Boulila, 2022, Weight initialization techniques for deep learning algorithms in remote sensing: Recent trends and future perspectives, 477 Sun, 2022, Multi-resolution transformer network for building and road segmentation of remote sensing image, ISPRS Int. J. Geo-Inf., 11, 165, 10.3390/ijgi11030165 Boulila, 2010, Spatio-temporal modeling for knowledge discovery in satellite image databases, 35 Jiang, 2022, Intelligent image semantic segmentation: a review through deep learning techniques for remote sensing image analysis, J. Indian Soc. Remote Sens., 1 Ghandorh, 2022, Semantic segmentation and edge detection—Approach to road detection in very high resolution satellite images, Remote Sens., 14, 613, 10.3390/rs14030613 Bai, 2022, Deep learning for change detection in remote sensing: a review, Geo-Spat. Inf. Sci., 1 Shafique, 2022, Deep learning-based change detection in remote sensing images: A review, Remote Sens., 14, 871, 10.3390/rs14040871 de Gélis, 2023, Siamese KPConv: 3D multiple change detection from raw point clouds using deep learning, ISPRS J. Photogramm. Remote Sens., 197, 274, 10.1016/j.isprsjprs.2023.02.001 Boulila, 2017, Sensitivity analysis approach to model epistemic and aleatory imperfection: Application to Land Cover Change prediction model, J. Comput. Sci., 23, 58, 10.1016/j.jocs.2017.10.006 Ferchichi, 2017, Propagating aleatory and epistemic uncertainty in land cover change prediction process, Ecol. Inform., 37, 24, 10.1016/j.ecoinf.2016.11.006 Boulila, 2009, Improving spatiotemporal change detection: A high level fusion approach for discovering uncertain knowledge from satellite image databases, 222 Gopinath, 2023, A comprehensive survey on deep learning based malware detection techniques, Comp. Sci. Rev., 47 Qiu, 2018, Deepinf: Social influence prediction with deep learning, 2110 Fout, 2017, Protein interface prediction using graph convolutional networks, Adv. Neural Inf. Process. Syst., 30 Xu, 2018 Velickovic, 2019, Deep graph infomax, ICLR (Poster), 2, 4 Zuo, 2012, Network centrality in the human functional connectome, Cerebral Cortex, 22, 1862, 10.1093/cercor/bhr269 Kaur, 2023, A systematic literature review on the use of machine learning in code clone research, Comp. Sci. Rev., 47 Chiang, 2019, Cluster-gcn: An efficient algorithm for training deep and large graph convolutional networks, 257 Huang, 2018, Adaptive sampling towards fast graph representation learning, Adv. Neural Inf. Process. Syst., 31 Jemmali, 2023, Efficient satellite image storage management: Iterative-probabilistic algorithms for dynamic resource allocation, IEEE Access, 10.1109/ACCESS.2023.3299213 Xu, 2023, TFSF: Topological and feature space fusion with spatio-temporal modeling for crop yield prediction, 1685 Fan, 2022, A GNN-RNN approach for harnessing geospatial and temporal information: application to crop yield prediction, 11873 Sellami, 2023, SHCNet: A semi-supervised hypergraph convolutional networks based on relevant feature selection for hyperspectral image classification, Pattern Recognit. Lett., 165, 98, 10.1016/j.patrec.2022.12.004 Wu, 2020, A comprehensive survey on graph neural networks, IEEE Trans. Neural Netw. Learn. Syst., 32, 4, 10.1109/TNNLS.2020.2978386 Wu, 2022, Graph neural networks in recommender systems: a survey, ACM Comput. Surv., 55, 1, 10.1145/3535101 Zhou, 2020, Graph neural networks: A review of methods and applications, AI Open, 1, 57, 10.1016/j.aiopen.2021.01.001 Waikhom, 2021 Zhang, 2021 Gupta, 2021, Graph neural network: Current state of Art, challenges and applications, Mater. Today: Proc., 46, 10927 Xia, 2021, Graph learning: A survey, IEEE Trans. Artif. Intell., 2, 109, 10.1109/TAI.2021.3076021 Skarding, 2021, Foundations and modeling of dynamic networks using dynamic graph neural networks: A survey, IEEE Access, 9, 79143, 10.1109/ACCESS.2021.3082932 Yuan, 2020 Sato, 2020 Dong, 2022 Ekambaram, 2015, Spline-like wavelet filterbanks for multiresolution analysis of graph-structured data, IEEE Trans. Signal Inf. Process. Netw., 1, 268 Liu, 2019, Learning graph topological features via GAN, IEEE Access, 7, 21834, 10.1109/ACCESS.2019.2898693 Liao, 2021, A review of graph neural networks and their applications in power systems, J. Mod. Power Syst. Clean Energy, 10, 345, 10.35833/MPCE.2021.000058 Mavroudi, 2020, Representation learning on visual-symbolic graphs for video understanding, 71 Bronstein, 2017, Geometric deep learning: going beyond euclidean data, IEEE Signal Process. Mag., 34, 18, 10.1109/MSP.2017.2693418 Kumar, 2020 Adjeisah, 2023, Towards data augmentation in graph neural network: An overview and evaluation, Comp. Sci. Rev., 47 Dong, 2021 Kampffmeyer, 2018 Veličković, 2017 Vaswani, 2017, Attention is all you need, Adv. Neural Inf. Process. Syst., 30 Li, 2015 Chen, 2021, A survey on traffic prediction techniques using artificial intelligence for communication networks, 518 Shi, 2020, Effective decoding in graph auto-encoder using triadic closure, 906 Tang, 2022 Yang, 2019, Conditional structure generation through graph variational generative adversarial nets, Adv. Neural Inf. Process. Syst., 32 Pan, 2018 Kipf, 2016 Kingma, 2013 Bojchevski, 2018, Netgan: Generating graphs via random walks, 610 Li, 2018 Tremblay, 2018, Design of graph filters and filterbanks, 299 He, 2022, RSI-Net: Two-stream deep neural network for remote sensing images-based semantic segmentation, IEEE Access, 10, 34858, 10.1109/ACCESS.2022.3163535 Oueslati, 2023, A systematic review on moving objects’ trajectory data and trajectory data warehouse modeling, Comp. Sci. Rev., 47 Tang, 2020, A general traffic flow prediction approach based on spatial-temporal graph attention, IEEE Access, 8, 153731, 10.1109/ACCESS.2020.3018452 Wu, 2019 Sarhan, 2023, Novel intelligent architecture and approximate solution for future networks, Plos One, 18, 10.1371/journal.pone.0278183 Rossi, 2020 Song, 2021, Temporally evolving graph neural network for fake news detection, Inf. Process. Manage., 58, 10.1016/j.ipm.2021.102712 Geng, 2019, Spatiotemporal multi-graph convolution network for ride-hailing demand forecasting, 3656 Pan, 2019, Urban traffic prediction from spatio-temporal data using deep meta learning, 1720 Zou, 2023, Spatiotemporal graph-based analysis of land cover evolution using remote sensing time series data, Int. J. Geogr. Inf. Sci., 1 Liu, 2022, Hybrid spatiotemporal graph convolutional network for detecting landscape pattern evolution from long-term remote sensing images, IEEE Trans. Geosci. Remote Sens., 60, 1 Wan, 2019, Multiscale dynamic graph convolutional network for hyperspectral image classification, IEEE Trans. Geosci. Remote Sens., 58, 3162, 10.1109/TGRS.2019.2949180 Wang, 2022, Comparison graph neural networks for remote sensing scene classification, 598 Zhao, 2022, Contextual-aware land cover classification with U-shaped object graph neural network (U-OGNN), IEEE Geosci. Remote Sens. Lett. Yu, 2022, Edge-inferring graph neural network with dynamic task-guided self-diagnosis for few-shot hyperspectral image classification, IEEE Trans. Geosci. Remote Sens., 60, 1 Zuo, 2022, FSL-EGNN: Edge-labeling graph neural network for hyperspectral image few-shot classification, IEEE Trans. Geosci. Remote Sens., 60, 1, 10.1109/TGRS.2022.3230043 Diao, 2020, Multi-label remote sensing image classification with deformable convolutions and graph neural networks, 521 Lin, 2021, Multilabel aerial image classification with a concept attention graph neural network, IEEE Trans. Geosci. Remote Sens., 60, 1 Saha, 2022, Multitarget domain adaptation for remote sensing classification using graph neural network, IEEE Geosci. Remote Sens. Lett., 19, 1 Dadsetan, 2021, Superpixels and graph convolutional neural networks for efficient detection of nutrient deficiency stress from aerial imagery, 2950 Xu, 2021, Deep feature aggregation framework driven by graph convolutional network for scene classification in remote sensing, IEEE Trans. Neural Netw. Learn. Syst. Wang, 2022, Graph-based semisupervised learning with weighted features for hyperspectral remote sensing image classification, IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., 15, 6356, 10.1109/JSTARS.2022.3195639 Ding, 2022, Multi-feature fusion: Graph neural network and CNN combining for hyperspectral image classification, Neurocomputing, 10.1016/j.neucom.2022.06.031 Wang, 2020 Ding, 2021, Graph sample and aggregate-attention network for hyperspectral image classification, IEEE Geosci. Remote Sens. Lett., 19, 1 Pu, 2022, Hyperspectral image classification with localized spectral filtering-based graph attention network, ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci., 3, 155, 10.5194/isprs-annals-V-3-2022-155-2022 Sha, 2020, Semisupervised classification for hyperspectral images using graph attention networks, IEEE Geosci. Remote Sens. Lett., 18, 157, 10.1109/LGRS.2020.2966239 Xu, 2021, Spectral–spatial residual graph attention network for hyperspectral image classification, IEEE Geosci. Remote Sens. Lett., 19, 1 Li, 2020, Multi-label remote sensing image scene classification by combining a convolutional neural network and a graph neural network, Remote Sens., 12, 4003, 10.3390/rs12234003 Liu, 2020 Liu, 2021, Self-constructing graph neural networks to model long-range pixel dependencies for semantic segmentation of remote sensing images, Int. J. Remote Sens., 42, 6184, 10.1080/01431161.2021.1936267 Wang, 2021, Dynamic graph-level neural network for SAR image change detection, IEEE Geosci. Remote Sens. Lett., 19, 1 Wang, 2021, Graph-level neural network for SAR image change detection, 3785 Liu, 2019, Semi-supervised change detection based on graphs with generative adversarial networks, 74 Boulila, 2022, A hybrid privacy-preserving deep learning approach for object classification in very high-resolution satellite images, Remote Sens., 14, 4631, 10.3390/rs14184631 Tian, 2021, A relation-augmented embedded graph attention network for remote sensing object detection, IEEE Trans. Geosci. Remote Sens., 60, 1 Chen, 2021 Zhang, 2020, A multi-modal graph neural network approach to traffic risk forecasting in smart urban sensing, 1 Yan, 2022, A combination of convolutional and graph neural networks for regularized road surface extraction, IEEE Trans. Geosci. Remote Sens., 60, 1 Liu, 2022, Dual learning-based graph neural network for remote sensing image super-resolution, IEEE Trans. Geosci. Remote Sens., 60, 1 Chaudhuri, 2019, Siamese graph convolutional network for content based remote sensing image retrieval, Comput. Vis. Image Underst., 184, 22, 10.1016/j.cviu.2019.04.004 Yang, 2010, Bag-of-visual-words and spatial extensions for land-use classification, 270 Tong, 2020, Land-cover classification with high-resolution remote sensing images using transferable deep models, Remote Sens. Environ., 237, 10.1016/j.rse.2019.111322 Yang, 2012, Geographic image retrieval using local invariant features, IEEE Trans. Geosci. Remote Sens., 51, 818, 10.1109/TGRS.2012.2205158 Xia, 2018, DOTA: A large-scale dataset for object detection in aerial images, 3974 Chaudhuri, 2017, Multilabel remote sensing image retrieval using a semisupervised graph-theoretic method, IEEE Trans. Geosci. Remote Sens., 56, 1144, 10.1109/TGRS.2017.2760909 Hua, 2019, Recurrently exploring class-wise attention in a hybrid convolutional and bidirectional LSTM network for multi-label aerial image classification, ISPRS J. Photogramm. Remote Sens., 149, 188, 10.1016/j.isprsjprs.2019.01.015 Zhu, 2020, So2Sat LCZ42: A benchmark data set for the classification of global local climate zones [Software and Data Sets], IEEE Geosci. Remote Sens. Mag., 8, 76, 10.1109/MGRS.2020.2964708 Schmitt, 2021 Tong, 2020, Few-shot learning with attention-weighted graph convolutional networks for hyperspectral image classification, 1686 Xia, 2017, AID: A benchmark data set for performance evaluation of aerial scene classification, IEEE Trans. Geosci. Remote Sens., 55, 3965, 10.1109/TGRS.2017.2685945 Zou, 2015, Deep learning based feature selection for remote sensing scene classification, IEEE Geosci. Remote Sens. Lett., 12, 2321, 10.1109/LGRS.2015.2475299 Cheng, 2017, Remote sensing image scene classification: Benchmark and state of the art, Proc. IEEE, 105, 1865, 10.1109/JPROC.2017.2675998 Yang, 2020, Learning relation by graph neural network for SAR image few-shot learning, 1743 Qin, 2018, Spectral–spatial graph convolutional networks for semisupervised hyperspectral image classification, IEEE Geosci. Remote Sens. Lett., 16, 241, 10.1109/LGRS.2018.2869563 Ren, 2021, Semi-supervised classification for PolSAR data with multi-scale evolving weighted graph convolutional network, IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., 14, 2911, 10.1109/JSTARS.2021.3061418 Fu, 2021, Example-feature graph convolutional networks for semi-supervised classification, Neurocomputing, 461, 63, 10.1016/j.neucom.2021.07.048 Gong, 2018, Deep salient feature based anti-noise transfer network for scene classification of remote sensing imagery, Remote Sens., 10, 410, 10.3390/rs10030410 Jiang, 2022, Semi-supervised sea ice classification of SAR imagery based on graph convolutional network, 1031 Leigh, 2013, Automated ice–water classification using dual polarization SAR satellite imagery, IEEE Trans. Geosci. Remote Sens., 52, 5529, 10.1109/TGRS.2013.2290231 Sha, 2019, Semi-supervised classification for hyperspectral images using edge-conditioned graph convolutional networks, 2690 Yang, 2022, Semi-supervised multiscale dynamic graph convolution network for hyperspectral image classification, IEEE Trans. Neural Netw. Learn. Syst., 10.1109/TNNLS.2022.3212985 Ding, 2021, Semi-supervised locality preserving dense graph neural network with ARMA filters and context-aware learning for hyperspectral image classification, IEEE Trans. Geosci. Remote Sens., 60, 1 Zhao, 2021, Spectral–spatial graph attention network for semisupervised hyperspectral image classification, IEEE Geosci. Remote Sens. Lett., 19, 1 Shao, 2018, Performance evaluation of single-label and multi-label remote sensing image retrieval using a dense labeling dataset, Remote Sens., 10, 964, 10.3390/rs10060964 Dong, 2022, Weighted feature fusion of convolutional neural network and graph attention network for hyperspectral image classification, IEEE Trans. Image Process., 31, 1559, 10.1109/TIP.2022.3144017 Yang, 2021, Mixed loss graph attention network for few-shot SAR target classification, IEEE Trans. Geosci. Remote Sens., 60, 1 Huang, 2017, OpenSARShip: A dataset dedicated to Sentinel-1 ship interpretation, IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., 11, 195, 10.1109/JSTARS.2017.2755672 Liang, 2020, A deep neural network combined CNN and GCN for remote sensing scene classification, IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., 13, 4325, 10.1109/JSTARS.2020.3011333 Chen, 2022, Open set few-shot remote sensing scene classification based on a multiorder graph convolutional network and domain adaptation, IEEE Trans. Geosci. Remote Sens., 60, 1 Wang, 2018, Scene classification with recurrent attention of VHR remote sensing images, IEEE Trans. Geosci. Remote Sens., 57, 1155, 10.1109/TGRS.2018.2864987 Li, 2020, RSI-CB: A large-scale remote sensing image classification benchmark using crowdsourced data, Sensors, 20, 1594, 10.3390/s20061594 Chen, 2020, A convolutional neural network with parallel multi-scale spatial pooling to detect temporal changes in SAR images, Remote Sens., 12, 1619, 10.3390/rs12101619 Saha, 2020, Semisupervised change detection using graph convolutional network, IEEE Geosci. Remote Sens. Lett., 18, 607, 10.1109/LGRS.2020.2985340 Ismail, 2022 Gupta, 2019 Sun, 2022, SemiSANet: A semi-supervised high-resolution remote sensing image change detection model using siamese networks with graph attention, Remote Sens., 14, 2801, 10.3390/rs14122801 Jia, 2022, Bipartite graph attention autoencoders for unsupervised change detection using vhr remote sensing images, IEEE Trans. Geosci. Remote Sens., 60, 1 Li, 2012, High-altitude radar measurements of ice thickness over the Antarctic and Greenland ice sheets as a part of operation icebridge, IEEE Trans. Geosci. Remote Sens., 51, 742, 10.1109/TGRS.2012.2203822 Liu, 2021, A probabilistic model based on bipartite convolutional neural network for unsupervised change detection, IEEE Trans. Geosci. Remote Sens., 60, 1 Benedek, 2009, Change detection in optical aerial images by a multilayer conditional mixed Markov model, IEEE Trans. Geosci. Remote Sens., 47, 3416, 10.1109/TGRS.2009.2022633 Liu, 2021, Super-resolution-based change detection network with stacked attention module for images with different resolutions, IEEE Trans. Geosci. Remote Sens., 60, 1 Mattyus, 2015, Enhancing road maps by parsing aerial images around the world, 1689 Liu, 2015, Fast multiclass vehicle detection on aerial images, IEEE Geosci. Remote Sens. Lett., 12, 1938, 10.1109/LGRS.2015.2439517 Melhim, 2018, Intelligent real-time intervention system applied in smart city, 1 Yang, 2022, Scene changes understanding framework based on graph convolutional networks and swin transformer blocks for monitoring LCLU using high-resolution remote sensing images, Remote Sens., 14, 3709, 10.3390/rs14153709 Ding, 2022, Self-supervised locality preserving low-pass graph convolutional embedding for large-scale hyperspectral image clustering, IEEE Trans. Geosci. Remote Sens., 60, 1 Van Engelen, 2020, A survey on semi-supervised learning, Mach. Learn., 109, 373, 10.1007/s10994-019-05855-6 Hanachi, 2021, Semi-supervised classification of hyperspectral image through deep encoder-decoder and graph neural networks, 1 Hong, 2021, Multimodal remote sensing benchmark datasets for land cover classification with a shared and specific feature learning model, ISPRS J. Photogramm. Remote Sens., 178, 68, 10.1016/j.isprsjprs.2021.05.011 He, 2023, Multi-modal remote sensing image segmentation with intuition-inspired hypergraph modeling, IEEE Trans. Image Process., 10.1109/TIP.2023.3245324 Peng, 2019, Densely based multi-scale and multi-modal fully convolutional networks for high-resolution remote-sensing image semantic segmentation, IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., 12, 2612, 10.1109/JSTARS.2019.2906387 Kang, 2020, Graph relation network: Modeling relations between scenes for multilabel remote-sensing image classification and retrieval, IEEE Trans. Geosci. Remote Sens., 59, 4355, 10.1109/TGRS.2020.3016020 Gao, 2021, Multiview graph convolutional hashing for multisource remote sensing image retrieval, IEEE Geosci. Remote Sens. Lett., 19, 1 Diao, 2022, Superpixel-based attention graph neural network for semantic segmentation in aerial images, Remote Sens., 14, 305, 10.3390/rs14020305 Atitallah, 2023, FedMicro-IDA: A federated learning and microservices-based framework for IoT data analytics, Internet Things, 23