Information fusion as an integrative cross-cutting enabler to achieve robust, explainable, and trustworthy medical artificial intelligence

Thrall, 2018, Artificial intelligence and machine learning in radiology: Opportunities, challenges, pitfalls, and criteria for success, J. Am. Coll. Radiol., 15, 504, 10.1016/j.jacr.2017.12.026 Yu, 2018, Artificial intelligence in healthcare, Nat. Biomed. Eng., 2, 719, 10.1038/s41551-018-0305-z Mei, 2020, Artificial intelligence–enabled rapid diagnosis of patients with covid-19, Nat. Med., 26, 1224, 10.1038/s41591-020-0931-3 J.E. Arco, A. Ortiz, J. Ramirez, F.J. Martínez-Murcia, Y.-D. Zhang, J.M. Górriz, Uncertainty-driven ensembles of deep architectures for multiclass classification. Application to covid-19 diagnosis in chest x-ray images, arXiv:2011.14894. F.J. Martinez-Murcia, A. Ortiz, J. Ramírez, J.M. Górriz, R. Cruz, Deep residual transfer learning for automatic diagnosis and grading of diabetic retinopathy, Neurocomputing. Grapov, 2018, Rise of deep learning for genomic, proteomic, and metabolomic data integration in precision medicine, omics:, J. Integr. Biol., 22, 630 Zhang, 2019, Deep learning in omics: A survey and guideline, Brief. Funct. Genom., 18, 41, 10.1093/bfgp/ely030 Chaudhary, 2018, Deep learning–based multi-omics integration robustly predicts survival in liver cancer, Clin. Cancer Res., 24, 1248, 10.1158/1078-0432.CCR-17-0853 Martorell-Marugán, 2019, 37 Farhangfar, 2009, Learning to segment from a few well-selected training images, 305 N. Papernot, P. McDaniel, I. Goodfellow, S. Jha, Z.B. Celik, A. Swami, Practical black-box attacks against machine learning, in: Proceedings of the 2017 ACM on Asia COnference on Computer and Communications Security, 2017, pp. 506–519. S. Jain, B.C. Wallace, Attention is not explanation, arXiv preprint arXiv:1902.10186. Wiegreffe, 2019, Attention is not not explanation, 11 Steels, 2018, The barcelona declaration for the proper development and usage of artificial intelligence in europe, AI Commun., 31, 485, 10.3233/AIC-180607 J. Crowley, A. Oulasvirta, J. Shawe-Taylor, M. Chetouani, B. O’Sullivan, A. Paiva, A. Nowak, C. Jonker, D. Pedreschi, F. Giannotti, F. van Harmelen, J. Hajic, J. van den Hoven, R. Chatila, Y. Rogers, Toward ai systems that augment and empower humans by understanding us, our society and the world around us, Report of 761758 EU Project HumaneAI (available online) (2019) 1–32. Schneeberger, 2020, The european legal framework for medical ai, 209 Mueller, 2021, The ten commandments of ethical medical ai, IEEE Comput., 54, 119, 10.1109/MC.2021.3074263 Hussain, 2009, Investigating agile user-centered design in practice: A grounded theory perspective, vol. 5889, 279 Holzinger, 2021, Towards multi-modal causability with graph neural networks enabling information fusion for explainable ai, Inf. Fusion, 71, 28, 10.1016/j.inffus.2021.01.008 Zitnik, 2015, Data fusion by matrix factorization, IEEE Trans. Pattern Anal. Mach. Intell., 37, 41, 10.1109/TPAMI.2014.2343973 Zitnik, 2019, Machine learning for integrating data in biology and medicine: Principles, practice, and opportunities, Inf. Fusion, 50, 71, 10.1016/j.inffus.2018.09.012 Cox, 2009, Comparative systems biology of human and mouse as a tool to guide the modeling of human placental pathology, Mol. Syst. Biol., 5, 279, 10.1038/msb.2009.37 Enright, 1999, Protein interaction maps for complete genomes based on gene fusion events, Nature, 402, 86, 10.1038/47056 IMEx Consortium, http://www.imexconsortium.org/, (Online; Accessed 17 December 2020). Del-Toro, 2012, Capturing variation impact on molecular interactions in the IMEx consortium mutations data set, Nature Methods, 9, 345 Gene Ontology Consortium, 2001, Creating the gene ontology resource: Design and implementation, Genome Res., 11, 1425, 10.1101/gr.180801 Wheeler, 2008, Database resources of the national center for biotechnology information, Nucl. Acids Res., 36, D13 McKusick, 2007, Mendelian inheritance in man and its online version, OMIM, Am. J. Hum. Genet., 80, 588, 10.1086/514346 Matthews, 2009, Reactome knowledgebase of human biological pathways and processes, Nucl. Acids Res., 37, D619, 10.1093/nar/gkn863 UniProt Consortium, 2009, The universal protein resource (UniProt) 2009, Nucl. Acids Res., 37, D169, 10.1093/nar/gkn664 Uhlen, 2010, Towards a knowledge-based human protein atlas, Nat. Biotechnol., 28, 1248, 10.1038/nbt1210-1248 Network The Cancer Genome Atlas Research, 2013, The cancer genome atlas pan-cancer analysis project, Nat. Genet., 45, 1113, 10.1038/ng.2764 Forbes, 2015, Cosmic: Exploring the world’s knowledge of somatic mutations in human cancer, Nucleic Acids Res., 43, D805, 10.1093/nar/gku1075 The Gene Ontology Consortium, 2015, Gene ontology consortium: Going forward, Nucleic Acids Res., 43, D1049, 10.1093/nar/gku1179 The UniProt Consortium, 2015, Uniprot: A hub for protein information, Nucleic Acids Res., 43, D204, 10.1093/nar/gku989 Rahmati, 2020, pathdip 4: An extended pathway annotations and enrichment analysis resource for human, model organisms and domesticated species, Nucleic Acids Res., 48, D479 Kotlyar, 2019, Iid 2018 update: Context-specific physical protein-protein interactions in human, model organisms and domesticated species, Nucleic Acids Res., 47, D581, 10.1093/nar/gky1037 Tokar, 2018, mirdip v4.0 – integrative microrna targets prediction and tissue-specificity annotation, Nucl. Acids Res., 46, D360, 10.1093/nar/gkx1144 Braun, 2009, An experimentally derived confidence score for binary protein-protein interactions, Nat. Methods, 6, 91, 10.1038/nmeth.1281 Kotlyar, 2015, In silico prediction of physical protein interactions and characterization of interactome orphans, Nature Methods, 12, 79, 10.1038/nmeth.3178 Azarkhalili, 2019, Deepathology: Deep multi-task learning for inferring molecular pathology from cancer transcriptome, Sci. Rep., 9, 1, 10.1038/s41598-019-52937-5 Enfield, 2019, Epithelial tumor suppressor elf3 is a lineage-specific amplified oncogene in lung adenocarcinoma, Nature Commun., 10, 5438, 10.1038/s41467-019-13295-y Pržulj, 2004, Functional topology in a network of protein interactions, Bioinformatics, 20, 340, 10.1093/bioinformatics/btg415 Klimovskaia, 2020, Poincaré maps for analyzing complex hierarchies in single-cell data, Nature Commun., 11, 1, 10.1038/s41467-020-16822-4 Fortney, 2010, Inferring the functions of longevity genes with modular subnetwork biomarkers of caenorhabditis elegans aging, Genome Biol., 11, R13, 10.1186/gb-2010-11-2-r13 Wiens, 2019, Do no harm: A roadmap for responsible machine learning for health care, Nat. Med., 25, 1337, 10.1038/s41591-019-0548-6 Jörnsten, 2011, Network modeling of the transcriptional effects of copy number aberrations in glioblastoma, Mol. Syst. Biol., 7, 486, 10.1038/msb.2011.17 Yang, 2014, Gene co-expression network analysis reveals common system-level properties of prognostic genes across cancer types, Nature Commun., 5, 262 Barabasi, 2011, Network medicine: A network-based approach to human disease, Nat. Rev. Genet., 12, 56, 10.1038/nrg2918 Wong, 2018, Modeling tumor progression via the comparison of stage-specific graphs, Methods, 132, 34, 10.1016/j.ymeth.2017.06.033 Monette, 2019, Failed immune responses across multiple pathologies share pan-tumor and circulating lymphocytic targets, J. Clin. Invest., 129, 2463, 10.1172/JCI125301 Camacho, 2018, Next-generation machine learning for biological networks, Cell, 173, 1581, 10.1016/j.cell.2018.05.015 Holzinger, 2014, Trends in interactive knowledge discovery for personalized medicine: Cognitive science meets machine learning, IEEE Intell. Inform. Bull., 15, 6 Newman, 2006 Emmert-Streib, 2008 Ben-Naim, 2004, Complex networks, 10.1007/b98716 Dehmer, 2017, Quantitative graph theory: A new branch of graph theory and network science, Inform. Sci., 418, 575, 10.1016/j.ins.2017.08.009 Dehmer, 2014 Wang, 2014, Similarity network fusion for aggregating data types on a genomic scale, Nature Methods, 11, 333, 10.1038/nmeth.2810 H. Bunke, Recent developments in graph matching, in: 15-th International Conference on Pattern Recognition, vol. 2, 2000, pp. 117–124. Emmert-Streib, 2016, Fifty years of graph matching, network alignment and network comparison, Inform. Sci., 346 Dehmer, 2019, On efficient network similarity measures, Appl. Math. Comput., 362 Devillers, 1999 Bonchev, 1983 Ulanowicz, 2013, Circumscribed complexity in ecological networks, 249 Bronstein, 2017, Geometric deep learning: Going beyond euclidean data, IEEE Signal Process. Mag., 34, 18, 10.1109/MSP.2017.2693418 Laponogov, 2021, Network machine learning maps phytochemically rich hyperfoods to fight covid-19, Hum. Genom., 15, 1, 10.1186/s40246-020-00297-x N. Díaz-Rodríguez, A. Lamas, J. Sanchez, G. Franchi, I. Donadello, S. Tabik, D. Filliat, P. Cruz, R. Montes, F. Herrera, Explainable neural-symbolic learning (x-nesyl) methodology to fuse deep learning representations with expert knowledge graphs: The monumai cultural heritage use case (2021). arXiv:2104.11914. Lipton, 2018, The mythos of model interpretability, Queue, 16, 31, 10.1145/3236386.3241340 DeYoung, 2020, ERASER: A benchmark to evaluate rationalized NLP models, 4443 Atanasova, 2020, A diagnostic study of explainability techniques for text classification, 3256 N. Díaz-Rodríguez, A. Härmä, R. Helaoui, I. Huitzil, F. Bobillo, U. Straccia, Couch potato or gym addict? Semantic lifestyle profiling with wearables and fuzzy knowledge graphs, in: Automatic Knowledge Base Construction (AKBC) Workshop at NIPS, 2017, pp. 1–10. Rodríguez, 2014, A fuzzy ontology for semantic modelling and recognition of human behaviour, Knowl.-Based Syst., 66, 46, 10.1016/j.knosys.2014.04.016 Biemann, 2013, Text: Now in 2D! a framework for lexical expansion with contextual similarity, J. Lang. Model., 1, 55 Díaz-Rodríguez, 2017, An ontology for wearables data interoperability and ambient assisted living application development, 1 Jeong, 2001, Lethality and centrality in protein networks, Nature, 411, 41, 10.1038/35075138 Hahn, 2005, Comparative genomics of centrality and essentiality in three eukaryotic protein-interaction networks, Mol. Biol. Evol., 22, 803, 10.1093/molbev/msi072 S., 2002, Nspecificity and stability in topology of protein networks, Science, 296, 910, 10.1126/science.1065103 Gavin, 2002, Functional organization of the yeast proteome by systematic analysis of protein complexes, Nature, 415, 141, 10.1038/415141a Wuchty, 2006, Topology and weights in a protein domain interaction network–a novel way to predict protein interactions, BMC Genom., 7, 1471, 10.1186/1471-2164-7-122 Sharan, 2007, Network-based prediction of protein function, Mol. Syst. Biol., 3, 88, 10.1038/msb4100129 Ravasz, 2002, Hierarchical organization of modularity in metabolic networks, Science, 297, 1551, 10.1126/science.1073374 H. Yu, M. Gerstein, Genomic analysis of the hierarchical structure of regulatory networks, Proc. Natl. Acad. Sci. U S A0027-8424 (Print) Journal article. Han, 2004, Evidence for dynamically organized modularity in the yeast protein-protein interaction network, Nature, 430, 88, 10.1038/nature02555 Segal, 2003, Module networks: Identifying regulatory modules and their condition-specific regulators from gene expression data, Nat. Genet., 34, 166, 10.1038/ng1165 Gavin, 2006, Proteome survey reveals modularity of the yeast cell machinery, Nature, 440, 631, 10.1038/nature04532 Wong, 2015, Comparative network analysis via differential graphlet communities, Proteomics, 15, 608, 10.1002/pmic.201400233 Shen-Orr, 2002, Network motifs in the transcriptional regulation network of escherichia coli, Nat. Gen., 31, 64, 10.1038/ng881 Rice, 2005, Lasting impressions: Motifs in protein-protein maps may provide footprints of evolutionary events, Proc. Natl. Acad. Sci. U S A, 102, 3173, 10.1073/pnas.0500130102 Jeremy Kershenbaum, 2005, Gustavo comment united states proceedings of the national academy of sciences of the united states of america, Proc. Natl. Acad. Sci. U S A, 102, 3173 Singh, 2018, Therapeutic targeting of the premetastatic stage in human lung-to-brain metastasis, Cancer Res., 78, 5124, 10.1158/0008-5472.CAN-18-1022 Monette, 2019, Immune-enrichment of non-small cell lung cancer baseline biopsies for multiplex profiling define prognostic immune checkpoint combinations for patient stratification, J. Immunother. Cancer, 7, 86, 10.1186/s40425-019-0544-x Kotlyar, 2012, Network-based characterization of drug-regulated genes, drug targets, and toxicity, Methods, 57, 499, 10.1016/j.ymeth.2012.06.003 Xiong, 2018 Barrios-Rodiles, 2005, High-throughput mapping of a dynamic signaling network in mammalian cells, Science, 307, 1621, 10.1126/science.1105776 Hu, 2007, A single nucleotide polymorphism in the mdm2 gene disrupts the oscillation of p53 and mdm2 levels in cells, Cancer Res., 67, 2757, 10.1158/0008-5472.CAN-06-2656 Barshir, 2013, The tissuenet database of human tissue protein-protein interactions, Nucl. Acids Res., 41, D841, 10.1093/nar/gks1198 Jansen, 2002, Relating whole-genome expression data with protein-protein interactions, Genome Res., 12, 37, 10.1101/gr.205602 Brown, 2007, Unequal evolutionary conservation of human protein interactions in interologous networks, Genome Biology, 8, R95, 10.1186/gb-2007-8-5-r95 Rhodes, 2005, Probabilistic model of the human protein-protein interaction network, Nat. Biotechnol., 23, 951, 10.1038/nbt1103 Kato, 2006, Network-based de-noising improves prediction from microarray data, BMC Bioinformatics Jonsson, 2006, Global topological features of cancer proteins in the human interactome, Bioinformatics, 22, 2291, 10.1093/bioinformatics/btl390 Wachi, 2005, Interactome-transcriptome analysis reveals the high centrality of genes differentially expressed in lung cancer tissues, Bioinformatics, 21, 4205, 10.1093/bioinformatics/bti688 Reis, 2020, A 4-gene signature from histologically normal surgical margins predicts local recurrence in patients with oral carcinoma: Clinical validation, Sci. Rep., 10, 1, 10.1038/s41598-020-58688-y Tokar, 2018, Differentially expressed micrornas in lung adenocarcinoma invert effects of copy number aberrations of prognostic genes, Oncotarget, 9, 9137, 10.18632/oncotarget.24070 V. Mandilaras, S. Garg, M. Cabanero, Q. Tan, C. Pastrello, J. Burnier, K. Karakasis, L. Wang, N.C. Dhani, M.O. Butler, P.L. Bedard, L.L. Siu, B. Clarke, P.A. Shaw, T. Stockley, I. Jurisica, A.M. Oza, S. Lheureux, Tp53 mutations in high grade serous ovarian cancer and impact on clinical outcomes: A comparison of next generation sequencing and bioinformatics analyses, International journal of gynecological cancer : Official journal of the International Gynecological Cancer Society. King, 2004, Protein complex prediction via cost-based clustering, Bioinformatics, 20, 3013, 10.1093/bioinformatics/bth351 N., 2006, Efficient estimation of graphlet frequency distributions in protein-protein interaction networks, Bioinformatics, 22, 974, 10.1093/bioinformatics/btl030 S.W.H. Wong, C. Pastrello, M. Kotlyar, C. Faloutsos, I. Jurisica, Sdregion: Fast spotting of changing communities in biological networks, Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Berrar, 2021, Deep learning in bioinformatics and biomedicine, Brief. Bioinform., 22, 1513, 10.1093/bib/bbab087 Ideker, 2002, Discovering regulatory and signalling circuits in molecular interaction networks, Bioinformatics, 18, S233, 10.1093/bioinformatics/18.suppl_1.S233 Chuang, 2007, Network-based classification of breast cancer metastasis, Mol. Syst. Biol., 3, 140, 10.1038/msb4100180 Nacu, 2007, Gene expression network analysis and applications to immunology, Bioinformatics, 23, 850, 10.1093/bioinformatics/btm019 Hwang, 2009, Predicting essential genes based on network and sequence analysis, Mol. Biosyst., 5, 1672, 10.1039/b900611g J.I. Geraci J., Liu G., Algorithms for systematic identification of small subgraphs (2012). Schramm, 2013, Disturbed protein-protein interaction networks in metastatic melanoma are associated with worse prognosis and increased functional mutation burden, Pigment Cell Melanoma Res., 26, 708, 10.1111/pcmr.12126 Ramanan, 2020, Causal learning from predictive modeling for observational data, Front. Big Data, 3, 34, 10.3389/fdata.2020.535976 Guo, 2020, A survey of learning causality with data: Problems and methods, ACM Comput. Surv., 53, 1 B. Schölkopf, Causality for machine learning, arXiv:1911.10500. Lu, 2008, Bayesian Generic priors for causal learning, Psychol. Rev., 115, 955, 10.1037/a0013256 Peters, 2017 D. Lopez-Paz, R. Nishihara, S. Chintala, B. Schölkopf, L. Bottou, Discovering causal signals in images, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 6979–6987. Castro, 2020, Causality matters in medical imaging, Nature Commun., 11, 1, 10.1038/s41467-020-17478-w O. Goudet, D. Kalainathan, P. Caillou, I. Guyon, D. Lopez-Paz, M. Sebag, Causal generative neural networks, arXiv preprint arXiv:1711.08936. M. Rojas-Carulla, M. Baroni, D. Lopez-Paz, Causal discovery using proxy variables, arXiv:1702.07306. B. Schölkopf, Causality for machine learning, arXiv preprint arXiv:1911.10500. Moraffah, 2020, Causal interpretability for machine learning-problems, methods and evaluation, ACM SIGKDD Explor. Newsl., 22, 18, 10.1145/3400051.3400058 Pearl, 1988 Pearl, 2009 A.-H. Karimi, J. von Kügelgen, B. Schölkopf, I. Valera, Algorithmic recourse under imperfect causal knowledge: A probabilistic approach, arXiv:2006.06831. Wachter, 2018, Counterfactual explanations without opening the black box: Automated decisions and the GDPR, Harv. J. Law Technol., 31, 841 Prosperi, 2020, Causal inference and counterfactual prediction in machine learning for actionable healthcare, Nat. Mach. Intell., 2, 369, 10.1038/s42256-020-0197-y M. Sharma, S. Mindermann, J. Brauner, G. Leech, A. Stephenson, T. Gavenčiak, J. Kulveit, Y.W. Teh, L. Chindelevitch, Y. Gal, How robust are the estimated effects of nonpharmaceutical interventions against covid-19? Advances in Neural Information Processing Systems 33. A. Jesson, S. Mindermann, U. Shalit, Y. Gal, Identifying causal-effect inference failure with uncertainty-aware models, Advances in Neural Information Processing Systems 33. Nair, 2020, Exploring uncertainty measures in deep networks for multiple sclerosis lesion detection and segmentation, Med. Image Anal., 59, 10.1016/j.media.2019.101557 T. Miller, Contrastive explanation: A structural-model approach, arXiv preprint arXiv:1811.03163. Elzein, 2019, The demand for contrastive explanations, Philos. Stud., 176, 1325, 10.1007/s11098-018-1065-z B. Krarup, S. Krivic, F. Lindner, D. Long, Towards contrastive explanations for comparing the ethics of plans, arXiv preprint arXiv:2006.12632. Dhurandhar, 2018, Explanations based on the missing: Towards contrastive explanations with pertinent negatives, Adv. Neural Inf. Process. Syst., 31, 592 W. Liang, J. Zou, Z. Yu, Alice: Active learning with contrastive natural language explanations, arXiv preprint arXiv:2009.10259. Liu, 2019, Deep feature selection and causal analysis of alzheimer’s disease, Front. Neurosci., 13, 1198, 10.3389/fnins.2019.01198 T.R. Besold, A. d. Garcez, S. Bader, H. Bowman, P. Domingos, P. Hitzler, K.-U. Kühnberger, L.C. Lamb, D. Lowd, P.M.V. Lima, et al. Neural-symbolic learning and reasoning: A survey and interpretation, arXiv preprint arXiv:1711.03902. King, 2020, Back-to-back regression: Disentangling the influence of correlated factors from multivariate observations, NeuroImage, 220, 10.1016/j.neuroimage.2020.117028 Barredo-Arrieta, 2020, Plausible counterfactuals: Auditing deep learning classifiers with realistic adversarial examples, 1 Hyland, 2020, Early prediction of circulatory failure in the intensive care unit using machine learning, Nat. Med., 26, 364, 10.1038/s41591-020-0789-4 A. Holzinger, C. Biemann, C.S. Pattichis, D.B. Kell, What do we need to build explainable ai systems for the medical domain? arXiv:1712.09923. Caruana, 2015, Intelligible models for healthcare: Predicting pneumonia risk and hospital 30-day readmission, 1721 Holzinger, 2016, Interactive machine learning for health informatics: When do we need the human-in-the-loop?, Brain Inform., 3, 119, 10.1007/s40708-016-0042-6 Buccafurri, 1999, Enhancing model checking in verification by ai techniques, Artificial Intelligence, 112, 57, 10.1016/S0004-3702(99)00039-9 Holzinger, 2019, Causability and explainability of artificial intelligence in medicine, Wiley Interdiscip. Rev. Data Min. Knowl. Discov., 9, 1, 10.1002/widm.1312 Holzinger, 2005, Usability engineering methods for software developers, Commun. ACM, 48, 71, 10.1145/1039539.1039541 Holzinger, 2020, Measuring the quality of explanations: The system causability scale (scs). comparing human and machine explanations, KI - Künstliche intelligenz (german journal of artificial intelligence), 193 Grigorescu, 2020, A survey of deep learning techniques for autonomous driving, J. Field Robotics, 37, 362, 10.1002/rob.21918 K. Muhammad, A. Ullah, J. Lloret, J. Del Ser, V.H.C. de Albuquerque, Deep learning for safe autonomous driving: Current challenges and future directions, IEEE Transactions on Intelligent Transportation Systems. Ting, 2018, Ai for medical imaging goes deep, Nat. Med., 24, 539, 10.1038/s41591-018-0029-3 K. Muhammad, S. Khan, J. Del Ser, V.H.C. de Albuquerque, Deep learning for multigrade brain tumor classification in smart healthcare systems: A prospective survey, IEEE Transactions on Neural Networks and Learning Systems. Diez-Olivan, 2019, Data fusion and machine learning for industrial prognosis: Trends and perspectives towards industry 4.0, Inf. Fusion, 50, 92, 10.1016/j.inffus.2018.10.005 Tellakula, 2021, A survey of ai imaging techniques for covid-19 diagnosis and prognosis, Appl. Comput. Sci., 17, 40, 10.35784/acs-2021-12 Xin, 2018, Machine learning and deep learning methods for cybersecurity, IEEE Access, 6, 35365, 10.1109/ACCESS.2018.2836950 Devlin, 2019, BERT: Pre-training of deep bidirectional transformers for language understanding, 4171 Rethmeier, 2020, 197 H. Daumé III, 2007, Frustratingly easy domain adaptation, 256 Blitzer, 2006, Domain adaptation with structural correspondence learning, 120 Wright, 2020, Transformer based multi-source domain adaptation, 7963 Goodfellow, 2020, Generative adversarial networks, Commun. ACM, 63, 139, 10.1145/3422622 Y. Ganin, V. Lempitsky, Unsupervised Domain Adaptation by Backpropagation, in: International Conference on Machine Learning, 2015, pp. 1180–1189. Atanasova, 2020, Generating label cohesive and well-formed adversarial claims, 3168 Lin, 2020, Does BERT need domain adaptation for clinical negation detection?, J. Am. Med. Inform. Assoc., 27, 584, 10.1093/jamia/ocaa001 Lesort, 2020, Continual learning for robotics: Definition, framework, learning strategies, opportunities and challenges, Inf. Fusion, 58, 52, 10.1016/j.inffus.2019.12.004 J. Bjerva, W. Kouw, I. Augenstein, Back to the future – sequential alignment of text representations, in: Proceedings of the 34th AAAI Conference on Artificial Intelligence. D. Doran, S. Schulz, T.R. Besold, What does explainable ai really mean? a new conceptualization of perspectives, arXiv preprint arXiv:1710.00794. A. Bennetot, J.-L. Laurent, R. Chatila, N. Díaz-Rodríguez, Towards explainable neural-symbolic visual reasoning, in: NeSy Workshop IJCAI, 2019, pp. 1–10. Vapnik, 1971, On the uniform convergence of relative frequencies of events to their probabilities, Theory Probab. Appl., 16, 264, 10.1137/1116025 Vapnik, 1991, The necessary and sufficient conditions for consistency in the empirical risk minimization method, Pattern Recognit. Image Anal., 1, 283 Poggio, 2004, General conditions for predictivity in learning theory, Nature, 428, 419, 10.1038/nature02341 Majkowska, 2020, Chest radiograph interpretation with deep learning models: Assessment with radiologist-adjudicated reference standards and population-adjusted evaluation, Radiology, 294, 421, 10.1148/radiol.2019191293 McKinney, 2020, International evaluation of an ai system for breast cancer screening, Nature, 577, 89, 10.1038/s41586-019-1799-6 Xu, 2012, Robustness and generalization, Mach. Learn., 86, 391, 10.1007/s10994-011-5268-1 N. Díaz-Rodríguez, R. Binkyte-Sadauskiene, W. Bakkali, S. Bookseller, P. Tubaro, A. Bacevicius, R. Chatila, Questioning causality on sex, gender and COVID-19, and identifying bias in large-scale data-driven analyses: the Bias Priority Recommendations and Bias Catalog for Pandemics, arXiv preprint arXiv:2104.14492. Pearl, 2011, Transportability of causal and statistical relations: A formal approach, 540 D. Tsipras, S. Santurkar, L. Engstrom, A. Turner, A. Madry, Robustness may be at odds with accuracy, arXiv:1805.12152. Dong, 2018, Boosting adversarial attacks with momentum, 9185 C. Szegedy, W. Zaremba, I. Sutskever, J. Bruna, D. Erhan, I. Goodfellow, R. Fergus, Intriguing properties of neural networks, arXiv preprint arXiv:1312.6199. A. Margeloiu, N. Simidjievski, M. Jamnik, A. Weller, Improving interpretability in medical imaging diagnosis using adversarial training, arXiv preprint arXiv:2012.01166. Merkulov, 2019, Empirical study of extreme overfitting points of neural networks, J. Commun. Technol. Electron., 64, 1527, 10.1134/S1064226919120118 Everingham, 2010, The pascal visual object classes (voc) challenge, Int. J. Comput. Vis., 88, 303, 10.1007/s11263-009-0275-4 Belinkov, 2019, On adversarial removal of hypothesis-only bias in natural language inference, 256 Lapuschkin, 2019, Unmasking clever hans predictors and assessing what machines really learn, Nature Commun., 10, 1096, 10.1038/s41467-019-08987-4 A. Jain, M. Ravula, J. Ghosh, Biased models have biased explanations, arXiv preprint arXiv:2012.10986. N. Liu, M. Du, X. Hu, Adversarial machine learning: An interpretation perspective, arXiv preprint arXiv:2004.11488. Heuillet, 2021, Explainability in deep reinforcement learning, Knowl.-Based Syst., 214, 10.1016/j.knosys.2020.106685 T.W. Killian, H. Zhang, J. Subramanian, M. Fatemi, M. Ghassemi, An empirical study of representation learning for reinforcement learning in healthcare, arXiv preprint arXiv:2011.11235. M.T. Ribeiro, S. Singh, C. Guestrin, why should I trust you?: Explaining the predictions of any classifier, in: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2016, pp. 1135–1144. Bach, 2015, On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation, PLoS One, 10, 10.1371/journal.pone.0130140 Gehrmann, 2019, Visual interaction with deep learning models through collaborative semantic inference, IEEE Trans. Vis. Comput. Graphics, 26, 884 Schmid, 2020, 1 Bruckert, 2020, The next generation of medical decision support: A roadmap toward transparent expert companions, Front. Artif. Intell., 3, 75, 10.3389/frai.2020.507973 S. Wallkotter, S. Tulli, G. Castellano, A. Paiva, M. Chetouani, Explainable agents through social cues: A review, arXiv preprint arXiv:2003.05251. E. Tjoa, C. Guan, A survey on explainable artificial intelligence (XAI): towards medical XAI, CoRR abs/1907.07374. arXiv:1907.07374. Lei, 2016, Rationalizing neural predictions, 107 Atanasova, 2020, Generating fact checking explanations, 7352 Singh, 2020, What is the optimal attribution method for explainable ophthalmic disease classification?, 21 Kim, 2018 Stammbach, 2020, e-fever: Explanations and summaries for automated fact checking, 32 Enarvi, 2020, Generating medical reports from patient-doctor conversations using sequence-to-sequence models, 22 Maynez, 2020, On faithfulness and factuality in abstractive summarization, 1906 Camburu, 2018, e-SNLI: Natural language inference with natural language explanations, 9539 Kotonya, 2020, Explainable automated fact-checking: A survey, 5430 Andrew, 2013, Deep canonical correlation analysis, III Valiant, 1999, Projection learning, Mach. Learn., 37, 115, 10.1023/A:1007678005361 Mikolov, 2013, Efficient estimation of word representations in vector space, 1 Jain, 2019, Attention is not explanation, 3543 Meister, 2021, Is sparse attention more interpretable?, 1 Valdez, 2017, Provcare semantic provenance knowledgebase: Evaluating scientific reproducibility of research studies, 1 Lakkaraju, 2019, Faithful and customizable explanations of black box models, 131 Muzammal, 2020, A multi-sensor data fusion enabled ensemble approach for medical data from body sensor networks, Inf. Fusion, 53, 155, 10.1016/j.inffus.2019.06.021 F. Rundo, G.L. Banna, L. Prezzavento, F. Trenta, S. Conoci, S. Battiato, 3d non-local neural network: A non-invasive biomarker for immunotherapy treatment outcome prediction. case-study: Metastatic urothelial carcinoma, Journal of Imaging. Sattler, 2020, Clustered federated learning: Model-agnostic distributed multi-task optimization under privacy constraints, IEEE Trans. Neural Netw. Learn. Syst., 31, 3400, 10.1109/TNNLS.2019.2944481 Ruff, 2021, A unifying review of deep and shallow anomaly detection, Proc. IEEE, 109, 756, 10.1109/JPROC.2021.3052449 Cabitza, 2017, Unintended consequences of machine learning in medicine, JAMA, 318, 517, 10.1001/jama.2017.7797 Holzinger, 2019, Why imaging data alone is not enough: Ai-based integration of imaging, omics, and clinical data, Eur. J. Nucl. Med. Mol. Imaging, 46, 2722, 10.1007/s00259-019-04382-9 Bhattacharyya, 2020, Personalized network modeling of the pan-cancer patient and cell line interactome, JCO Clin. Cancer Inform., 4, 399, 10.1200/CCI.19.00140 M. Abadi, A. Chu, I. Goodfellow, H.B. McMahan, I. Mironov, K. Talwar, L. Zhang, Deep learning with differential privacy, in: Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security, 2016, pp. 308–318. Friedrich, 2019, Adversarial learning of privacy-preserving text representations for de-identification of medical records, 5829 J. Wang, W. Bao, L. Sun, X. Zhu, B. Cao, S.Y. Philip, Private model compression via knowledge distillation, in: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, 2019, pp. 1190–1197. Celik, 2017, Patient-driven privacy control through generalized distillation, 1 Mehra, 2020, Cardiovascular disease, drug therapy, and mortality in covid-19, N. Engl. J. Med., 382, 10.1056/NEJMoa2007621 Mulvey, 2020, Analysis of complement deposition and viral rna in placentas of covid-19 patients, Ann. Diagn. Pathol., 46, 10.1016/j.anndiagpath.2020.151530 Zeng, 2018, Changing cancer survival in china during 2003–15: A pooled analysis of 17 population-based cancer registries, Lancet Glob. Health, 6, e555, 10.1016/S2214-109X(18)30127-X Fang, 2012, Misconduct accounts for the majority of retracted scientific publications, Proc. Nat. Acad. Sci., 42, 17028, 10.1073/pnas.1212247109 Orchard, 2019, Protein interaction data curation: the international molecular exchange (IMEx) consortium, Nature Commun., 10, 345 Perfetto, 2020 Porras, 2020, Towards a unified open access dataset of molecular interactions, Nat. Commun., 1, 6144, 10.1038/s41467-020-19942-z Hund, 2016, Visual analytics for concept exploration in subspaces of patient groups: Making sense of complex datasets with the doctor-in-the-loop, Brain Inform., 3, 233, 10.1007/s40708-016-0043-5 Keim, 2008, Visual analytics: Definition, process, and challenges, vol. 4950, 154 Streeb, 2021, Why visualize? Arguments for visual support in decision making, IEEE Comput. Graph. Appl., 41, 17, 10.1109/MCG.2021.3055971 A. holzinger, H. Mueller, Toward human-ai interfaces to support explainability and causability in medical ai, IEEE IEEE COMPUTER, 54, (10). http://dx.doi.org/10.1109/MC.2021.3092610. Lopez-Cobo, 2019, Academic offer and demand for advanced profiles in the eu.