Studying Psychosis Using Natural Language Generation: A Review of Emerging Opportunities

Cutting, 2003, Descriptive psychopathology, 15 Berrios, 1999, Falret, Séglas, Morselli, and Masselon, and the “language of the insane”: A conceptual history, Brain Lang, 69, 56, 10.1006/brln.1999.2042 Ungvari, 1993, The Wernicke-Kleist-Leonhard school of psychiatry, Biol Psychiatry, 34, 749, 10.1016/0006-3223(93)90062-I DeLisi, 2001, Speech disorder in schizophrenia: Review of the literature and exploration of its relation to the uniquely human capacity for language, Schizophr Bull, 27, 481, 10.1093/oxfordjournals.schbul.a006889 McKenna, 2005 Roche, 2016, Language disturbance and functioning in first episode psychosis, Psychiatry Res, 235, 29, 10.1016/j.psychres.2015.12.008 Oeztuerk, 2022, Association between formal thought disorders, neurocognition and functioning in the early stages of psychosis: A systematic review of the last half-century studies, Eur Arch Psychiatry Clin Neurosci, 272, 381, 10.1007/s00406-021-01295-3 Hoffman, 1982, Apprehending schizophrenic discourse: A structural analysis of the Listener’s task, Brain Lang, 15, 207, 10.1016/0093-934X(82)90057-8 Gooding, 2013, Thought disorder in mid-childhood as a predictor of adulthood diagnostic outcome: Findings from the New York High-Risk Project, Psychol Med, 43, 1003, 10.1017/S0033291712001791 Corcoran, 2018, Prediction of psychosis across protocols and risk cohorts using automated language analysis, World Psychiatry, 17, 67, 10.1002/wps.20491 Dominguez, 2010, Early expression of negative/disorganized symptoms predicting psychotic experiences and subsequent clinical psychosis: A 10-year study, Am J Psychiatry, 167, 1075, 10.1176/appi.ajp.2010.09060883 Häfner, 2019, From onset and prodromal stage to a Life-Long course of schizophrenia and its symptom dimensions: How sex, age, and other risk factors influence incidence and course of illness, Psychiatry J 2019 Palaniyappan, 2022, Dissecting the neurobiology of linguistic disorganisation and impoverishment in schizophrenia, Semin Cell Dev Biol, 129, 47, 10.1016/j.semcdb.2021.08.015 Crow, 2000, Schizophrenia as the price that Homo sapiens pays for language: A resolution of the central paradox in the origin of the species, Brain Res Brain Res Rev, 31, 118, 10.1016/S0165-0173(99)00029-6 Hoffman, 1986, Verbal hallucinations and language production processes in schizophrenia, Behav Brain Sci, 9, 503, 10.1017/S0140525X00046781 Hinzen, 2015, The linguistics of schizophrenia: Thought disturbance as language pathology across positive symptoms, Front Psychol, 6, 971 Reiter, 1997, Building applied natural language generation systems, Nat Lang Eng, 3, 57, 10.1017/S1351324997001502 Gatt, 2018, Survey of the state of the art in natural language generation: Core tasks, applications and evaluation, arXiv Hasson, 2020, Direct fit to nature: An evolutionary perspective on biological and artificial neural networks, Neuron, 105, 416, 10.1016/j.neuron.2019.12.002 Khurana, 2023, Natural language processing: State of the art, current trends and challenges, Multimed Tools Appl, 82, 3713, 10.1007/s11042-022-13428-4 Clark, 2021, All that’s ‘human’ is not gold: Evaluating human evaluation of generated text, 7282 See, 2019, What makes a good conversation? How controllable attributes affect human judgments, 1702 Mikolov, 2013, Efficient estimation of word representations in vector space, arXiv Devlin, 2019, BERT: Pre-training of deep bidirectional transformers for language understanding, arXiv Brown, 2020, Language models are few-shot learners, arXiv Vaswani Goldstein, 2022, Shared computational principles for language processing in humans and deep language models, Nat Neurosci, 25, 369, 10.1038/s41593-022-01026-4 Heilbron, 2022, A hierarchy of linguistic predictions during natural language comprehension, Proc Natl Acad Sci USA, 119, 10.1073/pnas.2201968119 Caucheteux, 2022, Deep language algorithms predict semantic comprehension from brain activity, Sci Rep, 12, 10.1038/s41598-022-20460-9 Schrimpf, 2021, The neural architecture of language: Integrative modeling converges on predictive processing, Proc Natl Acad Sci USA, 118, 10.1073/pnas.2105646118 Dou, 2022, Is GPT-3 text indistinguishable from human text? Scarecrow: A framework for scrutinizing machine text, arXiv Holtzman, 2020, The curious case of neural text degeneration, arXiv Andreasen, 1986, Thought, language, and communication in schizophrenia: Diagnosis and prognosis, Schizophr Bull, 12, 348, 10.1093/schbul/12.3.348 Arndt, 1995, A longitudinal study of symptom dimensions in schizophrenia. Prediction and patterns of change, Arch Gen Psychiatry, 52, 352, 10.1001/archpsyc.1995.03950170026004 Kircher, 2018, Formal thought disorders: From phenomenology to neurobiology, Lancet Psychiatry, 5, 515, 10.1016/S2215-0366(18)30059-2 Casey, 2019 Ji, 2022, Survey of hallucination in natural language generation, arXiv Rashkin, 2022, Measuring attribution in natural language generation models, arXiv Ritunnano, 2022, Do delusions have and give meaning?, Phenomenol Cogn Sci, 21, 949, 10.1007/s11097-021-09764-9 Dasgupta, 2022, Language models show human-like content effects on reasoning, arXiv Liddle, 2002, Thought and Language Index: An instrument for assessing thought and language in schizophrenia, Br J Psychiatry, 181, 326, 10.1192/bjp.181.4.326 Löffler, 1999, Nervenarzt, 70, 416, 10.1007/s001150050457 Roche, 2016, The prognostic value of formal thought disorder following first episode psychosis, Schizophr Res, 178, 29, 10.1016/j.schres.2016.09.017 Wilcox, 2012, Predictive value of thought disorder in new-onset psychosis, Compr Psychiatry, 53, 674, 10.1016/j.comppsych.2011.12.002 Bilder, 1992, Methylphenidate and neuroleptic effects on oral word production in schizophrenia, Neuropsychiatry Neuropsychol Behav Neurol, 5, 262 Li, 2022 Maynez, 2020, On faithfulness and factuality in abstractive summarization, 1906 Taylor, 2022, Galactica: A large language model for science, arXiv Cai, 2020, The errors analysis of natural language generation — A case study of Topic-to-Essay generation Kircher, 2022, Differences in single positive formal thought disorder symptoms between closely matched acute patients with schizophrenia and mania, Eur Arch Psychiatry Clin Neurosci, 272, 395, 10.1007/s00406-021-01263-x Alonso-Sánchez, 2022, Progressive changes in descriptive discourse in First Episode Schizophrenia: A longitudinal computational semantics study, Schizophrenia, 8, 36, 10.1038/s41537-022-00246-8 Huys, 2021, Advances in the computational understanding of mental illness, Neuropsychopharmacology, 46, 3, 10.1038/s41386-020-0746-4 Anticevic, 2015, Bridging levels of understanding in schizophrenia through computational modeling, Clin Psychol Sci, 3, 433, 10.1177/2167702614562041 Anticevic, 2017 Hoffman, 1987, Computer simulations of neural information processing and the schizophrenia-mania dichotomy, Arch Gen Psychiatry, 44, 178, 10.1001/archpsyc.1987.01800140090014 Lanillos, 2020, A review on neural network models of schizophrenia and autism spectrum disorder, Neural Netw, 122, 338, 10.1016/j.neunet.2019.10.014 Benrimoh, 2018, Active Inference and Auditory Hallucinations, Comput Psychiatr, 2, 183, 10.1162/CPSY_a_00022 Benrimoh, 2019, Hallucinations both in and out of context: An active inference account, PLoS One, 14, 10.1371/journal.pone.0212379 Adams, 2022, Computational modeling of electroencephalography and functional magnetic resonance imaging paradigms indicates a consistent loss of pyramidal cell synaptic gain in schizophrenia, Biol Psychiatry, 91, 202, 10.1016/j.biopsych.2021.07.024 Limongi, 2020, Glutamate and dysconnection in the salience network: Neurochemical, effective connectivity, and computational evidence in schizophrenia, Biol Psychiatry, 88, 273, 10.1016/j.biopsych.2020.01.021 Limongi, 2021, Frontal–striatal connectivity and positive symptoms of schizophrenia: Implications for the mechanistic basis of prefrontal rTMS, Eur Arch Psychiatry Clin Neurosci, 271, 3, 10.1007/s00406-020-01163-6 Palaniyappan, 2023, Language network dysfunction and formal thought disorder in schizophrenia, Schizophr Bull, 49, 486, 10.1093/schbul/sbac159 Stephan, 2009, Dysconnection in schizophrenia: From abnormal synaptic plasticity to failures of self-monitoring, Schizophr Bull, 35, 509, 10.1093/schbul/sbn176 Saxe, 2021, If deep learning is the answer, what is the question?, Nat Rev Neurosci, 22, 55, 10.1038/s41583-020-00395-8 Richards, 2019, A deep learning framework for neuroscience, Nat Neurosci, 22, 1761, 10.1038/s41593-019-0520-2 Doerig, 2023, The neuroconnectionist research programme, Nat Rev Neurosci, 24, 431, 10.1038/s41583-023-00705-w Jain, 2019, Attention is not explanation, arXiv Clark, 2019, What does BERT look at? An analysis of BERT’s attention, 276 van Aken, 2019, How does BERT answer questions? A layer-wise analysis of transformer representations, 1823 Ghaeini, 2018, Interpreting recurrent and attention-based neural models: A case study on natural language inference, arXiv Kanwisher, 2023, Using artificial neural networks to ask ‘why’ questions of minds and brains, Trends Neurosci, 46, 240, 10.1016/j.tins.2022.12.008 Girard, 2022, Computational analysis of spoken language in acute psychosis and mania, Schizophr Res, 245, 97, 10.1016/j.schres.2021.06.040 Colla, 2022, Semantic coherence markers: The contribution of perplexity metrics, Artif Intell Med, 134, 10.1016/j.artmed.2022.102393 Silva, 2022, Syntactic complexity of spoken language in the diagnosis of schizophrenia: A probabilistic Bayes network model [published online Jun 22], Schizophr Res Corcoran, 2020, Using language processing and speech analysis for the identification of psychosis and other disorders, Biol Psychiatry Cogn Neurosci Neuroimaging, 5, 770 Voleti, 2020, A review of automated speech and language features for assessment of cognitive and thought disorders, IEEE J Sel Top Signal Process, 14, 282, 10.1109/JSTSP.2019.2952087 Schrimpf, 2018, Brain-score: Which artificial neural network for object recognition is most brain-like?, bioRxiv Alonso-Sánchez, 2022, Language network self-inhibition and semantic similarity in first-episode schizophrenia: A computational-linguistic and effective connectivity approach [published online May 11], Schizophr Res Palaniyappan, 2022, Is collaborative open science possible with speech data in psychiatric disorders?, Schizophr Bull, 48, 963, 10.1093/schbul/sbac058 Chen, 2021, Synthetic data in machine learning for medicine and healthcare, Nat Biomed Eng, 5, 493, 10.1038/s41551-021-00751-8 McKenna, 2017 Meister, 2022, On the probability-quality paradox in language generation, arXiv Meister, 2022, Locally typical sampling, arXiv Chomsky, 1987, Vol. 16 Chater, 2008, Computational models of psycholinguistics, 477 Walker, 1994, Prediction of school outcomes based on early language production and socioeconomic factors, Child Dev, 65, 606, 10.2307/1131404 Newport, 2020, Children and adults as language learners: Rules, variation, and maturational change, Top Cogn Sci, 12, 153, 10.1111/tops.12416 Han, 2021, Pre-trained models: Past, present and future, AI Open, 2, 225, 10.1016/j.aiopen.2021.08.002 Willis, 1965, The diagnosis and treatment of schizophrenia. A questionnaire study of psychiatric opinion, Br J Psychiatry, 111, 1165, 10.1192/bjp.111.481.1165 Edwards, 1972, Diagnosis of schizophrenia: An Anglo-American comparison, Br J Psychiatry, 120, 385, 10.1192/bjp.120.557.385 Carpenter, 2011, One hundred years, Schizophr Bull, 37, 443, 10.1093/schbul/sbr032 Andreasen, 2007, DSM and the death of phenomenology in America: An example of unintended consequences, Schizophr Bull, 33, 108, 10.1093/schbul/sbl054 Tian, 2020, Sticking to the facts: Confident decoding for faithful data-to-text generation, arXiv Dziri, 2022, On the origin of hallucinations in conversational models: Is it the datasets or the models?, arXiv Xiao, 2021, On hallucination and predictive uncertainty in conditional language generation, arXiv Newman, 2019, Communication-based evaluation for natural language generation, arXiv Dziri, 2022, Evaluating attribution in dialogue systems: The BEGIN benchmark, Trans Assoc Comput Linguist, 10, 1066, 10.1162/tacl_a_00506 Gibson, 2019, How efficiency shapes human language, Trends Cogn Sci, 23, 389, 10.1016/j.tics.2019.02.003 Guan, 2021, Long text generation by modeling sentence-level and discourse-level coherence, arXiv Ouyang, 2022, Training language models to follow instructions with human feedback, arXiv Ma, 2020, A neural network walks into a lab: Towards using deep nets as models for human behavior, arXiv Hoffman, 2011, Using computational patients to evaluate illness mechanisms in schizophrenia, Biol Psychiatry, 69, 997, 10.1016/j.biopsych.2010.12.036 Lillicrap, 2020, Backpropagation and the brain, Nat Rev Neurosci, 21, 335, 10.1038/s41583-020-0277-3 Lake, 2017, Building machines that learn and think like people, Behav Brain Sci, 40, e253, 10.1017/S0140525X16001837