Protocol for Rhapsody: a longitudinal observational study examining the feasibility of speech phenotyping for remote assessment of neurodegenerative and psychiatric disorders

Elliot Hampsey, Marton Meszaros, Caroline Skirrow, Rebecca Strawbridge, Rosie H Taylor, Lazarus Chok, Dag Aarsland, Ammar Al-Chalabi, Ray Chaudhuri, Jack Weston, Emil Fristed, Aleksandra Podlewska, Olabisi Awogbemila, Allan H Young, Elliot Hampsey, Marton Meszaros, Caroline Skirrow, Rebecca Strawbridge, Rosie H Taylor, Lazarus Chok, Dag Aarsland, Ammar Al-Chalabi, Ray Chaudhuri, Jack Weston, Emil Fristed, Aleksandra Podlewska, Olabisi Awogbemila, Allan H Young

Abstract

Introduction: Neurodegenerative and psychiatric disorders (NPDs) confer a huge health burden, which is set to increase as populations age. New, remotely delivered diagnostic assessments that can detect early stage NPDs by profiling speech could enable earlier intervention and fewer missed diagnoses. The feasibility of collecting speech data remotely in those with NPDs should be established.

Methods and analysis: The present study will assess the feasibility of obtaining speech data, collected remotely using a smartphone app, from individuals across three NPD cohorts: neurodegenerative cognitive diseases (n=50), other neurodegenerative diseases (n=50) and affective disorders (n=50), in addition to matched controls (n=75). Participants will complete audio-recorded speech tasks and both general and cohort-specific symptom scales. The battery of speech tasks will serve several purposes, such as measuring various elements of executive control (eg, attention and short-term memory), as well as measures of voice quality. Participants will then remotely self-administer speech tasks and follow-up symptom scales over a 4-week period. The primary objective is to assess the feasibility of remote collection of continuous narrative speech across a wide range of NPDs using self-administered speech tasks. Additionally, the study evaluates if acoustic and linguistic patterns can predict diagnostic group, as measured by the sensitivity, specificity, Cohen's kappa and area under the receiver operating characteristic curve of the binary classifiers distinguishing each diagnostic group from each other. Acoustic features analysed include mel-frequency cepstrum coefficients, formant frequencies, intensity and loudness, whereas text-based features such as number of words, noun and pronoun rate and idea density will also be used.

Ethics and dissemination: The study received ethical approval from the Health Research Authority and Health and Care Research Wales (REC reference: 21/PR/0070). Results will be disseminated through open access publication in academic journals, relevant conferences and other publicly accessible channels. Results will be made available to participants on request.

Trial registration number: NCT04939818.

Keywords: Parkinson's disease; dementia; depression & mood disorders; motor neurone disease.

Conflict of interest statement

Competing interests: RS has received an honorarium for speaking from Lundbeck. In the past 3 years, AY has received honoraria for speaking from AstraZeneca, Lundbeck, Eli Lilly and Sunovion; honoraria for consulting from Allergan, Livanova and Lundbeck, Sunovion and Janssen and research grant support from Janssen. ERH declares no conflicts of interest. EF is CEO of Novoic. MM, JW and CS are employees of Novoic, and EF, MM and JW are shareholders in the company.

© Author(s) (or their employer(s)) 2022. Re-use permitted under CC BY. Published by BMJ.

Figures

Figure 1
Figure 1
Flow diagram of the participant journey in the RHAPSODY study.

References

    1. . Mental health of older adults [Internet], 2021. Available: [Accessed 30 Sep 2021].
    1. Wittenberg R, Hu B, Barraza-Araiza L, et al. . Projections of older people with dementia and costs of dementia care in the United Kingdom, 2019–2040. Care Policy and Evaluation Centre Working Paper 5 2019.
    1. Weir S, Samnaliev M, Kuo T-C, et al. . Short- and long-term cost and utilization of health care resources in Parkinson's disease in the UK. Mov Disord 2018;33:974–81. 10.1002/mds.27302
    1. No health without mental health: a cross-government mental health outcomes strategy for people of all ages 2011.
    1. McCrone P, Dhanasiri S, Patel A, et al. . Paying the price: the cost of mental health care in England to 2026, 2008.
    1. . Overview of the UK population - Office for National Statistics [Internet], 2021. Available: [Accessed 30 Sep 2021].
    1. McKeith I, Mintzer J, Aarsland D, et al. . Dementia with Lewy bodies. Lancet Neurol 2004;3:19–28. 10.1016/s1474-4422(03)00619-7
    1. The Lewy Body Society . A guide to Lewy body dementia, 2019.
    1. O'Brien J, Taylor J, Thomas A. Improving the diagnosis and management of neurodegenerative dementia of Lewy body type in the NHS (DIAMOND-Lewy programme). NIHR Journals Library Publications. 10.17863/CAM.65933
    1. McKeith IG, Rowan E, Askew K, et al. . More severe functional impairment in dementia with Lewy bodies than Alzheimer disease is related to extrapyramidal motor dysfunction. Am J Geriatr Psychiatry 2006;14:582–8. 10.1097/01.JGP.0000216177.08010.f4
    1. Gumber A, Ramaswamy B, Ibbotson R, et al. . Economic, Social and Financial Cost of Parkinson’s on Individuals, Carers and their Families in the UK. Project Report. Centre for Health and Social Care Research, Sheffield Hallam University 2017.
    1. McCrone P, Allcock LM, Burn DJ. Predicting the cost of Parkinson's disease. Mov Disord 2007;22:804–12. 10.1002/mds.21360
    1. Marras C, Chaudhuri KR. Nonmotor features of Parkinson's disease subtypes. Mov Disord 2016;31:1095–102. 10.1002/mds.26510
    1. Gowland A, Opie-Martin S, Scott KM, et al. . Predicting the future of ALS: the impact of demographic change and potential new treatments on the prevalence of ALS in the United Kingdom, 2020-2116. Amyotroph Lateral Scler Frontotemporal Degener 2019;20:264–74. 10.1080/21678421.2019.1587629
    1. Westeneng H-J, Debray TPA, Visser AE, et al. . Prognosis for patients with amyotrophic lateral sclerosis: development and validation of a personalised prediction model. Lancet Neurol 2018;17:423–33. 10.1016/S1474-4422(18)30089-9
    1. Solmi M, Radua J, Olivola M, et al. . Age at onset of mental disorders worldwide: large-scale meta-analysis of 192 epidemiological studies. Mol Psychiatry 2022;27:281-295. 10.1038/s41380-021-01161-7
    1. Kessing LV. Recurrence in affective disorder. British Journal of Psychiatry 1998;172:29–34. 10.1192/bjp.172.1.29
    1. James SL, Abate D, Abate KH, et al. . Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990–2017: a systematic analysis for the global burden of disease study 2017. The Lancet 2018;392:1789–858. 10.1016/S0140-6736(18)32279-7
    1. Fajutrao L, Locklear J, Priaulx J, et al. . A systematic review of the evidence of the burden of bipolar disorder in Europe. Clin Pract Epidemiol Ment Health 2009;5:3.. 10.1186/1745-0179-5-3
    1. Hirschfeld RM. Differential diagnosis of bipolar disorder and major depressive disorder. J Affect Disord 2014;169 Suppl 1:S12–16. 10.1016/S0165-0327(14)70004-7
    1. Dome P, Rihmer Z, Gonda X. Suicide risk in bipolar disorder: a brief review. Medicina 2019;55:403. 10.3390/medicina55080403
    1. Mitchell AJ, Vaze A, Rao S. Clinical diagnosis of depression in primary care: a meta-analysis. The Lancet 2009;374:609–19. 10.1016/S0140-6736(09)60879-5
    1. Vermani M, Marcus M, Katzman MA. Rates of detection of mood and anxiety disorders in primary care. Prim Care Companion CNS Disord 2011. 10.4088/PCC.10m01013
    1. Hohl U, Tiraboschi P, Hansen LA, et al. . Diagnostic accuracy of dementia with Lewy bodies. Arch Neurol 2000;57:347. 10.1001/archneur.57.3.347
    1. Beach TG, Monsell SE, Phillips LE, et al. . Accuracy of the clinical diagnosis of Alzheimer disease at National Institute on aging Alzheimer disease centers, 2005-2010. J Neuropathol Exp Neurol 2012;71:266–73. 10.1097/NEN.0b013e31824b211b
    1. Morselli PL, Elgie R, GAMIAN-Europe . GAMIAN-Europe/BEAM survey I--global analysis of a patient questionnaire circulated to 3450 members of 12 European advocacy groups operating in the field of mood disorders. Bipolar Disord 2003;5:265–78. 10.1034/j.1399-5618.2003.00037.x
    1. Dagani J, Signorini G, Nielssen O, et al. . Meta-Analysis of the interval between the onset and management of bipolar disorder. Can J Psychiatry 2017;62:247–58. 10.1177/0706743716656607
    1. Rasmussen J, Langerman H. Alzheimer's Disease - Why We Need Early Diagnosis. Degener Neurol Neuromuscul Dis 2019;9:123–30. 10.2147/DNND.S228939
    1. Goldman JG, Williams-Gray C, Barker RA, et al. . The spectrum of cognitive impairment in Lewy body diseases. Mov Disord 2014;29:608–21. 10.1002/mds.25866
    1. Aarsland D, Andersen K, Larsen JP, et al. . Prevalence and characteristics of dementia in Parkinson disease: an 8-year prospective study. Arch Neurol 2003;60pp.:387–92. 10.1001/archneur.60.3.387
    1. NHS Digital . Recorded dementia diagnoses. London: NHS England, 2020.
    1. Price A, Farooq R, Yuan J-M, et al. . Mortality in dementia with Lewy bodies compared with Alzheimer's dementia: a retrospective naturalistic cohort study. BMJ Open 2017;7:e017504. 10.1136/bmjopen-2017-017504
    1. Jankovic J. Parkinson’s disease: clinical features and diagnosis. Journal of Neurology, Neurosurgery & Psychiatry 2008;79:368–76. 10.1136/jnnp.2007.131045
    1. Rizek P, Kumar N, Jog MS. An update on the diagnosis and treatment of Parkinson disease. CMAJ 2016;188:1157–65. 10.1503/cmaj.151179
    1. Schrag A, Ben-Shlomo Y, Quinn N. How valid is the clinical diagnosis of Parkinson's disease in the community? J Neurol Neurosurg Psychiatry 2002;73:529–34. 10.1136/jnnp.73.5.529
    1. Sperling RA, Dickerson BC, Pihlajamaki M, et al. . Functional alterations in memory networks in early Alzheimer's disease. Neuromolecular Med 2010;12:27–43. 10.1007/s12017-009-8109-7
    1. Kulisevsky J, Pagonabarraga J. Cognitive impairment in Parkinson's disease: tools for diagnosis and assessment. Mov Disord 2009;24:1103–10. 10.1002/mds.22506
    1. D'Onofrio G, Sancarlo D, Panza F, et al. . Neuropsychiatric symptoms and functional status in Alzheimer's disease and vascular dementia patients. Curr Alzheimer Res 2012;9:759–71. 10.2174/156720512801322582
    1. NICE . Motor neurone disease Briefing paper. London: NICE, 2015.
    1. De Marchi F, Contaldi E, Magistrelli L, et al. . Telehealth in neurodegenerative diseases: opportunities and challenges for patients and physicians. Brain Sci 2021;11:237. 10.3390/brainsci11020237
    1. Patel SY, Mehrotra A, Huskamp HA, et al. . Trends in outpatient care delivery and telemedicine during the COVID-19 pandemic in the US. JAMA Intern Med 2021;181:388. 10.1001/jamainternmed.2020.5928
    1. National Academies of Sciences, Engineering, and Medicine; Health and Medicine Division; Board on Health Sciences Policy; Forum on Drug Discovery, Development, and Translation Shore C, ed. Virtual clinical trials: challenges and opportunities: proceedings of a workshop. National Academies Press (US), 2019.
    1. Cormack F, McCue M, Taptiklis N, et al. . Wearable technology for high-frequency cognitive and mood assessment in major depressive disorder: longitudinal observational study. JMIR Ment Health 2019;6:e12814. 10.2196/12814
    1. Goodday SM, Atkinson L, Goodwin G, et al. . The true colours remote symptom monitoring system: a decade of evolution. J Med Internet Res 2020;22:e15188. 10.2196/15188
    1. Skirrow C, Meszaros M, Meepegama U. Validation of a remote and fully automated story recall task to assess for early cognitive impairment in older adults: a longitudinal case-control observational study. medRXiv 2022. 10.1101/2021.10.12.21264879
    1. Broen MPG, Marsman VAM, Kuijf ML, et al. . Unraveling the relationship between motor symptoms, affective states and contextual factors in Parkinson's disease: a feasibility study of the experience sampling method. PLoS One 2016;11:e0151195. 10.1371/journal.pone.0151195
    1. Omberg L, Chaibub Neto E, Perumal TM, et al. . Remote smartphone monitoring of Parkinson's disease and individual response to therapy. Nat Biotechnol 2022;40:480–7. 10.1038/s41587-021-00974-9
    1. Fristed E, Skirrow C, Meszaros M. Evaluation of a speech-based AI system for early detection of Alzheimer’s disease remotely via smartphones. medRxiv 2021. 10.1101/2021.10.19.21264878
    1. Mueller KD, Hermann B, Mecollari J, et al. . Connected speech and language in mild cognitive impairment and Alzheimer's disease: a review of picture description tasks. J Clin Exp Neuropsychol 2018;40:917–39. 10.1080/13803395.2018.1446513
    1. Codina-Filb J, Escalera S, Escudero J, et al. . Mobile eHealth Platform for Home Monitoring of Bipolar Disorder. In: Springer C, ed. et al. MultiMedia Modeling. MMM 2021. Lecture Notes in Computer Science. 12573, 2021.
    1. Martínez-Nicolás I, Llorente TE, Martínez-Sánchez F, et al. . Ten years of research on automatic voice and speech analysis of people with Alzheimer's disease and mild cognitive impairment: a systematic review article. Front Psychol 2021;12:620251. 10.3389/fpsyg.2021.620251
    1. Low DM, Bentley KH, Ghosh SS. Automated assessment of psychiatric disorders using speech: a systematic review. Laryngoscope Investig Otolaryngol 2020;5:96–116. 10.1002/lio2.354
    1. Smith KM, Caplan DN. Communication impairment in Parkinson's disease: impact of motor and cognitive symptoms on speech and language. Brain Lang 2018;185:38–46. 10.1016/j.bandl.2018.08.002
    1. Sano M, Lapid MI, Ikeda M, et al. . Psychogeriatrics in a world with COVID-19. Int Psychogeriatr 2020;32:1101–5. 10.1017/S104161022000126X
    1. Patel UK, Anwar A, Saleem S, et al. . Artificial intelligence as an emerging technology in the current care of neurological disorders. J Neurol 2021;268:1623–42. 10.1007/s00415-019-09518-3
    1. Boschi V, Catricalà E, Consonni M, et al. . Connected speech in neurodegenerative language disorders: a review. Front Psychol 2017;8:269. 10.3389/fpsyg.2017.00269
    1. Engelman M, Agree EM, Meoni LA, et al. . Propositional density and cognitive function in later life: findings from the precursors study. J Gerontol B Psychol Sci Soc Sci 2010;65pp.:706–11. 10.1093/geronb/gbq064
    1. Fraser KC, Meltzer JA, Rudzicz F. Linguistic features identify Alzheimer's disease in narrative speech. J Alzheimers Dis 2016;49:407–22. 10.3233/JAD-150520
    1. Cummins N, Scherer S, Krajewski J, et al. . A review of depression and suicide risk assessment using speech analysis. Speech Commun 2015;71:10–49. 10.1016/j.specom.2015.03.004
    1. Riley KP, Snowdon DA, Desrosiers MF, et al. . Early life linguistic ability, late life cognitive function, and neuropathology: findings from the Nun study. Neurobiol Aging 2005;26:341–7. 10.1016/j.neurobiolaging.2004.06.019
    1. Cuetos F, Arango-Lasprilla JC, Uribe C, et al. . Linguistic changes in verbal expression: a preclinical marker of Alzheimer's disease. J Int Neuropsychol Soc 2007;13:433–9. 10.1017/S1355617707070609
    1. Snowdon DA, et al. . Linguistic ability in early life and cognitive function from the nun and Alzheimer’s Disease in late life study. JAMA 1996;275:528–32. 10.1001/jama.1996.03530310034029
    1. Hertzog MA. Considerations in determining sample size for pilot studies. Res Nurs Health 2008;31:180–91. 10.1002/nur.20247
    1. Welsh KA, Breitner JC, Magruder-Habib KM. Detection of dementia in the elderly using telephone screening of cognitive status. Neuropsychiatry, Neuropsychology, & Behavioral Neurology 1993;6:103–10.
    1. Albert MS, DeKosky ST, Dickson D, et al. . The diagnosis of mild cognitive impairment due to Alzheimer's disease: recommendations from the National Institute on Aging-Alzheimer's association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimers Dement 2011;7:270–9. 10.1016/j.jalz.2011.03.008
    1. McKeith IG, Boeve BF, Dickson DW, et al. . Diagnosis and management of dementia with Lewy bodies. Neurology 2017;89:88–100. 10.1212/WNL.0000000000004058
    1. Rascovsky K, Hodges JR, Knopman D, et al. . Sensitivity of revised diagnostic criteria for the behavioural variant of frontotemporal dementia. Brain 2011;134:2456–77. 10.1093/brain/awr179
    1. Mesulam MM. Primary progressive aphasia. Ann Neurol 2001;49:425–32.
    1. Román GC, Tatemichi TK, Erkinjuntti T, et al. . Vascular dementia: diagnostic criteria for research studies. Report of the NINDS-AIREN International workshop. Neurology 1993;43:250. 10.1212/WNL.43.2.250
    1. Roche JC, Rojas-Garcia R, Scott KM, et al. . A proposed staging system for amyotrophic lateral sclerosis. Brain 2012;135:847–52. 10.1093/brain/awr351
    1. Hoehn MM, Yahr MD. Parkinsonism: onset, progression and mortality. Neurology 1967;17:427. 10.1212/WNL.17.5.427
    1. Sheehan DV, Lecrubier Y, Sheehan KH, et al. . The Mini-International neuropsychiatric interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry 1998;59 Suppl 20:22-33:34–57.
    1. Guy W. Clinical global impressions, ECDEU assessment manual for psychopharmacology, revised (DHEW Publ. No. ADM 76-338. Rockville: National Institute of Mental Health, 1976: 218–22.
    1. Kroenke K, Spitzer RL, Williams JBW. The PHQ-9. J Gen Intern Med 2001;16:606–13. 10.1046/j.1525-1497.2001.016009606.x
    1. Rush AJ, Carmody T, Reimitz P-E. The inventory of depressive symptomatology (IDS): clinician (IDS-C) and self-report (IDS-SR) ratings of depressive symptoms. Int J Methods Psychiatr Res 2000;9:45–59. 10.1002/mpr.79
    1. Suárez‐González A, Cassani A, Gopalan R. When it is not primary progressive aphasia: a scoping review of spoken language impairment in other neurodegenerative dementias. Alzheimer’s & Dementia: Translational Research & Clinical Interventions 2021;7.
    1. Bora E, Harrison BJ, Yücel M, et al. . Cognitive impairment in euthymic major depressive disorder: a meta-analysis. Psychol Med 2013;43:2017–26. 10.1017/S0033291712002085
    1. Torres IJ, Boudreau VG, Yatham LN. Neuropsychological functioning in euthymic bipolar disorder: a meta-analysis. Acta Psychiatr Scand Suppl 2007;434:17–26. 10.1111/j.1600-0447.2007.01055.x
    1. Bourne C, Aydemir Ö, Balanzá-Martínez V, et al. . Neuropsychological testing of cognitive impairment in euthymic bipolar disorder: an individual patient data meta-analysis. Acta Psychiatr Scand 2013;128:149–62. 10.1111/acps.12133
    1. Spitzer RL, Kroenke K, Williams JBW, et al. . A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med 2006;166:1092. 10.1001/archinte.166.10.1092
    1. Moulton CD, Strawbridge R, Tsapekos D, et al. . The Maudsley 3-item visual analogue scale (M3VAS): validation of a scale measuring core symptoms of depression. J Affect Disord 2021;282:280–3. 10.1016/j.jad.2020.12.185
    1. Altman EG, Hedeker D, Peterson JL, et al. . The Altman self-rating mania scale. Biol Psychiatry 1997;42:948–55. 10.1016/S0006-3223(96)00548-3
    1. Lenain R, Weston J, Shivkumar A, et al. . Surfboard: Audio Feature Extraction for Modern Machine Learning [Internet], 2020. . Available: [Accessed 12 Apr 2022].
    1. Weston J, Lenain R, Meepegama U. &amp. Learning de-identified representations of prosody from raw audio. Proceedings of the 38th International Conference on machine learning, in. Proceedings of Machine Learning Research 2021;139:11145
    1. Qi P, Zhang Y, Zhang Y, et al. . Stanza : A Python Natural Language Processing Toolkit for Many Human Languages [Internet], 2003. Available: [Accessed 12 Apr 2022].
    1. Pedregosa F, Varoquaux G, Gramfort A, et al. . Scikit-learn: Machine Learning in Python [Internet], 2011. Available: [Accessed 12 Apr 2022].
    1. Weston J, Lenain R, Meepegama U. Generative pretraining for paraphrase evaluation, 2022. Available: [Accessed 12 Apr 2022].
    1. Mann HB, Whitney DR. On a test of whether one of two random variables is stochastically larger than the other. The Annals of Mathematical Statistics 1947;18:50–60. 10.1214/aoms/1177730491
    1. Cooper DB, Epker M, Lacritz L, et al. . Effects of practice on category fluency in Alzheimer's disease. Clin Neuropsychol 2001;15:125–8. 10.1076/clin.15.1.125.1914
    1. Cooper D, Lacritz L, Weiner M. Category fluency in mild cognitive impairment. Alzheimer Disease & Associated Disorders 2004;18:120–2.
    1. Besser L, Litvan I, Monsell S. Mild cognitive impairment in Parkinson’s disease versus Alzheimer’s disease. Parkinsonism & Related Disorders 2016;27:54–60.
    1. Semkovska M, Quinlivan L, O'Grady T, et al. . Cognitive function following a major depressive episode: a systematic review and meta-analysis. Lancet Psychiatry 2019;6:851–61. 10.1016/S2215-0366(19)30291-3
    1. Kudlicka A, Clare L, Hindle JV. Executive functions in Parkinson's disease: systematic review and meta-analysis. Mov Disord 2011;26:2305–15. 10.1002/mds.23868
    1. Gurnani A, Gavett B. The Differential Effects of Alzheimer’s Disease and Lewy Body Pathology on Cognitive Performance: a Meta-analysis. Neuropsychology Review 2016;27:1–17.
    1. Beeldman E, Raaphorst J, Klein Twennaar M, et al. . The cognitive profile of ALS: a systematic review and meta-analysis update. Journal of Neurology, Neurosurgery & Psychiatry 2015;87:611–9.
    1. Raucher-Chéné D, Achim AM, Kaladjian A, et al. . Verbal fluency in bipolar disorders: a systematic review and meta-analysis. J Affect Disord 2017;207:359–66. 10.1016/j.jad.2016.09.039
    1. Bauer K, Malek-Ahmadi M. Meta-Analysis of controlled oral word association test (COWAT) Fas performance in amnestic mild cognitive impairment and cognitively unimpaired older adults. Appl Neuropsychol Adult 2021:1–7. 10.1080/23279095.2021.1952590
    1. Piatt AL, Fields JA, Paolo AM, et al. . Action (verb naming) fluency as an executive function measure: convergent and divergent evidence of validity. Neuropsychologia 1999;37:1499–503. 10.1016/S0028-3932(99)00066-4
    1. Beber B, Chaves M. The basis and applications of the action fluency and action naming tasks. Dementia & Neuropsychologia 2014;8:47–57.
    1. Ramos AA, Machado L. A comprehensive meta-analysis on short-term and working memory dysfunction in Parkinson's disease. Neuropsychol Rev 2021;31:288–311. 10.1007/s11065-021-09480-w
    1. Rabi R, Vasquez BP, Alain C, et al. . Inhibitory control deficits in individuals with amnestic mild cognitive impairment: a meta-analysis. Neuropsychol Rev 2020;30:97–125. 10.1007/s11065-020-09428-6
    1. Clarke N, Barrick TR, Garrard P. A Comparison of Connected Speech Tasks for Detecting Early Alzheimer’s Disease and Mild Cognitive Impairment Using Natural Language Processing and Machine Learning. Front Comput Sci 2021;3. 10.3389/fcomp.2021.634360
    1. Goodglass H, Kaplan E. The assessment of aphasia and related disorders. 2nd edn. Philadelphia, PA: Lea and Febiger, 1983.
    1. Nicholas LE, Brookshire RH. A system for quantifying the informativeness and efficiency of the connected speech of adults with aphasia. J Speech Hear Res 1993;36:338–50. 10.1044/jshr.3602.338
    1. Teh EJ, Yap MJ, Liow SJR. PiSCES: pictures with social context and emotional scenes with norms for emotional valence, intensity, and social engagement. Behav Res Methods 2018;50:1793–805. 10.3758/s13428-017-0947-x
    1. Sherratt S, Bryan K. Textual cohesion in oral narrative and procedural discourse: the effects of ageing and cognitive skills. International Journal of Language & Communication Disorders 2018;54:95–109.
    1. Deterding D. The North wind versus a wolf: short texts for the description and measurement of English pronunciation. J Int Phon Assoc 2006;36:187–96. 10.1017/S0025100306002544
    1. Rusz J, Cmejla R, Tykalova T, et al. . Imprecise vowel articulation as a potential early marker of Parkinson's disease: effect of speaking task. J Acoust Soc Am 2013;134:2171–81. 10.1121/1.4816541
    1. Rong P, Yunusova Y, Richburg B, et al. . Automatic extraction of abnormal lip movement features from the alternating motion rate task in amyotrophic lateral sclerosis. Int J Speech Lang Pathol 2018;20:610–23. 10.1080/17549507.2018.1485739

Source: PubMed

3
Suscribir