Situation Model for Situation-Aware Assistance of Dementia Patients in Outdoor Mobility

Kristina Yordanova, Philipp Koldrack, Christina Heine, Ron Henkel, Mike Martin, Stefan Teipel, Thomas Kirste, Kristina Yordanova, Philipp Koldrack, Christina Heine, Ron Henkel, Mike Martin, Stefan Teipel, Thomas Kirste

Abstract

Background: Dementia impairs spatial orientation and route planning, thus often affecting the patient's ability to move outdoors and maintain social activities. Situation-aware deliberative assistive technology devices (ATD) can substitute impaired cognitive function in order to maintain one's level of social activity. To build such a system, one needs domain knowledge about the patient's situation and needs. We call this collection of knowledge situation model.

Objective: To construct a situation model for the outdoor mobility of people with dementia (PwD). The model serves two purposes: 1) as a knowledge base from which to build an ATD describing the mobility of PwD; and 2) as a codebook for the annotation of the recorded behavior.

Methods: We perform systematic knowledge elicitation to obtain the relevant knowledge. The OBO Edit tool is used for implementing and validating the situation model. The model is evaluated by using it as a codebook for annotating the behavior of PwD during a mobility study and interrater agreement is computed. In addition, clinical experts perform manual evaluation and curation of the model.

Results: The situation model consists of 101 concepts with 11 relation types between them. The results from the annotation showed substantial overlapping between two annotators (Cohen's kappa of 0.61).

Conclusion: The situation model is a first attempt to systematically collect and organize information related to the outdoor mobility of PwD for the purposes of situation-aware assistance. The model is the base for building an ATD able to provide situation-aware assistance and to potentially improve the quality of life of PwD.

Keywords: Alzheimer’s disease; assistance; data collection; dementia; knowledge base; mobility limitation; situationawareness.

Figures

Fig.1
Fig.1
The proposed development process for situation models. Figure adapted from [21]. The process consists of domain analysis, conceptualization, implementation, and maintenance. In parallel to these phases, there are two additional processes. These are the evaluation of the results of each phase and their documentation.
Fig.2
Fig.2
Life-space levels as proposed in [29]. Life-space of 0 is limited to the bedroom; Life-space of 1 is limited to the home of the person; Life-space of 2 is limited to the immediate outside of the home; Life-space of 3 is limited to the neighborhood; Life-space of 4 is limited to the town where the person is living; Life-space of 5 is unlimited.
Fig.3
Fig.3
The guided walk. The person with dementia is guided by a psychologist to a tram station, which is 1 km away. The person is then asked to find the way back to the start point on their own.
Fig.4
Fig.4
The identified concepts and the relations between them. Orange indicates the person with dementia, green the interaction the person can execute. The behavior can be normal or challenging (both in dark grey). The rest of the concepts are in light grey, while their subconcepts or concepts identified during the mobility study and interviews are in white. The full list of concepts can be found in the Supplementary Material C and Supplementary Table 1. The implemented situation model can be found in [37] (https://doi.org/10.18453/rosdok_id00000150).

References

    1. Gill TM, Kurland B (2003) The burden and patterns of disability in activities of daily living among community-living older persons. J Gerontol A Biol Sci Med Sci 58A, M70–M75.
    1. Teipel S, Babiloni C, Hoey J, Kaye J, Kirste T, Burmeister OK (2016) Information and communication technology solutions for outdoor navigation in dementia. Alzheimers Dement 12, 695–707.
    1. Hoey J, Poupart P, von Bertoldi A, Craig T, Boutilier C, Mihailidis A (2010) Automated handwashing assistance for persons with dementia using video and a partially observable markov decision process. Comput Vis Image Underst 114, 503–519.
    1. Ertel KA, Glymour MM, Berkman LF (2008) Effects of social integration on preserving memory function in a nationally representative US elderly population. Am J Public Health 98, 1215–1220.
    1. Hughes TF, Flatt JD, Fu B, Chang CH, Ganguli M (2013) Engagement in social activities and progression from mild to severe cognitive impairment: The myhat study. Int Psychogeriatr 25, 587–595.
    1. Kaye J, Matteck N, Hayes T, Austin D, Dodge H (2012) Community life withdrawal with MCI progression. Alzheimers Dement 8, P483.
    1. Kasper E, Ochmann S, Hoffmann W, Schneider W, Cavedo E, Hampel H, Teipel S (2015) Cognitive rehabilitation in Alzheimer’s disease - a conceptual and methodological review. J Prev Alzheimers Dis 2, 142–152.
    1. Brorsson A (2012) Access to everyday activities in public space: Views of people with dementia (PhD thesis). Karolinska Institutet, Stockholm and Sweden.
    1. Patterson DJ, Liao L, Gajos K, Collier M, Livic N, Olson K, Wang S, Fox D, Kautz H (2004) Opportunity knocks: A system to provide cognitive assistance with transportation services In UbiComp 2004: Ubiquitous Computing, Davies N, Mynatt ED, Siio I, eds. Springer, Berlin, Heidelberg, pp. 433–450.
    1. Liao L, Patterson DJ, Fox D, Kautz H (2007) Learning and inferring transportation routines. Artif Intell 171, 311–331.
    1. Kirste T (2001) A reference model for situation-aware assistance Workshop Mensch-Computer-Interaktion in allgegenwärtigen Informationssystemen, Mensch und Computer 2001, Bad Honnef.
    1. Krüger F, Yordanova K, Burghardt C, Kirste T (2012) Towards creating assistive software by employing human behavior models. J Ambient Intell Smart Environ 4, 209–226.
    1. Yordanova K, Bader S, Heine C, Teipel S, Kirste T (2016) Towards a situation model for assessing challenging behaviour of people with dementia Proc Int Workshop Sensor-based Activity Recognition and Interaction. ACM, Rostock, Germany.
    1. Yordanova K, Kirste T (2015) A process for systematic development of symbolic models for activity recognition. ACM Trans Interact Intell Syst 5, 20:1–20:35.
    1. Ye J, Dobson S, McKeever S (2012) Situation identification techniques in pervasive computing: A review. Perv Mob Comp 8, 36–66.
    1. Ye J, Stevenson G, Dobson S (2012) USMART: An unsupervised semantic mining activity recognition technique. ACM Trans Interact Intell Syst 4, 16:1–16:27.
    1. Yordanova K, Kirste T (2016) Learning models of human behaviour from textual instructions Proc Int Conf Agents Artificial Intell, Rome, Italy, pp. 415–422.
    1. Yordanova K (2016) From textual instructions to sensor-based recognition of user behaviour In Comp Pub Int Conf Intelligent User Interfaces. ACM, New York, pp. 67–73.
    1. Yordanova K (2017) TextToHBM: A generalised approach to learning models of human behaviour for activity recognition from textual instructions. AAAI Proc AAAI Workshops. San Francisco, CA.
    1. Yordanova K (2017) Automatic generation of situation models for plan recognition problems Proc Recent Advances in Natural Language Processing, Varna, Bulgaria.
    1. Simperl EPB, Tempich C (2006) Ontology engineering: A reality check In On the Move to Meaningful Internet Systems 2006: CoopIS, DOA, GADA, and ODBASE, Lecture Notes in Computer Science, vol 4275, Meersman R, Tari Z, eds. Springer; Berlin Heidelberg, pp. 836–854.
    1. Webster J, Watson RT (2002) Analyzing the past to prepare for the future: Writing a literature review. MIS Q 26, xiii–xxiii.
    1. vom Brocke J, Simons A, Niehaves B, Riemer K, Plattfaut R, Cleven A (2009) Reconstructing the giant: On the importance of rigour in documenting the literature search process. Verona, Italy, pp. Proc European Conf Inform Syst 2206–2217.
    1. Smith B, Ashburner M, Rosse C, Bard J, Bug W, Ceusters W, Goldberg LJ, Eilbeck K, Ireland A, Mungall CJ, Leontis N, Rocca-Serra P, Ruttenberg A, Sansone S, Scheuermann RH, Shah N, Whetzel PL, Lewis S (2007) The obo foundry: Coordinated evolution of ontologies to support biomedical data integration. Nat Biotechnol 25, 1251–1255.
    1. The National Center for Biomedical Ontology. NCBO bioportal. . Accessed on October 07, 2016.
    1. Deuschl G, Maier W (2009) S3-Leitlinie “Demenzen": Kurzversion.
    1. Morris JC, Heyman A, Mohs RC, Hughes JP, van Belle G, Fillenbaum GDME, Mellits ED, Clark C (1989) The consortium to establish a registry for Alzheimer’s disease (CERAD): I. Clinical and neuropsychological assessment of Alzheimer’s disease. Neurology 39, 1159–1165.
    1. Folstein MF, Folstein SE, McHugh PR (1975) “Mini-mental state”: A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res 12, 189–198.
    1. Peel C, Baker PS, Roth DL, Brown CJ, Bodner EV, Allman RM (2005) Assessing mobility in older adults: The UAB Study of Aging Life-Space Assessment. Phys Ther 85, 1008–1019.
    1. Mayring P (2000) Qualitative content analysis, Forum Qual Soc Res, 1, Art. 20 .
    1. Venkatesh V, Davis FD (2000) A theoretical extension of the technology acceptance model: Four longitudinal field studies. Manage Sci 46, 186–204.
    1. Hoey J, Plötz T, Jackson D, Monk A, Pham C, Olivier P (2011) Rapid specification and automated generation of prompting systems to assist people with dementia. Pervasive Mob Comput 7, 299–318.
    1. McGuinness DL, van Harmelen F (2004) OWL web ontology language overview. W3C Recommendation 10, 2004.
    1. Obrst L, Ceusters W, Mani I, Ray S, Smith B (2007) The evaluation of ontologies In Semantic Web, Baker CJO, Cheung KH, eds. Springer US, Boston, MA, pp. 139–158.
    1. Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33, 159–174.
    1. Kundel HL, Polansky M (2003) Measurement of observer agreement. Radiology 228, 303–308.
    1. Yordanova K, Koldrack P, Heine C, Henkel R, Martin M, Teipel S, Kirste T (2017) Ontology for the outdoor mobility of people with dementia. University Library, University of Rostock.
    1. Sheehan B (2012) Assessment scales in dementia. Ther Adv Neurol Disord 5, 349–358.
    1. Fook VFS, Tay SC, Jayachandran M, Biswas J, Zhang D (2006) An ontology-based context model in monitoring and handling agitation behavior for persons with dementia. PerCom Workshops, IEEE.
    1. Skillen K, Chen L, Nugent CD, Donnelly MP, Solheim I (2012) A user profile ontology based approach for assisting people with dementia in mobile environments. Eng Med Biolog Soc IEEE, 6390–6393.
    1. Baum C, Edwards DF (1993) Cognitive performance in senile dementia of the Alzheimer’s type: The kitchen task assessment. Am J Occup Ther 47, 431–436.
    1. Bouchard B, Giroux S, Bouzouane A (2007) A keyhole plan recognition model for Alzheimer’s patients: First results. Appl Artif Intell 21, 623–658.
    1. Serna A, Pigot H, Rialle V (2007) Modeling the progression of Alzheimer’s disease for cognitive assistance in smart homes. User Model User-adapt Interact 17, 415–438.
    1. Bettcher BM, Giovannetti T, Macmullen L, Libon DJ (2008) Error detection and correction patterns in dementia: A breakdown of error monitoring processes and their neuropsychological correlates. J Neurol Neurosurg Psychiatry 14, 199–208.
    1. Mattson JW, Upper Great Plains Transportation Institute. (2012) Travel Behavior and Mobility of Transportation- disadvantaged Populations: Evidence from the National Household Travel Survey. UGPTI publication; Upper Great Plains Transportation Institute.
    1. Berdier C (2011) An ontology for urban mobility In Ontologies in Urban Development Projects, Advanced Information and Knowledge Processing, Springer, London, pp. 189–196.
    1. Schlenoff C, Messina E (2005) A robot ontology for urban search and rescue Proc ACM Workshop KRAS, ACM, New York, pp. 27–34.
    1. Armand A, Filliat D, Ibanez-Guzman J (2014) Ontology-based context awareness for driving assistance systems. Intelligent Vehicles Symposium, IEEE, pp. 227–233.
    1. Berdier C, Roussey C (2007) Urban Ontologies: The Towntology Prototype towards case studies In: Ontologies for Urban Development, Teller J, Lee JR, Roussey C, eds. Springer-Verlag, Berlin Heidelberg, pp. 143–155.
    1. Saad S, De Beul D, Mahmoudi S, Manneback P (2012) An ontology for video human movement representation based on Benesh notation In 2012 International Conference on Multimedia Computing and Systems (ICMCS). IEEE, pp. 77–82.
    1. El Raheb K, Ioannidis Y (2012) A labanotation based ontology for representing dance movement In Gesture and Sign Language in Human-Computer Interaction and Embodied Communication, Efthimiou E, Kouroupetroglou G, Fotinea SE, eds. Springer, Berlin Heidelberg, pp. 106–117.
    1. Chung H, Kim JM, Byun YC, Byun SY (2005) Retrieving and exploring ontology-based human motion sequences Comput Sci Applications, Springer, pp. 788–797.
    1. Bertini M, Cucchiara R, Del Bimbo A, Torniai C (2005) Video annotation with pictorially enriched ontologies Int Conf Multimedia and Expo, IEEE, pp. 1428–1431.
    1. Zhang S, McCullagh P, Nugent C, Zheng H (2011) An ontology-based context-aware approach for behaviour analysis In: Activity Recognition in Pervasive Intelligent Environments, Chen L, Nugent C, Biswas J, Hoey J, eds. Atlantis Press, pp. 127–148.
    1. Okeyo G, Chen L, Wang H, Sterritt R (2011) Ontology-based learning framework for activity assistance in an adaptive smart home In Activity Recognition in Pervasive Intelligent Environments, Chen L, Nugent C, Biswas J, Hoey J, eds. Atlantis Press, pp. 237–263.
    1. Wongpatikaseree K, Ikeda M, Buranarach M, Supnithi T, Lim AO, Tan Y (2012) Activity recognition using context-aware infrastructure ontology in smart home domain In International Conference on Knowledge, Information and Creativity Support Systems, Melbourne, pp. 50–57.
    1. Krüger F, Nyolt M, Yordanova K, Hein A, Kirste T (2014) Computational state space models for activity and intention recognition. A feasibility study. PLoS One 9, e109381.
    1. Kiefer P, Scheider S, Giannopoulos I, Weiser P (2015) A wayfinding grammar based on reference system transformations In Spatial Information Theory—12th International Conference, COSIT 2015, Fabrikant SI, Raubal M, Bertolotto M, Davies C, Freundschuh SM, Bell S, eds. Santa Fe, NM, pp. 447–467.
    1. Guest AH (2005) Labanotation: The system of analyzing and recording movement, Psychology Press.
    1. Benesh R, Benesh J (1977) Reading dance: The birth of choreology, International Specialized Book Services.

Source: PubMed

Patrocinadores y Colaboradores

Condiciones médicas

Intervenciones de drogas

3
Suscribir