Measuring the Patient Experience of Mental Health Care: A Systematic and Critical Review of Patient-Reported Experience Measures

Sara Fernandes, Guillaume Fond, Xavier Yves Zendjidjian, Karine Baumstarck, Christophe Lançon, Fabrice Berna, Franck Schurhoff, Bruno Aouizerate, Chantal Henry, Bruno Etain, Ludovic Samalin, Marion Leboyer, Pierre-Michel Llorca, Magali Coldefy, Pascal Auquier, Laurent Boyer, French PREMIUM Group, Sara Fernandes, Guillaume Fond, Xavier Yves Zendjidjian, Karine Baumstarck, Christophe Lançon, Fabrice Berna, Franck Schurhoff, Bruno Aouizerate, Chantal Henry, Bruno Etain, Ludovic Samalin, Marion Leboyer, Pierre-Michel Llorca, Magali Coldefy, Pascal Auquier, Laurent Boyer, French PREMIUM Group

Abstract

Background: There is growing concern about measuring patient experience with mental health care. There are currently numerous patient-reported experience measures (PREMs) available for mental health care, but there is little guidance for selecting the most suitable instruments. The objective of this systematic review was to provide an overview of the psychometric properties and the content of available PREMs.

Methods: A comprehensive review following the preferred reporting items for systematic reviews and meta-analysis (PRISMA) guidelines was conducted using the MEDLINE database with no date restrictions. The content of PREMs was analyzed using an inductive qualitative approach, and the methodological quality was assessed according to Pesudovs quality criteria.

Results: A total of 86 articles examining 75 PREMs and totaling 1932 items were included. Only four PREMs used statistical methods from item response theory (IRT). The 1932 items covered seven key mental health care domains: interpersonal relationships (22.6%), followed by respect and dignity (19.3%), access and care coordination (14.9%), drug therapy (14.1%), information (9.6%), psychological care (6.8%) and care environment (6.1%). Additionally, a few items focused on patient satisfaction (6.7%) rather than patient experience. No instrument covered the latent trait continuum of patient experience, as defined by the inductive qualitative approach, and the psychometric properties of the instruments were heterogeneous.

Conclusion: This work is a critical step in the creation of an item library to measure mental health care patient-reported experience that will be used in France to develop, validate, and standardize item banks and computerized adaptive testing (CAT) based on IRT. It will also provide internationally replicable measures that will allow direct comparisons of mental health care systems.

Trial registration: NCT02491866.

Keywords: bipolar disorder; health services research; major depression; patient experience; patient satisfaction; patient-reported experience measures; schizophrenia; systematic review.

Conflict of interest statement

Bruno Aouizerate reports personal fees from Janssen-Cilag, Lilly, Sanofi, and Lundbeck, outside the submitted work. Pierre-Michel Llorca reports personal fees from lundbeck, otsuka, Sanofi, Recordatti, and Gedeon Richter, and personal fees and non-financial support from Janssen, outside the submitted work. The authors report no other possible conflicts of interest in this work.

© 2020 Fernandes et al.

Figures

Figure 1
Figure 1
PRISMA flow chart. Note: Adapted from Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group (2009). Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol. 62(10):1006–1012.

References

    1. Patel V, Saxena S, Lund C, et al. The Lancet Commission on global mental health and sustainable development. Lancet Lond Engl. 2018;392(10157):1553‑98.
    1. Institute of Medicine. Improving the Quality of Health Care for Mental and Substance-Use Conditions. Washington, DC: National Academies Press; 2006.
    1. Lake J, Turner MS. Urgent need for improved mental health care and a more collaborative model of care. Perm J. 2017;21.
    1. Kilbourne AM, Beck K, Spaeth-Rublee B, et al. Measuring and improving the quality of mental health care: a global perspective. World Psychiatry. 2018;17(1):30‑8. doi:10.1002/wps.20482
    1. Fond G, Salas S, Pauly V, et al. End-of-life care among patients with schizophrenia and cancer: a population-based cohort study from the French national hospital database. Lancet Public Health. 2019;4(11):e583‑91. doi:10.1016/S2468-2667(19)30187-2
    1. Fond G, Baumstarck K, Auquier P, et al. Recurrent major depressive disorder’s impact on end-of-life care of cancer: a nationwide study. J Affect Disord. 2020;263:326‑35. doi:10.1016/j.jad.2019.12.003
    1. Piotrowski P, Gondek TM, Królicka-Deręgowska A, Misiak B, Adamowski T, Kiejna A. Causes of mortality in schizophrenia: an updated review of European studies. Psychiatr Danub. 2017;29(2):108‑20.
    1. Viron MJ, Stern TA. The impact of serious mental illness on health and healthcare. Psychosomatics. 2010;51(6):458‑65. doi:10.1016/S0033-3182(10)70737-4
    1. Kessler RC, Berglund PA, Bruce ML, et al. The prevalence and correlates of untreated serious mental illness. Health Serv Res. 2001;36(6 Pt 1):987‑1007.
    1. Packness A, Halling A, Simonsen E, Waldorff FB, Hastrup LH. Are perceived barriers to accessing mental healthcare associated with socioeconomic position among individuals with symptoms of depression? Questionnaire-results from the Lolland-Falster Health Study, a rural Danish population study. BMJ Open. 2019;9(3):e023844. doi:10.1136/bmjopen-2018-023844
    1. Wang PS, Demler O, Kessler RC. Adequacy of treatment for serious mental illness in the United States. Am J Public Health. 2002;92(1):92‑8. doi:10.2105/AJPH.92.1.92
    1. Drapalski AL, Milford J, Goldberg RW, Brown CH, Dixon LB. Perceived barriers to medical care and mental health care among veterans with serious mental illness. Psychiatr Serv Wash DC. 2008;59(8):921‑4.
    1. Kohn R, Saxena S, Levav I, Saraceno B. The treatment gap in mental health care. Bull World Health Organ. 2004;82(11):858‑66.
    1. Tran LD, Ponce NA. Who gets needed mental health care? Use of mental health services among adults with mental health need in California. Californian J Health Promot. 2017;15(1):36‑45.
    1. Coldefy M, Le Neindre C Les disparités territoriales d’offre et d’organisation des soins en psychiatrie en France: d’une vision segmentée à une approche systémique. Report n°558. Paris: Institut de Recherche et Documentation en Economie de la Santé (IRDES); 2014.
    1. Clement S, Brohan E, Jeffery D, Henderson C, Hatch SL, Thornicroft G. Development and psychometric properties the Barriers to Access to Care Evaluation scale (BACE) related to people with mental ill health. BMC Psychiatry. 2012;12:36. doi:10.1186/1471-244X-12-36
    1. Knaak S, Mantler E, Szeto A. Mental illness-related stigma in healthcare: barriers to access and care and evidence-based solutions. Healthc Manage Forum. 2017;30(2):111‑6. doi:10.1177/0840470416679413
    1. Thornicroft G. Stigma and discrimination limit access to mental health care. Epidemiol Psichiatr Soc. 2008;17(1):14‑9. doi:10.1017/S1121189X00002621
    1. Fond G, Boyer L, Boucekine M, et al. Validation study of the medication adherence rating scale. Results from the FACE-SZ national dataset. Schizophr Res. 2017;182:84‑9. doi:10.1016/j.schres.2016.10.023
    1. Wang DE, Tsugawa Y, Figueroa JF, Jha AK. Association between the centers for medicare and medicaid services hospital star rating and patient outcomes. JAMA Intern Med. 2016;176(6):848‑50. doi:10.1001/jamainternmed.2016.0784
    1. Trzeciak S, Gaughan JP, Bosire J, Mazzarelli AJ. Association between medicare summary star ratings for patient experience and clinical outcomes in US hospitals. J Patient Exp. 2016;3(1):6‑9. doi:10.1177/2374373516667002
    1. Jenkinson C, Coulter A, Bruster S, Richards N, Chandola T. Patients’ experiences and satisfaction with health care: results of a questionnaire study of specific aspects of care. Qual Saf Health Care. 2002;11(4):335‑9. doi:10.1136/qhc.11.4.335
    1. Fernandes S, Fond G, Zendjidjian X, et al. The patient-reported experience measure for improving qUality of care in Mental health (PREMIUM) project in France: study protocol for the development and implementation strategy. Patient Prefer Adherence. 2019;13:165‑77. doi:10.2147/PPA.S172100
    1. Kingsley C, Patel S. Patient-reported outcome measures and patient-reported experience measures. BJA Educ. 2017;17(4):137‑44. doi:10.1093/bjaed/mkw060
    1. Gleeson H, Calderon A, Swami V, Deighton J, Wolpert M, Edbrooke-Childs J. Systematic review of approaches to using patient experience data for quality improvement in healthcare settings. BMJ Open. 2016;6(8):e011907. doi:10.1136/bmjopen-2016-011907
    1. Coulter A, Fitzpatrick R, Cornwell J. The Point of Care Measures of Patients’ Experience in Hospital: Purpose, Methods and Uses. London, UK: The King’s Fund; 2009.
    1. Christalle E, Zeh S, Hahlweg P, Kriston L, Härter M, Scholl I. Assessment of patient centredness through patient-reported experience measures (ASPIRED): protocol of a mixed-methods study. BMJ Open. 2018;8(10):e025896. doi:10.1136/bmjopen-2018-025896
    1. Anhang Price R, Elliott MN, Zaslavsky AM, et al. Examining the role of patient experience surveys in measuring health care quality. Med Care Res Rev MCRR. 2014;71(5):522‑54. doi:10.1177/1077558714541480
    1. Doyle C, Lennox L, Bell D. A systematic review of evidence on the links between patient experience and clinical safety and effectiveness. BMJ Open. 2013;3(1):e001570. doi:10.1136/bmjopen-2012-001570
    1. Manary MP, Boulding W, Staelin R, Glickman SW. The patient experience and health outcomes. N Engl J Med. 2013;368(3):201‑3. doi:10.1056/NEJMp1211775
    1. Loh A, Leonhart R, Wills CE, Simon D, Härter M. The impact of patient participation on adherence and clinical outcome in primary care of depression. Patient Educ Couns. 2007;65(1):69‑78. doi:10.1016/j.pec.2006.05.007
    1. Boyer L, Baumstarck-Barrau K, Cano N, et al. Assessment of psychiatric inpatient satisfaction: a systematic review of self-reported instruments. Eur Psychiatry J Assoc Eur Psychiatr. 2009;24(8):540‑9.
    1. Miglietta E, Belessiotis-Richards C, Ruggeri M, Priebe S. Scales for assessing patient satisfaction with mental health care: a systematic review. J Psychiatr Res. 2018;100:33‑46. doi:10.1016/j.jpsychires.2018.02.014
    1. Sanchez-Balcells S, Callarisa Roca M, Rodriguez-Zunino N, Puig-Llobet M, Lluch-Canut M-T, Roldan-Merino JF. Psychometric properties of instruments measuring quality and satisfaction in mental health: a systematic review. J Adv Nurs. 2018;74(11):2497‑510. doi:10.1111/jan.13813
    1. Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol. 2009;62(10):1006–1012. doi:10.1016/j.jclinepi.2009.06.005
    1. Gerteis M, Edgman-Levitan S, Daley J, Delbanco TL. Through the Patient’s Eyes: Understanding and Promoting Patient-Centered Care. 1st ed. San Francisco, CA: Jossey-Bass; 1993.
    1. Valentine NB, de Silva A, Kawabata K, Darby C, Murray CJL, Evans DB. Health system responsiveness: concepts, domains and operationalization In: Murray CJL, Evans DB, editors. Health Systems Performance Assessment: Debates, Methods, and Empiricism. Geneva, Switzerland: World Health Organization; 2003:573–596.
    1. Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107‑15. doi:10.1111/j.1365-2648.2007.04569.x
    1. Bruyneel L, Van Houdt S, Coeckelberghs E, et al. Patient experiences with care across various types of mental health care: questionnaire development, measurement invariance, and patients’ reports. Int J Methods Psychiatr Res. 2018;27:1. doi:10.1002/mpr.1592
    1. Pesudovs K, Burr JM, Harley C, Elliott DB. The development, assessment, and selection of questionnaires. Optom Vis Sci. 2007;84(8):663‑74. doi:10.1097/OPX.0b013e318141fe75
    1. Male L, Noble A, Atkinson J, Marson T. Measuring patient experience: a systematic review to evaluate psychometric properties of patient reported experience measures (PREMs) for emergency care service provision. Int J Qual Health Care. 2017;29(3):314‑26. doi:10.1093/intqhc/mzx027
    1. Oades LG, Law J, Marshall SL. Development of a consumer constructed scale to evaluate mental health service provision: consumer constructed scale. J Eval Clin Pract. 2011;17(6):1102‑7. doi:10.1111/j.1365-2753.2010.01474.x
    1. Aloba O, Mapayi B, Akinsulore S, Ukpong D, Fatoye O. Trust in physician scale: factor structure, reliability, validity and correlates of trust in a sample of Nigerian psychiatric outpatients. Asian J Psychiatry. 2014;11:20‑7. doi:10.1016/j.ajp.2014.05.005
    1. Anderson LA, Dedrick RF. Development of the trust in physician scale: a measure to assess interpersonal trust in patient-physician relationships. Psychol Rep. 1990;67(3 Pt 2):1091‑100.
    1. Atkinson M, Sinha A, Hass S, et al. Validation of a general measure of treatment satisfaction, the treatment satisfaction questionnaire for medication (TSQM), using a national panel study of chronic disease. Health Qual Life Outcomes. 2004;2:12. doi:10.1186/1477-7525-2-12
    1. Baker R. Development of a questionnaire to assess patients’ satisfaction with consultations in general practice. Br J Gen Pract J R Coll Gen Pract. 1990;40(341):487‑90.
    1. Barker D, Shergill S, Higginson I, Orrell M. Patient’s views towards care received from psychiatrists. Br J Psychiatry J Ment Sci. 1996;168(5):641‑6. doi:10.1192/bjp.168.5.641
    1. Barker DA, Orrell MW. The psychiatric care satisfaction questionnaire: a reliability and validity study. Soc Psychiatry Psychiatr Epidemiol. 1999;34(2):111‑6. doi:10.1007/s001270050120
    1. Berghofer G, Castille DM, Link B. Evaluation of client services (ECS): a measure of treatment satisfaction for people with chronic mental illnesses. Community Ment Health J. 2011;47(4):399‑407. doi:10.1007/s10597-010-9331-3
    1. Blais M, Matthews J, Lipkis-Orlando R, et al. Development and application of a brief multi-faceted tool for evaluating inpatient psychiatric care. Adm Policy Ment Health. 2002;30(2):159‑72. doi:10.1023/A:1022537218940
    1. Brunero S, Lamont S, Fairbrother G. Using and understanding consumer satisfaction to effect an improvement in mental health service delivery. J Psychiatr Ment Health Nurs. 2009;16(3):272‑8. doi:10.1111/j.1365-2850.2008.01371.x
    1. Bramesfeld A, Klippel U, Seidel G, Schwartz FW, Dierks ML. How do patients expect the mental health service system to act? Testing the WHO responsiveness concept for its appropriateness in mental health care. Soc Sci Med. 2007;65(5):880‑9. doi:10.1016/j.socscimed.2007.03.056
    1. Caruso R, Grassi L, Biancosino B, et al. Exploration of experiences in therapeutic groups for patients with severe mental illness: development of the Ferrara group experiences scale (FE- GES). BMC Psychiatry. 2013;13:242. doi:10.1186/1471-244X-13-242
    1. Eisen S, Shaul J, Leff H, Stringfellow V, Clarridge B, Cleary P. Toward a national consumer survey: evaluation of the CABHS and MHSIP instruments. J Behav Health Serv Res. 2001;28(3):347‑69. doi:10.1007/BF02287249
    1. Eisen SV, Shaul JA, Clarridge B, Nelson D, Spink J, Cleary PD. Development of a consumer survey for behavioral health services. Psychiatr Serv. 1999;50(6):793‑8. doi:10.1176/ps.50.6.793
    1. Eisen SV, Wilcox M, Idiculla T, Speredelozzi A, Dickey B. Assessing consumer perceptions of inpatient psychiatric treatment: the perceptions of care survey. JT Comm J Qual Improv. 2002;28(9):510‑26. doi:10.1016/s1070-3241(02)28021-9
    1. Eton D, Ridgeway J, Egginton J. et al. Finalizing a measurement framework for the burden of treatment in complex patients with chronic conditions. Patient Relat Outcome Meas;2015. 117. doi:10.2147/PROM.S78955
    1. Eton DT, Yost KJ, Lai J-S, et al. Development and validation of the Patient Experience with Treatment and Self-management (PETS): a patient-reported measure of treatment burden. Qual Life Res. 2017;26(2):489‑503. doi:10.1007/s11136-016-1397-0
    1. Evans J, Rose D, Flach C, et al. VOICE: developing a new measure of service users’ perceptions of inpatient care, using a participatory methodology. J Ment Health. 2012;21(1):57‑71. doi:10.3109/09638237.2011.629240
    1. Forouzan AS, Rafiey H, Padyab M, Ghazinour M, Dejman M, Sebastian MS. Reliability and validity of a mental health system responsiveness questionnaire in Iran. Glob Health Action. 2014;7(1):24748. doi:10.3402/gha.v7.24748
    1. Garratt AM, Bjørngaard JH, Dahle KA, Bjertnæs ØA, Saunes IS, Ruud T. The Psychiatric Out-Patient Experiences Questionnaire (POPEQ): data quality, reliability and validity in patients attending 90 Norwegian clinics. Nord J Psychiatry. 2006;60(2):89‑96. doi:10.1080/08039480600583464
    1. Olsen RV, Garratt AM, Iversen HH, Bjertnaes OA. Rasch analysis of the Psychiatric Out-Patient Experiences Questionnaire (POPEQ). BMC Health Serv Res. 2010;10:282. doi:10.1186/1472-6963-10-282
    1. Gensichen J, Serras A, Paulitsch MA, et al. The Patient Assessment of Chronic Illness Care questionnaire: evaluation in patients with mental disorders in primary care. Community Ment Health J. 2011;47(4):447‑53. doi:10.1007/s10597-010-9340-2
    1. Gigantesco A. Quality of psychiatric care: validation of an instrument for measuring inpatient opinion. Int J Qual Health Care. 2003;15(1):73‑8. doi:10.1093/intqhc/15.1.73
    1. Glick I, Burti L, Suzuki K, Sacks M. Effectiveness in psychiatric care. I. A cross-national study of the process of treatment and outcomes of major depressive disorder. J Nerv Ment Dis. 1991;179(2):55‑63. doi:10.1097/00005053-199102000-00001
    1. Hansson L, Höglund E. Patient satisfaction with psychiatric services: the development, reliability, and validity of two patient-satisfaction questionnaires for use in inpatient and outpatient setting. Nord J Psychiatry. 1995;49(4):257‑62. doi:10.3109/08039489509011915
    1. Hester L, O’ Doherty LJ, Schnittger R, et al. SEQUenCE: a service user-centred quality of care instrument for mental health services. Int J Qual Health Care. 2015;27(4):284‑90. doi:10.1093/intqhc/mzv043
    1. Howard PB, Clark JJ, Rayens MK, Hines-Martin V, Weaver P, Littrell R. Consumer satisfaction with services in a regional psychiatric hospital: a collaborative research project in Kentucky. Arch Psychiatr Nurs. 2001;15(1):10‑23. doi:10.1053/apnu.2001.20577
    1. Ivarsson B, Malm U. Self-reported consumer satisfaction in mental health services: validation of a self-rating version of the UKU-consumer satisfaction rating scale. Nord J Psychiatry. 2007;61(3):194‑200. doi:10.1080/08039480701352488
    1. Ahlfors UG, Lewander T, Lindström E, Malt UF, Lublin H, Malm U. Assessment of patient satisfaction with psychiatric care. Development and clinical evaluation of a brief consumer satisfaction rating scale (UKU-ConSat). Nord J Psychiatry. 2001;55 Suppl 44:71‑90.
    1. Jenkinson C, Coulter A, Bruster S. The Picker Patient Experience questionnaire: development and validation using data from in-patient surveys in five countries. Int J Qual Health Care. 2002;14(5):353‑8. doi:10.1093/intqhc/14.5.353
    1. Joyce AS, Adair CE, Wild TC, et al. Continuity of care: validation of a self-report measure to assess client perceptions of mental health Service Delivery. Community Ment Health J. 2010;46(2):192‑208. doi:10.1007/s10597-009-9215-6
    1. Kertesz SG, Pollio DE, Jones RN, et al. Development of the Primary Care Quality-Homeless (PCQ-H) instrument: a practical survey of homeless patients’ experiences in primary care. Med Care. 2014;52(8):734‑42. doi:10.1097/MLR.0000000000000160
    1. Kolb SJ, Race KE, Seibert JH. Psychometric evaluation of an inpatient psychiatric care consumer satisfaction survey. J Behav Health Serv Res. 2000;27(1):75‑86. doi:10.1007/BF02287805
    1. Larsen DL, Attkisson CC, Hargreaves WA, Nguyen TD. Assessment of client/patient satisfaction: development of a general scale. Eval Program Plann. 1979;2(3):197‑207. doi:10.1016/0149-7189(79)90094-6
    1. Lelliott P, Beevor A, Hogman G, Hyslop J, Lathlean J, Ward M. Carers’ and users’ expectations of services – user version (CUES–U): a new instrument to measure the experience of users of mental health services. Br J Psychiatry. 2001;179:67‑72. doi:10.1192/bjp.179.1.67
    1. Blenkiron P. What determines patients’ satisfaction with their mental health care and quality of life? Postgrad Med J. 2003;79(932):337‑40. doi:10.1136/pmj.79.932.337
    1. Lloyd-Evans B, Slade M, Osborn DP, Skinner R, Johnson S. Developing and comparing methods for measuring the content of care in mental health services. Soc Psychiatry Psychiatr Epidemiol. 2011;46(3):219‑29. doi:10.1007/s00127-010-0192-4
    1. MacInnes D, Beer D, Keeble P, Rees D, Reid L. The development of a tool to measure service user satisfaction with in-patient forensic services: the Forensic Satisfaction Scale. J Ment Health. 2010;19(3):272‑81. doi:10.3109/09638231003728133
    1. Madan A, Fowler JC, Allen JG, et al. Assessing and addressing patient satisfaction in a longer-term inpatient psychiatric hospital: preliminary findings on the Menninger Quality of Care measure and methodology. Qual Manag Health Care. 2014;23(3):178‑87. doi:10.1097/QMH.0000000000000034
    1. Mavaddat N, Lester HE, Tait L. Development of a patient experience questionnaire for primary care mental health. Qual Saf Health Care. 2009;18(2):147‑52. doi:10.1136/qshc.2007.023143
    1. Mayston R, Habtamu K, Medhin G, et al. Developing a measure of mental health service satisfaction for use in low income countries: a mixed methods study. BMC Health Serv Res. 2017;17(1):183. doi:10.1186/s12913-017-2126-2
    1. McGuire-Snieckus R, McCabe R, Catty J, Hansson L, Priebe S. A new scale to assess the therapeutic relationship in community mental health care: STAR. Psychol Med. 2007;37(1):85. doi:10.1017/S0033291706009299
    1. Meehan T, Bergen H, Stedman T. Monitoring consumer satisfaction with inpatient service delivery: the inpatient evaluation of service questionnaire. Aust N Z J Psychiatry. 2002;36(6):807‑11. doi:10.1046/j.1440-1614.2002.01094.x
    1. Misdrahi D, Verdoux H, Lançon C, Bayle F. The 4-point ordinal alliance self-report: a self-report questionnaire for assessing therapeutic relationships in routine mental health. Compr Psychiatry. 2009;50(2):181‑5. doi:10.1016/j.comppsych.2008.06.010
    1. Moutoussis M, Gilmour F, Barker D, Orrel MW. Quality of care in a psychiatric out-patient department. J Ment Health. 2000;9(4):409‑20. doi:10.1080/713680257
    1. Nabati L, Shea N, McBride L, Gavin C, Bauer MS. Adaptation of a simple patient satisfaction instrument to mental health: psychometric properties. Psychiatry Res. 1998;77(1):51‑6. doi:10.1016/S0165-1781(97)00122-4
    1. Nordon C, Falissard B, Gerard S, et al. Patient satisfaction with psychotropic drugs: validation of the PAtient SAtisfaction with Psychotropic (PASAP) scale in patients with bipolar disorder. Eur Psychiatry. 2014;29(3):183‑90. doi:10.1016/j.eurpsy.2013.03.001
    1. Rose G, Beale I, Malone J, Kinkead S, Higgin J. Validity of a scale for consumer evaluation of mental health service delivery. Int J Pers Centered Med. 2011;1(4):733‑40.
    1. Ortiz G, Schacht L. Psychometric evaluation of an inpatient consumer survey measuring satisfaction with psychiatric care. The Patient. 2012;5(3):163‑73.
    1. Parker G, Wright M, Robertson S, Gladstone G. The development of a patient satisfaction measure for psychiatric outpatients. Aust N Z J Psychiatry. 1996;30(3):343‑9. doi:10.3109/00048679609064997
    1. Pellegrin KL, Stuart GW, Maree B, Frueh BC, Ballenger JC. A brief scale for assessing patients’ satisfaction with Care in outpatient psychiatric services. Psychiatr Serv. 2001;52(6):816‑9. doi:10.1176/appi.ps.52.6.816
    1. Perreault M, Katerelos T, Sabourin S, Leichner P, Desmarais J. Information as a distinct dimension for satisfaction assessment of outpatient psychiatric services. Int J Health Care Qual Assur Inc Leadersh Health Serv. 2001;14(2‑3):111‑20.
    1. Perreault M, Katerelos TE, Tardif H, Pawliuk N. Patients’ perspectives on information received in outpatient psychiatry. J Psychiatr Ment Health Nurs. 2006;13(1):110‑6. doi:10.1111/j.1365-2850.2006.00928.x
    1. Peytremann-Bridevaux I, Scherer F, Peer L, et al. Satisfaction of patients hospitalised in psychiatric hospitals: a randomised comparison of two psychiatric-specific and one generic satisfaction questionnaires. BMC Health Serv Res. 2006;6:108. doi:10.1186/1472-6963-6-108
    1. Phattharayuttawat S, Ngamthipwatthana T. The development of the Thai Psychiatric Satisfaction Scale. J Med Assoc Thail Chotmaihet Thangphaet. 2005;88(8):1067‑76.
    1. Priebe S, Gruyters T. The role of the helping alliance in psychiatric community care. A prospective study. J Nerv Ment Dis. 1993;181(9):552‑7. doi:10.1097/00005053-199309000-00004
    1. Rofail D, Gray R, Gournay K. The development and internal consistency of the satisfaction with antipsychotic medication scale. Psychol Med. 2005;35(7):1063‑72. doi:10.1017/S0033291705004526
    1. Rose D, Sweeney A, Leese M, et al. Developing a user-generated measure of continuity of care: brief report. Acta Psychiatr Scand. 2009;119(4):320‑4. doi:10.1111/j.1600-0447.2008.01296.x
    1. Rossberg JI, Friis S. Do the spontaneity and anger and aggression subscales of the ward atmosphere scale form homogeneous dimensions? A cross-sectional study of 54 wards for psychotic patients. Acta Psychiatr Scand. 2003;107(2):118‑23. doi:10.1034/j.1600-0447.2003.02082.x
    1. Rossberg JI, Friis S. A suggested revision of the Ward Atmosphere Scale. Acta Psychiatr Scand. 2003;108(5):374‑80. doi:10.1034/j.1600-0447.2003.00191.x
    1. Ruggeri M, Lasalvia A, Dall’Agnola R, et al. Development, internal consistency and reliability of the Verona Service Satisfaction Scale–European version. EPSILON Study 7. European psychiatric services: inputs linked to outcome domains and needs. Br J Psychiatry Suppl. 2000;177(39):S41‑48. doi:10.1192/bjp.177.39.s41
    1. Rush B, Hansson E, Cvetanova Y, Rotondi N, Furlong A, Behrooz R. Development of a Client Perception of Care Tool for Mental Health and Addictions: Qualitative, Quantitative, and Psychometric Analysis. Final Report for the Ministry of Health and Long‐Term Care. Toronto, Canada: Health Systems and Health Equity Research, Centre for Addiction and Mental Health; 2013.
    1. Schalast N, Redies M, Collins M, Stacey J, Howells K. EssenCES, a short questionnaire for assessing the social climate of forensic psychiatric wards. Crim Behav Ment Health. 2008;18(1):49‑58. doi:10.1002/cbm.677
    1. Schröder A, Wilde Larsson B, Ahlström G. Quality in psychiatric care: an instrument evaluating patients’ expectations and experiences. Int J Health Care Qual Assur. 2007;20(2):141‑60. doi:10.1108/09526860710731834
    1. Schröder A, Wilde Larsson B, Ahlström G, Lundqvist L. Psychometric properties of the instrument quality in psychiatric care and descriptions of quality of care among in‐patients. Int J Health Care Qual Assur. 2010;23(6):554‑70. doi:10.1108/09526861011060924
    1. Schröder A, Ahlström G, Wilde-Larsson B, Lundqvist L-O. Psychometric properties of the Quality in Psychiatric Care - Outpatient (QPC-OP) instrument. Int J Ment Health Nurs. 2011;20(6):445‑53. doi:10.1111/j.1447-0349.2011.00741.x
    1. Shiva A, Haden S, Brooks J. Forensic and civil psychiatric inpatients: development of the inpatient satisfaction questionnaire. J Am Acad Psychiatry Law. 2009;37(2):201‑13.
    1. Slade M, Jordan H, Clarke E, et al. The development and evaluation of a five-language multi-perspective standardised measure: clinical decision-making involvement and satisfaction (CDIS). BMC Health Serv Res. 2014;14:323. doi:10.1186/1472-6963-14-323
    1. Slater V, Linn M, Harris R. A satisfaction with mental health care scale. Compr Psychiatry. 1982;23(1):68‑74. doi:10.1016/0010-440X(82)90010-4
    1. Speckens A, Spinhoven P, Van Hemert A, Bolk J. The Reassurance Questionnaire (RQ): psychometric properties of a self-report questionnaire to assess reassurability. Psychol Med. 2000;30(4):841‑7. doi:10.1017/S0033291799002378
    1. Svedberg P, Svensson B, Arvidsson B, Hansson L. The construct validity of a self-report questionnaire focusing on health promotion interventions in mental health services. J Psychiatr Ment Health Nurs. 2007;14(6):566‑72. doi:10.1111/j.1365-2850.2007.01129.x
    1. Svedberg P, Arvidsson B, Svensson B, Hansson L. Psychometric characteristics of a self-report questionnaire (HPIQ) focusing on health promotion interventions in mental health services. Int J Ment Health Nurs. 2008;17(3):171‑9. doi:10.1111/j.1447-0349.2008.00527.x
    1. Uijen AA, Schellevis FG, van den Bosch WJHM, Mokkink HGA, van Weel C, Schers HJ. Nijmegen Continuity Questionnaire: development and testing of a questionnaire that measures continuity of care. J Clin Epidemiol. 2011;64(12):1391‑9. doi:10.1016/j.jclinepi.2011.03.006
    1. Uijen AA, Schers HJ, Schellevis FG, Mokkink HG, van Weel C, van den Bosch WJ. Measuring continuity of care: psychometric properties of the Nijmegen Continuity Questionnaire. Br J Gen Pract. 2012;62(600):e949‑57. doi:10.3399/bjgp12X652364
    1. Ul-haq I. Patients’ satisfaction with a psychiatric day hospital in the West Galway catchments area. Ir J Psychol Med. 2012;29(2):85‑90. doi:10.1017/S0790966700017353
    1. Ware N, Dickey B, Tugenberg T, McHorney C. CONNECT: a measure of continuity of care in mental health services. Ment Health Serv Res. 2003;5(4):209‑21. doi:10.1023/A:1026276918081
    1. Webster S. Patients’ satisfaction with mental health nursing interventions in the management of anxiety: results of a questionnaire study. J Nurs Educ Pract. 2012;2(2):52‑62.
    1. Wongpakaran T, Wongpakaran N, Intachote-Sakamoto R, Boripuntakul T. The Group Cohesiveness Scale (GCS) for psychiatric inpatients. Perspect Psychiatr Care. 2013;49(1):58‑64. doi:10.1111/j.1744-6163.2012.00342.x
    1. Woodring S, Polomano RC, Haagen BF, et al. Development and testing of patient satisfaction measure for inpatient psychiatry care. J Nurs Care Qual. 2004;19(2):137‑48. doi:10.1097/00001786-200404000-00011
    1. Zendjidjian XY, Auquier P, Lançon C, et al. The SATISPSY-22: development and validation of a French hospitalized patients’ satisfaction questionnaire in psychiatry. Eur Psychiatry. 2015;30(1):172‑8. doi:10.1016/j.eurpsy.2014.04.002
    1. Zimmerman M, Gazarian D, Multach M, et al. A clinically useful self-report measure of psychiatric patients’ satisfaction with the initial evaluation. Psychiatry Res. 2017;252:38‑44. doi:10.1016/j.psychres.2017.02.036
    1. Bjertnaes O, Iversen HH, Kjollesdal J. PIPEQ-OS–an instrument for on-site measurements of the experiences of inpatients at psychiatric institutions. BMC Psychiatry. 2015;15:234. doi:10.1186/s12888-015-0621-8
    1. Ruggeri M, Dall’Agnola R. The development and use of the Verona Expectations for Care Scale (VECS) and the Verona Service Satisfaction Scale (VSSS) for measuring expectations and satisfaction with community-based psychiatric services in patients, relatives and professionals. Psychol Med. 1993;23(2):511‑23. doi:10.1017/S0033291700028609
    1. Wright SM, Craig T, Campbell S, Schaefer J, Humble C. Patient satisfaction of female and male users of veterans health administration services. J Gen Intern Med. 2006;21(Suppl 3):S26‑32. doi:10.1111/j.1525-1497.2006.00371.x
    1. Tavakol M, Dennick R. Making sense of Cronbach’s alpha. Int J Med Educ. 2011;2:53‑5. doi:10.5116/ijme.4dfb.8dfd
    1. Bjertnaes OA, Sjetne IS, Iversen HH. Overall patient satisfaction with hospitals: effects of patient-reported experiences and fulfilment of expectations. BMJ Qual Saf. 2012;21(1):39‑46. doi:10.1136/bmjqs-2011-000137
    1. Bolarinwa O. Principles and methods of validity and reliability testing of questionnaires used in social and health science researches. Niger Postgrad Med J. 2015;22(4):195. doi:10.4103/1117-1936.173959
    1. Streiner DL, Norman GR, Cairney J. Health Measurement Scales: A Practical Guide to Their Development and Use. 5th ed. Oxford, England: Oxford University Press; 2015.
    1. LaVela SL, Gallan AS. Evaluation and measurement of patient experience. Patient Exp J. 2014;1:1.
    1. Bleich SN, Ozaltin E, Murray CKL. How does satisfaction with the health-care system relate to patient experience? Bull World Health Organ. 2009;87(4):271‑8. doi:10.2471/BLT.07.050401
    1. Crow R, Gage H, Hampson S, et al. The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. Health Technol Assess Winch Engl. 2002;6(32):1‑244.
    1. Sofaer S, Firminger K. Patient perceptions of the quality of health services. Annu Rev Public Health. 2005;26:513‑59. doi:10.1146/annurev.publhealth.25.050503.153958
    1. Vuori H. Patient satisfaction—an attribute or indicator of the quality of care? QRB - Qual Rev Bull. 1987;13(3):106‑8. doi:10.1016/S0097-5990(16)30116-6
    1. Cleary PD, McNeil BJ. Patient satisfaction as an indicator of quality care. Inq J Med Care Organ Provis Financ. 1988;25(1):25‑36.
    1. Williams B, Coyle J, Healy D. The meaning of patient satisfaction: an explanation of high reported levels. Soc Sci Med. 1998;47(9):1351‑9. doi:10.1016/S0277-9536(98)00213-5
    1. Sitzia J. How valid and reliable are patient satisfaction data? An analysis of 195 studies. Int J Qual Health Care J Int Soc Qual Health Care. 1999;11(4):319‑28.
    1. Fitzpatrick R, Hopkins A. Problems in the conceptual framework of patient satisfaction research: an empirical exploration. Sociol Health Illn. 1983;5(3):297‑311. doi:10.1111/1467-9566.ep10491836
    1. Williams B. Patient satisfaction: a valid concept? Soc Sci Med. 1994;38(4):509‑16. doi:10.1016/0277-9536(94)90247-X
    1. Epstein RM, Street RL. The values and value of patient-centered care. Ann Fam Med. 2011;9(2):100‑3. doi:10.1370/afm.1239
    1. Berwick DM, Nolan TW, Whittington J. The triple aim: care, health, and cost. Health Aff Proj Hope. 2008;27(3):759‑69.
    1. Garratt AM, Solheim E, Danielsen K National and cross-national surveys of patient experiences: a structured review. Report n°7-2008. 2008. Oslo, Norway: Norwegian Knowledge Centre for the Health Services.
    1. Australian Commission on Safety and Quality in Health Care. Review of patient experience and satisfaction surveys conducted within public and private hospital in Australia. 2012. Available from: . Accessed January15, 2019.
    1. de Silva D Measuring patient experience. Evidence scan n°18. London: The Health Foundation; 2013. Available from: . Accessed January25, 2019
    1. Coulter A. Measuring what matters to patients. BMJ. 2017;j816. doi:10.1136/bmj.j816
    1. Beattie M, Murphy DJ, Atherton I, Lauder W. Instruments to measure patient experience of healthcare quality in hospitals: a systematic review. Syst Rev. 2015;4(1):97. doi:10.1186/s13643-015-0089-0
    1. Larson E, Sharma J, Bohren MA, Tunçalp Ö. When the patient is the expert: measuring patient experience and satisfaction with care. Bull World Health Organ. 2019;97(8):563‑9. doi:10.2471/BLT.18.225201
    1. Hays RD, Morales LS, Reise SP. Item response theory and health outcomes measurement in the 21st century. Med Care. 2000;38(9 Suppl):II28‑II42. doi:10.1097/00005650-200009002-00007
    1. Bjorner JB, Chang C-H, Thissen D, Reeve BB. Developing tailored instruments: item banking and computerized adaptive assessment. Qual Life Res Int J Qual Life Asp Treat Care Rehabil. 2007;16 Suppl 1:95‑108.
    1. Kornhaber R, Walsh K, Duff J, Walker K. Enhancing adult therapeutic interpersonal relationships in the acute health care setting: an integrative review. J Multidiscip Healthc. 2016;9:537‑46. doi:10.2147/JMDH.S116957
    1. Gilburt H, Rose D, Slade M. The importance of relationships in mental health care: a qualitative study of service users’ experiences of psychiatric hospital admission in the UK. BMC Health Serv Res. 2008;8:92. doi:10.1186/1472-6963-8-92
    1. Berghofer G, Lang A, Henkel H, Schmidl F, Rudas S, Schmitz M. Satisfaction of inpatients and outpatients with staff, environment, and other patients. Psychiatr Serv. 2001;52(1):104‑6. doi:10.1176/appi.ps.52.1.104
    1. Murray-Swank A, Glynn S, Cohen AN, et al. Family contact, experience of family relationships, and views about family involvement in treatment among VA consumers with serious mental illness. J Rehabil Res Dev. 2007;44(6):801‑11. doi:10.1682/JRRD.2006.08.0092
    1. Tzelepis F, Sanson-Fisher RW, Zucca AC, Fradgley EA. Measuring the quality of patient-centered care: why patient-reported measures are critical to reliable assessment. Patient Prefer Adherence. 2015;9:831‑5. doi:10.2147/PPA.S82441

Source: PubMed

Sponsoren und Mitarbeiter

Krankheiten

Drogeninterventionen

3
Abonnieren