The effect of referral templates on out-patient quality of care in a hospital setting: a cluster randomized controlled trial

Henrik Wåhlberg, Per Christian Valle, Siri Malm, Øistein Hovde, Ann Ragnhild Broderstad, Henrik Wåhlberg, Per Christian Valle, Siri Malm, Øistein Hovde, Ann Ragnhild Broderstad

Abstract

Background: The assessment of quality of care is an integral part of modern medicine. The referral represents the handing over of care from the general practitioner to the specialist. This study aimed to assess whether an improved referral could lead to improved quality of care.

Methods: A cluster randomized trial with the general practitioner surgery as the clustering unit was performed. Fourteen surgeries in the area surrounding the University Hospital of North Norway Harstad were randomized stratified by town versus countryside location. The intervention consisted of implementing referral templates for new referrals in four clinical areas: dyspepsia; suspected colorectal cancer; chest pain; and confirmed or suspected chronic obstructive pulmonary disease. The control group followed standard referral practice. Quality of treatment pathway as assessed by newly developed quality indicators was used as main outcome. Secondary outcomes included subjective quality assessment, positive predictive value of referral and adequacy of prioritization. Assessment of outcomes was done at the individual level. The patients, hospital doctors and outcome assessors were blinded to the intervention status.

Results: A total of 500 patients were included, with 281 in the intervention and 219 in the control arm. From the multilevel regression model the effect of the intervention on the quality indicator score was insignificant at 1.80% (95% CI, -1.46 to 5.06, p = 0.280). No significant differences between the intervention and the control groups were seen in the secondary outcomes. Active use of the referral intervention was low, estimated at approximately 50%. There was also wide variation in outcome scoring between the different assessors.

Conclusions: In this study no measurable effect on quality of care or prioritization was revealed after implementation of referral templates at the general practitioner/hospital interface. The results were hindered by a limited uptake of the intervention at GP surgeries and inconsistencies in outcome assessment.

Trial registration: The study was registered under registration number NCT01470963 on September 5th, 2011.

Keywords: Care cooperation; Quality of care; Referral.

Figures

Fig. 1
Fig. 1
Bland-Altman plot for quality indicator score for area chest pain and chronic obstructive pulmonary disease (COPD)
Fig. 2
Fig. 2
Subjective quality score (1–10) for intervention and control groups

References

    1. Helsedirektoratet. The Norwegian Patient Safety Programme: In Safe Hands. . The Norwegian Directorate of Health. 2014. Oslo, The Norwegian Directorate of Health. 19-11-2014.
    1. The Norwegian Directorat of Health . … and it’s going to get better! National Strategy for Quality Improvement in Health and Social Services (2005–2015) Oslo: The Norwegian Directorat of Health; 2005.
    1. Jortveit J, Govatsmark RE, Digre TA, Risoe C, Hole T, Mannsverk J, et al. Myocardial infarction in Norway in 2013. Tidsskr Nor Laegeforen. 2014;134:1841–1846. doi: 10.4045/tidsskr.14.0804.
    1. Hoff G, Bretthauer M, Huppertz-Hauss G, Kittang E, Stallemo A, Høie O, et al. The Norwegian Gastronet project: Continuous quality improvement of colonoscopy in 14 Norwegian centres. Scand J Gastroenterol. 2006;41:481–487. doi: 10.1080/00365520500265208.
    1. Mosadeghrad AM. Factors influencing healthcare service quality. Int J Health Policy Manag. 2014;3:77–89. doi: 10.15171/ijhpm.2014.65.
    1. Donabedian A. The definition of quality and approaches to its assessment. Ann Arbor, Mich: Health Administration Press; 1980.
    1. Øvretveit J. Health Service Quality. Oxford: Blackwell Scientific Press; 1992.
    1. Mainz J. Developing evidence-based clinical indicators: a state of the art methods primer. Int J Qual Health Care. 2003;15:i5–i11. doi: 10.1093/intqhc/mzg084.
    1. Brook RH, McGlynn EA, Cleary PD. Measuring Quality of Care. N Engl J Med. 1996;335:966–970. doi: 10.1056/NEJM199609263351311.
    1. Perera R, Moriarty H. If quality is the answer … what is the question? Int J Qual Health Care. 2013;25:107–109. doi: 10.1093/intqhc/mzt021.
    1. Donabedian A. Evaluating the quality of medical care. Milbank Mem Fund Q. 1966;44:166–203. doi: 10.2307/3348969.
    1. Cooperberg MR, Birkmeyer JD, Litwin MS. Defining high quality health care. Urol Oncol: Semin Orig Investig. 2009;27:411–416. doi: 10.1016/j.urolonc.2009.01.015.
    1. Patwardhan M, Fisher DA, Mantyh CR, McCrory DC, Morse MA, Prosnitz RG, et al. Assessing the quality of colorectal cancer care: do we have appropriate quality measures? (A systematic review of literature) J Eval Clin Pract. 2007;13(6):831–845.
    1. Birkmeyer JD, Dimick JB, Birkmeyer NJO. Measuring the quality of surgical care: structure, process, or outcomes? J Am Coll Surg. 2004;198:626–632. doi: 10.1016/j.jamcollsurg.2003.11.017.
    1. Jencks SF, Huff ED, Cuerdon T. Change in the Quality of Care Delivered to Medicare Beneficiaries, 1998–1999 to 2000–2001. JAMA. 2003;289:305–312. doi: 10.1001/jama.289.3.305.
    1. Lindenauer PK, Pekow P, Gao S, Crawford AS, Gutierrez B, Benjamin EM. Quality of Care for Patients Hospitalized for Acute Exacerbations of Chronic Obstructive Pulmonary Disease. Ann Intern Med. 2006;144:894–903. doi: 10.7326/0003-4819-144-12-200606200-00006.
    1. Spertus JA, Radford MJ, Every NR, Ellerbeck EF, Peterson ED, Krumholz HM. Challenges and Opportunities in Quantifying the Quality of Care for Acute Myocardial Infarction: Summary From the Acute Myocardial Infarction Working Group of the American Heart Association/American College of Cardiology First Scientific Forum on Quality of Care and Outcomes Research in Cardiovascular Disease and Stroke. Circulation. 2003;107:1681–1691. doi: 10.1161/01.CIR.0000062026.90014.63.
    1. Campbell SM, Roland MO, Shekelle PG, Cantrill JA, Buetow SA, Cragg DK. Development of review criteria for assessing the quality of management of stable angina, adult asthma, and non-insulin dependent diabetes mellitus in general practice. Qual Health Care. 1999;8:6–15. doi: 10.1136/qshc.8.1.6.
    1. Brook RH, Chassin MR, Fink A, Solomon DH, Kosecoff J, Park RE. A method for the detailed assessment of the appropriateness of medical technologies. Int J Technol Assess Health Care. 1986;2:53–63. doi: 10.1017/S0266462300002774.
    1. Hutchinson A, McIntosh A, Anderson J, Gilbert C, Field R. Developing primary care review criteria from evidence-based guidelines: coronary heart disease as a model. Br J Gen Pract. 2003;53(494):690–696.
    1. Perera R, Dowell A, Crampton P. Painting by numbers: A guide for systematically developing indicators of performance at any level of health care. Health Policy. 2012;108:49–59. doi: 10.1016/j.healthpol.2012.07.008.
    1. Thomson RG, McElroy H, Kazandjian VA. Maryland Hospital Quality Indicator Project in the United Kingdom: an approach for promoting continuous quality improvement. Qual Health Care. 1997;6:49–55. doi: 10.1136/qshc.6.1.49.
    1. Casalino LP. The Unintended Consequences of Measuring Quality on the Quality of Medical Care. N Engl J Med. 1999;341:1147–1150. doi: 10.1056/NEJM199910073411511.
    1. Panzer RJ, Gitomer RS, Greene WH, Webster P, Landry KR, Riccobono CA. Increasing demands for quality measurement. JAMA. 2013;310:1971–1980. doi: 10.1001/jama.2013.282047.
    1. Bishop TF. Pushing the outpatient quality envelope. JAMA. 2013;309:1353–1354. doi: 10.1001/jama.2013.1220.
    1. Guevara J, Hsu D, Forrest C. Performance measures of the specialty referral process: a systematic review of the literature. BMC Health Serv Res. 2011;11:168. doi: 10.1186/1472-6963-11-168.
    1. Goodwin N, Dixon A, Poole T, Raleigh V. In: Improving the quality of care in general practice. Stanley E, editor. London: The Kings Fund; 2011.
    1. Ong SP, Lim LT, Barnsley L, Read R. General practitioners’ referral letters--Do they meet the expectations of gastroenterologists and rheumatologists? Aust Fam Physician. 2006;35:920–922.
    1. Syed AA, Large DM. Quality of GPs’ referral letters to diabetes secondary care. Prac Diabetes Int. 2003;20:165–169. doi: 10.1002/pdi.488.
    1. Bodek S, Ghori K, Edelstein M, Reed A, MacFadyen RJ. Contemporary referral of patients from community care to cardiology lack diagnostic and clinical detail. Int J Clin Pract. 2006;60:595–601. doi: 10.1111/j.1368-5031.2006.00902.x.
    1. Akbari A, Mayhew A, Al-AlawiMA, Grimshaw J, Winkens R, Glidewell E, Pritchard C, Thomas R, Fraser C. Interventions to improve outpatient referrals from primarycare to secondary care. Cochrane Database Syst Rev. 2008;(4). Art. No.: CD005471. doi:10.1002/14651858.CD005471.pub2.
    1. Carlsen B, Norheim OF. Introduction of the patient-list system in general practice. Changes in Norwegian physicians’ perception of their gatekeeper role. Scand J Prim Health Care. 2003;21:209–213. doi: 10.1080/02813430310004155.
    1. Ree AO. Medisinsk faglig innhold i henvisninger [Medical technical content in referral papers]. KITH 22/03. 19-9-2003. Trondheim, Norwegian Centre for Informatics in Health and Social Care (KITH 2003). 10-5-2010.
    1. Wahlberg H, Valle P, Malm S, Broderstad A. Impact of referral templates on the quality of referrals from primary to secondary care: a cluster randomised trial. BMC Health Serv Res. 2015;15:353. doi: 10.1186/s12913-015-1017-7.
    1. Wahlberg H, Valle PC, Malm S, Broderstad AR. Practical health co-operation–the impact of a referral template on quality of care and health care co-operation: study protocol for a cluster randomized controlled trial. Trials. 2013;14:7. doi: 10.1186/1745-6215-14-7.
    1. Roth CP, Lim YW, Pevnick JM, Asch SM, McGlynn EA. The Challenge of Measuring Quality of Care From the Electronic Health Record. Am J Med Qual. 2009;24:385–394. doi: 10.1177/1062860609336627.
    1. Dyspepsia: Managing Dyspepsia in Adults in Primary Care. North of England Dyspepsia Guideline Development Group. 112. 1-8-2004. Newcastle upon Tyne, Centre for Health Services Research. 19-5-2010.
    1. Talley NJ. American Gastroenterological Association Medical Position Statement: Evaluation of Dyspepsia. Gastroenterology. 2005;129:1753–56. doi: 10.1053/j.gastro.2005.09.019.
    1. Talley NJ, Vakil N. Guidelines for the management of dyspepsia. Am J Gastroenterol. 2005;100:2324–2337. doi: 10.1111/j.1572-0241.2005.00225.x.
    1. Riktlinjer handläggning av gastroesofageal refluxsjukdom [Guidelines for treatment of gastroesophageal reflux disease]. Svensk Gastroenterologisk Förening; 2008. . Accessed 3 Mar 2017.
    1. Valle PC, Breckan RK, Amin A, Kristiansen MG, Husebye E, Nordgard K, et al. “Test, score and scope”: a selection strategy for safe reduction of upper gastrointestinal endoscopies in young dyspeptic patients referred from primary care. Scand J Gastroenterol. 2006;41:161–169. doi: 10.1080/00365520500286881.
    1. Longstreth GF. Approach to the patient with dyspepsia. In: Basow DS, editor. UpToDate. Waltham; 2009. . Accessed Jun 2010.
    1. Nygaard E, Kårikstad V. Prioriteringsveileder–Fordøyelsessykdommer [Prioritization guidelines–Gastrointestinal diseases] Oslo: The Norwegian Directorate of Health; 2009.
    1. Bourke MJ. Making every colonoscopy count: Ensuring quality in endoscopy. J Gastroenterol Hepatol. 2009;24(Suppl 3):S43–S50. doi: 10.1111/j.1440-1746.2009.06070.x.
    1. Sharma VK, Nguyen CC, Crowell MD, Lieberman DA, de Garmo P, Fleischer DE. A national study of cardiopulmonary unplanned events after GI endoscopy. Gastrointest Endosc. 2007;66:27–34. doi: 10.1016/j.gie.2006.12.040.
    1. Enns R. Quality indicators in colonoscopy. Can J Gastroenterol. 2007;21:277–279. doi: 10.1155/2007/582062.
    1. Froehlich F, Wietlisbach V, Gonvers JJ, Burnand B, Vader JP. Impact of colonic cleansing on quality and diagnostic yield of colonoscopy: the European Panel of Appropriateness of Gastrointestinal Endoscopy European multicenter study. Gastrointest Endosc. 2005;61:378–384. doi: 10.1016/S0016-5107(04)02776-2.
    1. Ahnen DJ, Macrae FA. Clinical manifestations, diagnosis, and staging of colorectal cancer. In: Basow DS, editor. UpToDate. Waltham; 2010. . Accessed Jun 2010.
    1. Nygaard E, Kårikstad V. Prioriteringsveileder–Lungesykdommer. [Prioritization guidelines–Pulmonary diseases] Oslo: The Norwegian Directorate of Health; 2008.
    1. Rennard IS. Chronic obstructive pulmonary disease: Definition, clinical manifestations, diagnosis, and staging. In: Basow DS, editor. UpToDate. Waltham; 2009. . Accessed Jun 2010.
    1. Kerr EA, ASMHEGMEA . Quality of Care for Cardiopulmonary Conditions: A Review of the Literature and Quality Indicators. Santa Monica: RAND; 2000. Chronic Obstructive Pulmonary Disease; pp. 91–115.
    1. Global Initiative for Chronic Obstructive Lung Disease. Global strategy for the diagnosis, mangement and prevention of chronic obstructive pulmonary disease. Medical Communications Resources, Inc.; 2009. 19-5-2010. . Accessed Jun 2010.
    1. Mularski RA, Asch SM, Shrank WH, Kerr EA, Setodji CM, Adams JL, et al. The Quality of Obstructive Lung Disease Care for Adults in the United States as Measured by Adherence to Recommended Processes*. Chest. 2006;130:1844–1850. doi: 10.1378/chest.130.6.1844.
    1. Heffner JE, Mularski RA, Calverley PMA. COPD Performance Measures. Chest. 2010;137:1181–1189. doi: 10.1378/chest.09-2306.
    1. American Gastroenterological Association, Spechler SJ, Sharma P, Souza RF, Inadomi JM, Shaheen NJ. American Gastroenterological Association Medical Position Statement on the Management of Barrett’s Esophagus. Gastroenterology. 2011;140:1084–91.
    1. Jones R, Hunt C, Stevens R, Dalrymple J, Driscoll R, Sleet S, et al. Management of common gastrointestinal disorders: quality criteria based on patients’ views and practice guidelines. Br J Gen Pract. 2009;59:e199–e208. doi: 10.3399/bjgp09X420761.
    1. Ciclitira PJ, Dewar DH, McLaughlin SD, Sanders DS. The Management of Adult with Coeliac Disease. British Society of Gastroenterology; 2010. . Accessed Jun 2010.
    1. Fisher L, Lee Krinsky M, Anderson MA, Appalaneni V, Banerjee S, Ben Menachem T, et al. The role of endoscopy in the management of obscure GI bleeding. Gastrointest Endosc. 2010;72:471–479. doi: 10.1016/j.gie.2010.04.032.
    1. Bull-Henry K, Al Kawas FH. Evaluation of occult gastrointestinal bleeding. Am Fam Physician. 2013;87(6):430–436.
    1. Hofstad B, Andersen SN, Nesbakken A. Colorectal polyps. Tidskr Nor Lægeforen. 2007;127(20):2692–2695.
    1. Early DS, Ben Menachem T, Decker GA, Evans JA, Fanelli RD, Fisher DA, et al. Appropriate use of GI endoscopy. Gastrointest Endosc. 2012;75:1127–1131. doi: 10.1016/j.gie.2012.01.011.
    1. Erhardt L, Herlitz J, Bossaert L, Halinen M, Keltai M, Koster R, et al. Task force on the management of chest pain. Eur Heart J. 2002;23:1153–1176. doi: 10.1053/euhj.2002.3194.
    1. Kerr EA, ASMHEGMEA . Quality of Care for Cardiopulmonary Conditions: A Review of the Literature and Quality Indicators. Santa Monica: RAND; 2000. Coronary artery disease–diagnosis and screening; pp. 141–159.
    1. Buetow SA, Coster GD. New Zealand and United Kingdom experiences with the RAND modified Delphi approach to producing angina and heart failure criteria for quality assessment in general practice. Qual Health Care. 2000;9:222–231. doi: 10.1136/qhc.9.4.222.
    1. Kerr EA, ASMHEGMEA . Quality of Care for Cardiopulmonary Conditions: A Review of the Literature and Quality Indicators. Santa Monica: RAND; 2000. Coronary artery disease–prevention and treatment; pp. 161–177.
    1. Cooper A, Calvert N, Skinner J, Sawyer L, Sparrow K, Timmis A, et al. Chest pain of recent onset: Assessment and diagnosis of recent onset chest pain or discomfort of suspected cardiac origin. London: National Clinical Guideline Centre for Acute and Chronic Conditions (UK); 2010.
    1. Fihn SD, Gardin JM, Abrams J, Berra K, Blankenship JC, Dallas AP, et al. 2012 ACCF/AHA/ACP/AATS/PCNA/SCAI/STS Guideline for the Diagnosis and Management of Patients With Stable Ischemic Heart Disease: Executive Summary: A Report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines, and the American College of Physicians, American Association for Thoracic Surgery, Preventive Cardiovascular Nurses Association, Society for Cardiovascular Angiography and Interventions, and Society of Thoracic Surgeons. Circulation. 2012;126:3097–3137. doi: 10.1161/CIR.0b013e3182776f83.
    1. National Institute for Health and Care Excellence . Stable Angina: full guideline (CG126) London: National Institute for Health and Care Excellence; 2011.
    1. Marshall MN, Shekelle PG, McGlynn EA, Campbell S, Brook RH, Roland MO. Can health care quality indicators be transferred between countries? Qual Saf Health Care. 2003;12:8–12. doi: 10.1136/qhc.12.1.8.
    1. Ashton CM, Kuykendall DH, Johnson ML, Wray NP. An empirical assessment of the validity of explicit and implicit process-of-care criteria for quality assessment. Med Care. 1999;37:798–808. doi: 10.1097/00005650-199908000-00009.
    1. Ashton CM, Kuykendall DH, Johnson ML, Wun CC, Wray NP, Carr MJ, et al. A method of developing and weighting explicit process of care criteria for quality assessment. Med Care. 1994;32:755–770. doi: 10.1097/00005650-199408000-00001.
    1. Lyons TF, Payne BC. The use of item importance weights in assessing physician performance with predetermined criteria indices. Med Care. 1975;13:432–439. doi: 10.1097/00005650-197505000-00005.
    1. Bennett K, Haggard M, Churchill R, Wood S. Improving referrals for glue ear from primary care: are multiple interventions better than one alone? J Health Serv Res Policy. 2001;6:139–144. doi: 10.1258/1355819011927387.
    1. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;327:307–310. doi: 10.1016/S0140-6736(86)90837-8.
    1. Campbell MKP. Consort 2010 statement: extension to cluster randomised trials. BMJ. 2012;345:e5661. doi: 10.1136/bmj.e5661.
    1. Baker R, Fraser RC. Development of review criteria: linking guidelines and assessment of quality. BMJ. 1995;311:370–373. doi: 10.1136/bmj.311.7001.370.
    1. Wisdom JP, Cavaleri MA, Onwuegbuzie AJ, Green CA. Methodological Reporting in Qualitative, Quantitative, and Mixed Methods Health Services Research Articles. Health Serv Res. 2012;47:721–745. doi: 10.1111/j.1475-6773.2011.01344.x.
    1. Jiwa M, Skinner P, Coker AO, Shaw L, Campbell MJ, Thompson J. Implementing referral guidelines: lessons from a negative outcome cluster randomised factorial trial in general practice. BMC Fam Pract. 2006;7:65. doi: 10.1186/1471-2296-7-65.
    1. Thomas RE, Grimshaw JM, Mollison J, McClinton S, McIntosh E, Deans H, et al. Cluster randomized trial of a guideline-based open access urological investigation service. Fam Pract. 2003;20:646–654. doi: 10.1093/fampra/cmg605.
    1. Hartveit M, Biringer E, Vanhaecht K, Haug K, Aslaksen A. The Western Norway mental health interface study: a controlled intervention trial on referral letters between Primary Care and Specialist Mental Health Care. BMC Psychiatry. 2011;11:177. doi: 10.1186/1471-244X-11-177.
    1. Medical Research Council. Cluster randomised trials: Methodological and ethical considerations. London: Medical Research Council; 2002.
    1. Timian A, Rupcic S, Kachnowski S, Luisi P. Do Patients “Like” Good Care? Measuring Hospital Quality via Facebook. Am J Med Qual. 2013;28:374–382. doi: 10.1177/1062860612474839.
    1. Mainz J. Defining and classifying clinical indicators for quality improvement. Int J Qual Health Care. 2003;15:523–530. doi: 10.1093/intqhc/mzg081.
    1. Chassin MR, Loeb JM, Schmaltz SP, Wachter RM. Accountability Measures–Using Measurement to Promote Quality Improvement. N Engl J Med. 2010;363:683–688. doi: 10.1056/NEJMsb1002320.
    1. Quality of Care and Outcomes Research in CVD. Stroke Working Groups Measuring and Improving Quality of Care: A Report From the American Heart Association/American College of Cardiology First Scientific Forum on Assessment of Healthcare Quality in Cardiovascular Disease and Stroke. Circulation. 2000;101:1483–1493. doi: 10.1161/01.CIR.101.12.1483.
    1. Institute of Medicine; Committee on Improving the Patient Record; Richard S. Dick, Elaine B. Steen, and Don E. Detmer, Editors. The Computer-Based Patient Record: An Essential Technology for Health Care, Revised Edition. The National Academies Press; 1997.
    1. Romm FJ, Putnam SM. The validity of the medical record. Med Care. 1981;19:310–315. doi: 10.1097/00005650-198103000-00006.
    1. Moran MT, Wiser TH, Nanda J, Gross H. Measuring medical residents’ chart-documentation practices. J Med Educ. 1988;63(11):859–865.
    1. Weiskopf NG, Weng C. Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research. J Am Med Inform Assoc. 2013;20:144–151. doi: 10.1136/amiajnl-2011-000681.

Source: PubMed

Sponsorer och medarbetare

Medicinska tillstånd

Läkemedelsinterventioner

3
Prenumerera