Not perfect, but better: primary care providers' experiences with electronic referrals in a safety net health system

Yeuen Kim, Alice Hm Chen, Ellen Keith, Hal F Yee Jr, Margot B Kushel, Yeuen Kim, Alice Hm Chen, Ellen Keith, Hal F Yee Jr, Margot B Kushel

Abstract

Background: Electronic referrals can improve access to subspecialty care in safety net settings. In January 2007, San Francisco General Hospital (SFGH) launched an electronic referral portal that incorporated subspecialist triage, iterative communication with referring providers, and existing electronic health record data to improve access to subspecialty care.

Objective: We surveyed primary care providers (PCPs) to assess the impact of electronic referrals on workflow and clinical care.

Design: We administered an 18-item, web-based questionnaire to all 368 PCPs who had the option of referring to SFGH.

Measurements: We asked participants to rate time spent submitting a referral, guidance of workup, wait times, and change in overall clinical care compared to prior referral methods using 5-point Likert scales. We used multivariate logistic regression to identify variables associated with perceived improvement in overall clinical care.

Results: Two hundred ninety-eight PCPs (81.0%) from 24 clinics participated. Over half (55.4%) worked at hospital-based clinics, 27.9% at county-funded community clinics, and 17.1% at non-county-funded community clinics. Most (71.9%) reported that electronic referrals had improved overall clinical care. Providers from non-county-funded clinics (AOR 0.40, 95% CI 0.14-0.79) and those who spent > or =6 min submitting an electronic referral (AOR 0.33, 95%CI 0.18-0.61) were significantly less likely than other participants to report that electronic referrals had improved clinical care.

Conclusions: PCPs felt electronic referrals improved health-care access and quality; those who reported a negative impact on workflow were less likely to agree. While electronic referrals hold promise as a tool to improve clinical care, their impact on workflow should be considered.

Figures

Figure 1
Figure 1
PCPs’ ratings of attributes of electronic referrals compared to prior referral methods.

References

    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'PubMed', 'value': '10345255', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/10345255/'}]}
    2. Wagner EH. Chronic disease management: what will it take to improve care for chronic illness? Eff. Clin. Pract. 1998;1:2-4.
    1. None
    2. Ein Lewin M, Altman SH. America's health care safety net: intact but endangered. Washington, DC: Institute of Medicine; 2000.
    1. Smith SM, Allwright S, O'Dowd T. Effectiveness of shared care across the interface between primary and specialty care in chronic disease management. Cochrane Database Syst Rev 2007:CD004910.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'DOI', 'value': '10.1007/s11606-007-0383-1', 'is_inner': False, 'url': 'https://doi.org/10.1007/s11606-007-0383-1'}, {'type': 'PMC', 'value': 'PMC2359526', 'is_inner': False, 'url': 'http://www.ncbi.nlm.nih.gov/pmc/articles/pmc2359526/'}, {'type': 'PubMed', 'value': '18373130', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/18373130/'}]}
    2. Fischer MA, Vogeli C, Stedman MR, Ferris TG, Weissman JS. Uptake of electronic prescribing in community-based practices. J Gen Intern Med 2008;23:358-63.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'DOI', 'value': '10.1007/s11606-007-0488-6', 'is_inner': False, 'url': 'https://doi.org/10.1007/s11606-007-0488-6'}, {'type': 'PMC', 'value': 'PMC2359517', 'is_inner': False, 'url': 'http://www.ncbi.nlm.nih.gov/pmc/articles/pmc2359517/'}, {'type': 'PubMed', 'value': '18373132', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/18373132/'}]}
    2. Leu MG, Cheung M, Webster TR, et al. Centers speak up: the clinical context for health information technology in the ambulatory care setting. J Gen Intern Med 2008;23:372-8.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'DOI', 'value': '10.1001/jama.290.2.259', 'is_inner': False, 'url': 'https://doi.org/10.1001/jama.290.2.259'}, {'type': 'PubMed', 'value': '12851283', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/12851283/'}]}
    2. Bodenheimer T, Grumbach K. Electronic technology: a spark to revitalize primary care? Jama 2003;290:259-64.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'DOI', 'value': '10.1377/hlthaff.21.5.277', 'is_inner': False, 'url': 'https://doi.org/10.1377/hlthaff.21.5.277'}, {'type': 'PubMed', 'value': '12224892', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/12224892/'}]}
    2. Felt-Lisk S, McHugh M, Howell E. Monitoring local safety-net providers: do they have adequate capacity? Health Aff (Millwood) 2002;21:277-83.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'DOI', 'value': '10.1377/hlthaff.21.6.188', 'is_inner': False, 'url': 'https://doi.org/10.1377/hlthaff.21.6.188'}, {'type': 'PubMed', 'value': '12442854', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/12442854/'}]}
    2. Gusmano MK, Fairbrother G, Park H. Exploring the limits of the safety net: community health centers and care for the uninsured. Health Aff (Millwood) 2002;21:188-94.
    1. Felland LE, Felt-Lisk S, McHugh M. Health care access for low-income people: significant safety net gaps remain. Issue Brief Cent Stud Health Syst Change 2004:1-4.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'PMC', 'value': 'PMC2569014', 'is_inner': False, 'url': 'http://www.ncbi.nlm.nih.gov/pmc/articles/pmc2569014/'}, {'type': 'PubMed', 'value': '16957798', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/16957798/'}]}
    2. Knudtson ML, Beanlands R, Brophy JM, Higginson L, Munt B, Rottger J. Treating the right patient at the right time: access to specialist consultation and non-invasive testing. Can J Cardiol 2006;22:819-24.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'PubMed', 'value': '11032351', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/11032351/'}]}
    2. Levin A. Consequences of late referral on patient outcomes. Nephrol Dial Transplant 2000;15(Suppl 3):8-13.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'PMC', 'value': 'PMC2042546', 'is_inner': False, 'url': 'http://www.ncbi.nlm.nih.gov/pmc/articles/pmc2042546/'}, {'type': 'PubMed', 'value': '17359610', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/17359610/'}]}
    2. Shaw LJ, de Berker DA. Strengths and weaknesses of electronic referral: comparison of data content and clinical value of electronic and paper referrals in dermatology. Br J Gen Pract 2007;57:223-4.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'DOI', 'value': '10.1001/jama.280.15.1339', 'is_inner': False, 'url': 'https://doi.org/10.1001/jama.280.15.1339'}, {'type': 'PubMed', 'value': '9794315', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/9794315/'}]}
    2. Hunt DL, Haynes RB, Hanna SE, Smith K. Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. Jama 1998;280:1339-46.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'PubMed', 'value': '11575484', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/11575484/'}]}
    2. Medow MA, Wilt TJ, Dysken S, Hillson SD, Woods S, Borowsky SJ. Effect of written and computerized decision support aids for the U.S. agency for health care policy and research depression guidelines on the evaluation of hypothetical clinical scenarios. Med Decis Making 2001;21:344-56.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'DOI', 'value': '10.1111/j.1475-6773.2006.00626.x', 'is_inner': False, 'url': 'https://doi.org/10.1111/j.1475-6773.2006.00626.x'}, {'type': 'PMC', 'value': 'PMC1955366', 'is_inner': False, 'url': 'http://www.ncbi.nlm.nih.gov/pmc/articles/pmc1955366/'}, {'type': 'PubMed', 'value': '17362211', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/17362211/'}]}
    2. Prentice JC, Pizer SD. Delayed access to health care and mortality. Health Serv Res 2007;42:644-62.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'DOI', 'value': '10.1215/03616878-17-4-637', 'is_inner': False, 'url': 'https://doi.org/10.1215/03616878-17-4-637'}, {'type': 'PubMed', 'value': '1299684', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/1299684/'}]}
    2. Reinhardt UE. The United States: breakthroughs and waste. J Health Polit Policy Law 1992;17:637-66.
    1. Gruen RL, Weeramanthri TS, Knight SE, Bailie RS. Specialist outreach clinics in primary care and rural hospital settings. Cochrane Database Syst Rev 2004:CD003798.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'PubMed', 'value': '7953208', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/7953208/'}]}
    2. Madhok R, Green S. Orthopaedic outpatient referral guidelines: experience in an English health district. Int J Qual Health Care 1994;6:73-6.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'DOI', 'value': '10.1016/S0140-6736(00)04564-5', 'is_inner': False, 'url': 'https://doi.org/10.1016/s0140-6736(00)04564-5'}, {'type': 'PubMed', 'value': '11356439', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/11356439/'}]}
    2. Eccles M, Steen N, Grimshaw J, et al. Effect of audit and feedback, and reminder messages on primary-care radiology referrals: a randomised trial. Lancet 2001;357:1406-9.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'PubMed', 'value': '11901566', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/11901566/'}]}
    2. Abbott KC, Mann S, DeWitt D, Sales LY, Kennedy S, Poropatich RK. Physician-to-physician consultation via electronic mail: the Walter Reed Army Medical Center Ask a Doc system. Mil Med 2002;167:200-4.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'PubMed', 'value': '18042656', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/18042656/'}]}
    2. Deutscher D, Hart DL, Dickstein R, Horn SD, Gutvirtz M. Implementing an integrated electronic outcomes and electronic health record process to create a foundation for clinical practice improvement. Phys Ther 2008;88:270-85.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'DOI', 'value': '10.1056/NEJMhpr0706165', 'is_inner': False, 'url': 'https://doi.org/10.1056/nejmhpr0706165'}, {'type': 'PubMed', 'value': '18322289', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/18322289/'}]}
    2. Bodenheimer T. Coordinating care–a perilous journey through the health care system. N Engl J Med 2008;358:1064-71.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'DOI', 'value': '10.1007/s11606-008-0573-5', 'is_inner': False, 'url': 'https://doi.org/10.1007/s11606-008-0573-5'}, {'type': 'PMC', 'value': 'PMC2517887', 'is_inner': False, 'url': 'http://www.ncbi.nlm.nih.gov/pmc/articles/pmc2517887/'}, {'type': 'PubMed', 'value': '18369679', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/18369679/'}]}
    2. Zandieh SO, Yoon-Flannery K, Kuperman GJ, Langsam DJ, Hyman D, Kaushal R. Challenges to EHR implementation in electronic- versus paper-based office practices. J Gen Intern Med 2008;23:755-61.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'DOI', 'value': '10.1007/s11606-007-0494-8', 'is_inner': False, 'url': 'https://doi.org/10.1007/s11606-007-0494-8'}, {'type': 'PMC', 'value': 'PMC2359528', 'is_inner': False, 'url': 'http://www.ncbi.nlm.nih.gov/pmc/articles/pmc2359528/'}, {'type': 'PubMed', 'value': '18373131', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/18373131/'}]}
    2. Crosson JC, Isaacson N, Lancaster D, et al. Variation in electronic prescribing implementation among twelve ambulatory practices. J Gen Intern Med 2008;23:364-71.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'DOI', 'value': '10.1287/isre.9.2.204', 'is_inner': False, 'url': 'https://doi.org/10.1287/isre.9.2.204'}]}
    2. Agarwal R, Prasad J. A conceptual and operational definition of personal innovativeness in the domain of information technology. Information Systems Research 1998;9:204-15.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'DOI', 'value': '10.1136/qshc.2005.014704', 'is_inner': False, 'url': 'https://doi.org/10.1136/qshc.2005.014704'}, {'type': 'PMC', 'value': 'PMC2564006', 'is_inner': False, 'url': 'http://www.ncbi.nlm.nih.gov/pmc/articles/pmc2564006/'}, {'type': 'PubMed', 'value': '16456203', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/16456203/'}]}
    2. Wright J, Harrison S, McGeorge M, et al. Improving the management and referral of patients with transient ischaemic attacks: a change strategy for a health community. Qual Saf Health Care 2006;15:9-12.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'DOI', 'value': '10.1046/j.1525-1497.2000.91119.x', 'is_inner': False, 'url': 'https://doi.org/10.1046/j.1525-1497.2000.91119.x'}, {'type': 'PMC', 'value': 'PMC1495590', 'is_inner': False, 'url': 'http://www.ncbi.nlm.nih.gov/pmc/articles/pmc1495590/'}, {'type': 'PubMed', 'value': '11029676', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/11029676/'}]}
    2. Gandhi TK, Sittig DF, Franklin M, Sussman AJ, Fairchild DG, Bates DW. Communication breakdown in the outpatient referral process. J Gen Intern Med 2000;15:626-31.
    1. Moiduddin A, Gaylin D. Health information technology adoption among health centers. A digital divide in the making? National Health Policy Forum 2007:17.
    1. Tierney WM, Rotich JK, Smith FE, Bii J, Einterz RM, Hannan TJ. Crossing the "digital divide:" implementing an electronic medical record system in a rural Kenyan health center to support clinical care and research. Proc AMIA Symp 2002:792-5.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'PMC', 'value': 'PMC1314732', 'is_inner': False, 'url': 'http://www.ncbi.nlm.nih.gov/pmc/articles/pmc1314732/'}, {'type': 'PubMed', 'value': '14702909', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/14702909/'}]}
    2. Faulkner A, Mills N, Bainton D, et al. A systematic review of the effect of primary care-based service innovations on quality and patterns of referral to specialist secondary care. Br J Gen Pract 2003;53:878-84.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'DOI', 'value': '10.1056/NEJM199811193392106', 'is_inner': False, 'url': 'https://doi.org/10.1056/nejm199811193392106'}, {'type': 'PubMed', 'value': '9819451', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/9819451/'}]}
    2. Grumbach K, Osmond D, Vranizan K, Jaffe D, Bindman AB. Primary care physicians' experience of financial incentives in managed-care systems. N Engl J Med 1998;339:1516-21.
    1. Ludwick DA, Doucette J. Primary Care Physicians' Experience with Electronic Medical Records: Barriers to Implementation in a Fee-for-Service Environment. Int J Telemed Appl 2009;2009:853524.
    1. {'text': '', 'ref_index': 1, 'ids': [{'type': 'DOI', 'value': '10.1186/1472-6963-7-194', 'is_inner': False, 'url': 'https://doi.org/10.1186/1472-6963-7-194'}, {'type': 'PMC', 'value': 'PMC2222624', 'is_inner': False, 'url': 'http://www.ncbi.nlm.nih.gov/pmc/articles/pmc2222624/'}, {'type': 'PubMed', 'value': '18045482', 'is_inner': True, 'url': 'http://pubmed.ncbi.nlm.nih.gov/18045482/'}]}
    2. Skinner AC, Mayer ML. Effects of insurance status on children's access to specialty care: a systematic review of the literature. BMC Health Serv Res 2007;7:194.

Source: PubMed

3
Tilaa