Standardized outcome measures for pregnancy and childbirth, an ICHOM proposal

Malini Anand Nijagal, Stephanie Wissig, Caleb Stowell, Elizabeth Olson, Isis Amer-Wahlin, Gouke Bonsel, Allyson Brooks, Matthew Coleman, Shamala Devi Karalasingam, James M N Duffy, Tracy Flanagan, Stefan Gebhardt, Meridith E Greene, Floris Groenendaal, J Ravichandran R Jeganathan, Tessa Kowaliw, Marije Lamain-de-Ruiter, Elliott Main, Michelle Owens, Rod Petersen, Irwin Reiss, Carol Sakala, Anna Maria Speciale, Rachel Thompson, Oluwakemi Okunade, Arie Franx, Malini Anand Nijagal, Stephanie Wissig, Caleb Stowell, Elizabeth Olson, Isis Amer-Wahlin, Gouke Bonsel, Allyson Brooks, Matthew Coleman, Shamala Devi Karalasingam, James M N Duffy, Tracy Flanagan, Stefan Gebhardt, Meridith E Greene, Floris Groenendaal, J Ravichandran R Jeganathan, Tessa Kowaliw, Marije Lamain-de-Ruiter, Elliott Main, Michelle Owens, Rod Petersen, Irwin Reiss, Carol Sakala, Anna Maria Speciale, Rachel Thompson, Oluwakemi Okunade, Arie Franx

Abstract

Background: Value-based health care aims to optimize the balance of patient outcomes and health care costs. To improve value in perinatal care using this strategy, standard outcomes must first be defined. The objective of this work was to define a minimum, internationally appropriate set of outcome measures for evaluating and improving perinatal care with a focus on outcomes that matter to women and their families.

Methods: An interdisciplinary and international Working Group was assembled. Existing literature and current measurement initiatives were reviewed. Serial guided discussions and validation surveys provided consumer input. A series of nine teleconferences, incorporating a modified Delphi process, were held to reach consensus on the proposed Standard Set.

Results: The Working Group selected 24 outcome measures to evaluate care during pregnancy and up to 6 months postpartum. These include clinical outcomes such as maternal and neonatal mortality and morbidity, stillbirth, preterm birth, birth injury and patient-reported outcome measures (PROMs) that assess health-related quality of life (HRQoL), mental health, mother-infant bonding, confidence and success with breastfeeding, incontinence, and satisfaction with care and birth experience. To support analysis of these outcome measures, pertinent baseline characteristics and risk factor metrics were also defined.

Conclusions: We propose a set of outcome measures for evaluating the care that women and infants receive during pregnancy and the postpartum period. While validation and refinement via pilot implementation projects are needed, we view this as an important initial step towards value-based improvements in care.

Keywords: Consensus; DELPHI process; Delivery outcomes; Health outcomes; Obstetrics; Outcome measures; Patient-centred outcomes; Patient-reported; Perinatal health; Pregnancy.

Conflict of interest statement

Ethics approval and consent to participate

Quorum Review IRB issued a written determination of exemption for this study (Protocol Number: Exemption Determination - 30552).

Consent for publication

Not applicable.

Competing interests

FG declares that he is been expert witness in several cases of perinatal asphyxia and has received money from academic insitutions to give lectures on perinatal asphyxia. In addition, he has patent CA 2419302 A1: Use of 2-iminobiotin for the prevention or treatment of perinatal asphyxia in neonates licensed to Neurophyxia (www.neurophyxia.com/). RT declares that she is an editor of the book Shared Decision Making in Health Care: Achieving evidence-based patient choice (Oxford University Press, 2016) and will receive royalties from the sale of this book in the forthcoming year. RT is also an owner of copyright in several written works, including patient surveys and patient decision aids intended for use in routine maternity care delivery and research; she receives no income in relation to this intellectual property ownership. AB, AF, TF, TK, EO, SG, SDK, RP, JRRJ, MG, MC, MLR, MN, JD, IAW, IR, GB, EM, CSa, CSt, AMS, MO and SW have no competing interests to disclose.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Figures

Fig. 1
Fig. 1
Timeline for ICHOM Pregnancy and Childbirth Standard Set data collection. The following timeline illustrates when Standard Set variables should be collected from patients, clinicians or administrative sources

References

    1. Nippita TA, Trevena JA, Patterson JA, Ford JB, Morris JM, Roberts CL. Variation in hospital rates of induction of labour : a population-based record linkage study. BMJ Open. 2015;5(e008755):1–8.
    1. Mesterton J, Ladfors L, Abreu AE, Lindgren P, Saltvedt S, Weichselbraun M, et al. Case mix adjusted variation in cesarean section rate in Sweden. Acta Obstet Gynecol Scand. 2017;96:597–606. doi: 10.1111/aogs.13117.
    1. Kozhimannil KB, Law MR, Virnig BA. Cesarean delivery rates vary tenfold among US hospitals; reducing variation may address quality and cost issues. Health Aff. 2013;32(3):527–535. doi: 10.1377/hlthaff.2012.1030.
    1. International Federation of Health Plans. 2015 Comparative Price Report: Variation in Medical and Hospital Prices by Country. 2015 [cited 2017 Jul 20]. Available from:
    1. Porter ME. What is value in health care? N Engl J Med. 2010;363(26):2477–2481. doi: 10.1056/NEJMp1011024.
    1. Joint Commission National Quality Measures 2016. 2016 [cited 2017 Jul 20]. Available from:
    1. Center for Medicare and Medicaid Services. 2016 Core Set of Adult Health Care Quality Measures for Medicaid (Adult Core Set). 2016 [cited 2016 Jun 6]. Available from:
    1. Australian Institute of Health and Welfare . National core maternity indicators. 2016.
    1. World Health Organisation (WHO) WHO recommendations for the prevention and treatment of postpartum haemorrhage. 2012.
    1. Kesmodel US, Jalving LR. Measuring and improving quality in obstetrics - the implementation of national indicators in Denmark. Acta Obstet Gynecol Scand. 2011;90(4):295–304. doi: 10.1111/j.1600-0412.2011.01078.x.
    1. Euro-Peristat . European Perinatal Health Report: Health and Care of Pregnant Women and Babies in Europe in 2010. 2010.
    1. Public Health Agency of Canada. Perinatal health indicators for Canada 2013: A report of the Canadian perinatal surveillance system. Ottawa: Public Health Agency of Canada; 2013. Available from:
    1. Porter ME, Larsson S, Lee TH. Standardizing patient outcomes measurement. N Engl J Med. 2016;374(6):504–506. doi: 10.1056/NEJMp1511701.
    1. Pill J. The Delphi method: substance, context, a critique and an annotated bibliography. Socio Econ Plan Sci. 1971;5(1):57–71. doi: 10.1016/0038-0121(71)90041-3.
    1. Guyatt GH, Oxman AD, Kunz R, Atkins D, Brozek J, Vist G, et al. GRADE guidelines: 2. Framing the question and deciding on important outcomes. J Clin Epidemiol. 2011;64(4):395–400. doi: 10.1016/j.jclinepi.2010.09.012.
    1. Declercq ER, Sakala C, Corry MP, Applebaum S, Herrlich A. Listening to MothersSM III: Pregnancy and Birth. New York: Childbirth Connection; 2013.
    1. Saal D, Nuebling M, Husemann Y, Heidegger T. Effect of timing on the response to postal questionnaires concerning satisfaction with anaesthesia care. Br J Anaesth. 2005;94:206–210. doi: 10.1093/bja/aei024.
    1. Bredart A, Razavi D, Robertson C, Brignone S, Fonzo D, Petit J, et al. Timing of patient satisfaction assessment : effect on questionnairee acceptability , completeness of data , reliability and variability of scores. Patient Educ Couns. 2002;46:131–136. doi: 10.1016/S0738-3991(01)00152-5.
    1. World Health Organization (WHO) Health Statistics and Information Systems: Maternal Mortality Ratio. 2016.
    1. WHO, UNICEF. Every Newborn: An Action Plan To End Preventable Deaths. Geneva: World Health Organization; 2014. Available from: .
    1. Creanga A, Berg CJ, Syverson C, Seed K, Bruce FC, Callaghan WM. Pregnancy-related mortality in the United States, 2006–2010. Obstet Gynecol. 2015;125(1):5–12. doi: 10.1097/AOG.0000000000000564.
    1. World Health Organization (WHO) Evaluating the quality of care for severe pregnancy complications: the WHO near-miss approach for maternal health. Bull World Health Organ. 2011;87(10):1–29.
    1. Callaghan WM, Grobman WA, Kilpatrick SJ, Main EK, D’Alton M. Facility-based identification of women with severe maternal morbidity: it is time to start. Obstet Gynecol. 2014;123(5):978–981. doi: 10.1097/AOG.0000000000000218.
    1. Say L, Chou D, Gemmill A, Tunçalp Ö, Moller AB, Daniels J, et al. Global causes of maternal death: a WHO systematic analysis. Lancet Glob Heal. 2014;2(6):323–333. doi: 10.1016/S2214-109X(14)70227-X.
    1. Main EK, Abreo A, Mcnulty J, Gilbert W, Mcnally C, Poeltler D, et al. Measuring severe maternal morbidity: validation of potential measures. Am J Obstet Gynecol. 2016;214(5):643.e1–643.e10. doi: 10.1016/j.ajog.2015.11.004.
    1. World Health Organization (WHO) Born Too Soon: The Global Action Report on Preterm Birth. 2012.
    1. National Perinatal Information Center (NPIC) Unexpected Newborn Complications Update ( NQF # 716 “Healthy Term Newborn”) 2013.
    1. Julka A, Vander HK. Shoulder sequelae of neonatal brachial plexus injuries: orthopedic assessment and management. J Pediatr Rehabil Med. 2011;4(2):131–140.
    1. Mason DC, Ciervo C. a. Brachial plexus injuries in neonates: an osteopathic approach. J Am Osteopath Assoc. 2009;109(2):87–91.
    1. Mahmud A, Morris E, Johnson S, Ismail K. Developing core patient-reported outcomes in maternity: PRO-Maternity. BJOG An Int J Obstet Gynaecol. 2014;121:15–19. doi: 10.1111/1471-0528.12901.
    1. National Perinatal Epidemiology Unit. National Survey of Women’s experience of maternity care. 2014; Available from:
    1. Miller Y, Thompson R, Porter J, Armanasco A. Having a baby in Queensland: your story. 2012. Available from:
    1. Reeve BB, Wyrwich KW, Wu AW, Velikova G, Terwee CB, Snyder CF, et al. ISOQOL recommends minimum standards for patient-reported outcome measures used in patient-centered outcomes and comparative effectiveness research. Qual Life Res. 2013;22(8):1889–1905. doi: 10.1007/s11136-012-0344-y.
    1. Hollins Martin CJ, Martin CR. Development and psychometric properties of the birth satisfaction scale-revised (BSS-R) Midwifery. 2014;30(6):610–619. doi: 10.1016/j.midw.2013.10.006.
    1. Pollard D, Guill M. The Relationship between baseline self efficacy and breastfeeding duration. South Online J Nurs Res. 2011;9(4).
    1. Bennett IM, et al. Efficiency of a two-item pre-screen to REduce the burden of depression screening in pregnancy and postpartum: an IMPLICIT network study. J Am Board Fam Med. 2008;21(4):317–325. doi: 10.3122/jabfm.2008.04.080048.
    1. Cox JL, Sagovsky JMHR. Detection of Postnatal Depression Development of the 10-item Edinburgh Postnatal Depression Scale. 1987;50:782–7.
    1. Bergink V, Kooistra L, Berg MPL, Den WH. Validation of the Edinburgh Depression Scale during pregnancy. J Psychosom Res. 2011;70(4):385–389. doi: 10.1016/j.jpsychores.2010.07.008.
    1. Dias AG, Roberts CJ, Lippa J, Arora J, Lundstrom M, Rolfson O, et al. Benchmarking outcomes that matter most to patients: the GLOBE Programme. EMJ. 2017;2(2):42–49.
    1. International Consortium for Health Outcomes Measurement. Available from:
    1. Thom DH, Rortveit G. Prevalence of postpartum urinary incontinence: a systematic review. Acta Obstet Gynecol Scand. 2010;89(12):1511–1522. doi: 10.3109/00016349.2010.526188.
    1. Handa VL, Zyczynski HM, Burgio KL, Fitzgerald MP, Borello-France D, Janz NK, et al. The impact of fecal and urinary incontinence on quality of life 6 months after childbirth. Am J Obstet Gynecol. 2007;197(6):636.e1–636.e6. doi: 10.1016/j.ajog.2007.08.020.
    1. Ansar H, Adil F, Munir AA. Unreported urinary and anal incontinence in women. J Liaquat Univ Med Heal Sci. 2005;4(2):54–56. doi: 10.22442/jlumhs.05420059.
    1. Black N, Burke L, Forrest CB, Ravens Sieberer UH, Ahmed S, Valderas JM, et al. Patient-reported outcomes: pathways to better health, better services, and better societies. Qual Life Res. 2016;25(5):1103–1112. doi: 10.1007/s11136-015-1168-3.
    1. Collins KJ, Draycott T. Measuring quality of maternity care. Best Pract Res Clin Obstet Gynaecol. 2015; Available from:. 10.1016/j.bpobgyn.2015.03.021.
    1. Simms RA, Yelland A, Ping H, Beringer AJ, Draycott TJ, Fox R. Using data and quality monitoring to enhance maternity outcomes: a qualitative study of risk managers’ perspectives. BMJ Qual Saf. 2014;23(6):457–464. doi: 10.1136/bmjqs-2013-002025.
    1. Zeitlin J, Wildman K, Bréart G, Alexander S, Barros H, Blondel B, et al. Selecting an indicator set for monitoring and evaluating perinatal health in Europe: Criteria, methods and results from the PERISTAT project. Eur J Obstet Gynecol Reprod Biol. 2003;111(SUPPL. 1).
    1. Center for Medicare and Medicaid Services. 2015 Core Set of Maternity Measures for Medicaid and CHIP. 2015. Available from:
    1. World Health Organization (WHO) WHO Statement on Caesarean Section Rates. 2015. pp. 1–8.
    1. Molina G, Weiser TG, Lipsitz SR, Esquivel MM, Uribe-Leitz T, Azad T, et al. Relationship between cesarean delivery rate and maternal and neonatal mortality. JAMA J Am Med Assoc. 2015;314(21):2263–2270. doi: 10.1001/jama.2015.15553.
    1. Zuarez-Easton S, Shalev E, Salim R. Trend in major neonatal and maternal morbidities accompanying the rise in the cesarean delivery rate. Sci Rep. 2015;5:12565. doi: 10.1038/srep12565.
    1. Callaghan WM, Creanga A, Kuklina EV. Severe Maternal Morbidity Among Delivery and Postpartum Hospitalizations in the United States. Obstet Gynecol. 2012;120(5):1. doi: 10.1097/AOG.0b013e31826d60c5.
    1. Belfort MA, Clark SL, Saade GR, Kleja K, Dildy GA, Van Veen TR, et al. Hospital readmission after delivery: evidence for an increased incidence of nonurogenital infection in the immediate postpartum period. Am J Obstet Gynecol. 2010;202(1):35.e1–35.e7. doi: 10.1016/j.ajog.2009.08.029.
    1. Billings J. Using administrative data to monitor access, identify disparities, and assess performance of the safety net. Agency Healthc Res Qual Arch. Available from: .
    1. Khwaja HA, Syed H, Cranston DW. Coding errors: a comparative analysis of hospital and prospectively collected departmental data. BJU Int. 2002;89(3):178–180. doi: 10.1046/j.1464-4096.2001.01428.x.
    1. Franklin PD, Allison JJ, Ayers DC. A patient-centered research consortium for comparative effectiveness in Total joint replacement. JAMA J Am Med Assoc. 2012;308(12):1217–1218. doi: 10.1001/jama.2012.12568.
    1. Rolfson O, Karrholm J, Dahlberg L, Garellick G. Patient-reported outcomes in the Swedish hip arthroplasty register: results of a nationwide prospective observational study. J Bone Jt Surg. 2011;93(7):867–875. doi: 10.1302/0301-620X.93B7.25737.
    1. Department of Health- National Health Service United Kingdom . Guidance on the routine collection of Patient Reported Outcome Measures ( PROMs ) 2009.
    1. PharmAccess Foundation . How mobile technology helps us understand what matters most to patients. 2018.

Source: PubMed

Подписаться