Development and Validation of an Index to Measure the Quality of Facility-Based Labor and Delivery Care Processes in Sub-Saharan Africa

Vandana Tripathi, Cynthia Stanton, Donna Strobino, Linda Bartlett, Vandana Tripathi, Cynthia Stanton, Donna Strobino, Linda Bartlett

Abstract

Background: High quality care is crucial in ensuring that women and newborns receive interventions that may prevent and treat birth-related complications. As facility deliveries increase in developing countries, there are concerns about service quality. Observation is the gold standard for clinical quality assessment, but existing observation-based measures of obstetric quality of care are lengthy and difficult to administer. There is a lack of consensus on quality indicators for routine intrapartum and immediate postpartum care, including essential newborn care. This study identified key dimensions of the quality of the process of intrapartum and immediate postpartum care (QoPIIPC) in facility deliveries and developed a quality assessment measure representing these dimensions.

Methods and findings: Global maternal and neonatal care experts identified key dimensions of QoPIIPC through a modified Delphi process. Experts also rated indicators of these dimensions from a comprehensive delivery observation checklist used in quality surveys in sub-Saharan African countries. Potential QoPIIPC indices were developed from combinations of highly-rated indicators. Face, content, and criterion validation of these indices was conducted using data from observations of 1,145 deliveries in Kenya, Madagascar, and Tanzania (including Zanzibar). A best-performing index was selected, composed of 20 indicators of intrapartum/immediate postpartum care, including essential newborn care. This index represented most dimensions of QoPIIPC and effectively discriminated between poorly and well-performed deliveries.

Conclusions: As facility deliveries increase and the global community pays greater attention to the role of care quality in achieving further maternal and newborn mortality reduction, the QoPIIPC index may be a valuable measure. This index complements and addresses gaps in currently used quality assessment tools. Further evaluation of index usability and reliability is needed. The availability of a streamlined, comprehensive, and validated index may enable ongoing and efficient observation-based assessment of care quality during labor and delivery in sub-Saharan Africa, facilitating targeted quality improvement.

Conflict of interest statement

Competing Interests: The authors have declared that no competing interests exist.

Figures

Fig 1. Delphi process to identify the…
Fig 1. Delphi process to identify the key dimensions of QoPIIPC
Fig 2. AUROCs (discrimination of good total…
Fig 2. AUROCs (discrimination of good total quality score (top 25%)): Recommended QoPIIPC index.
Fig 3. AUROCs (discrimination of good total…
Fig 3. AUROCs (discrimination of good total quality score (top 25%)): Comparison of the 3+ index and the recommended index.
Fig 4. Frequency of performance of items…
Fig 4. Frequency of performance of items in recommended QoPIIPC index across countries.

References

    1. World Health Organization; Trends in maternal mortality: 1990 to 2013 Estimates developed by WHO, UNICEF, UNFPA and the World Bank. Geneva: WHO; 2014. 56 p. 10.1186/1471-2393-14-299
    1. Lozano R, Wang H, Foreman KJ, Rajaratnam JK, Naghavi M, Marcus JR, et al. Progress towards Millennium Development Goals 4 and 5 on maternal and child mortality: an updated systematic analysis. Lancet 2011; 378: 1139–65. 10.1016/S0140-6736(11)61337-8
    1. Hogan MC, Foreman KJ, Naghavi M, Ahn SY, Wang M, Makela SM, et al. Maternal mortality for 181 countries, 1980–2008: A systematic analysis of progress towards millennium development goal 5. Lancet 2010; 375: 1609–23. 10.1016/S0140-6736(10)60518-1
    1. Lawn JE, Kerber K, Enweronu-Laryea C, Cousens S. 3.6 million neonatal deaths—what is progressing and what is not? Semin Perinatol 2010; 34: 371–86. 10.1053/j.semperi.2010.09.011
    1. Oestergaard MZ, Inoue M, Yoshida S, Mahanani WR, Gore FM, Cousens S, et al.; United Nations Inter-Agency Group for Child Mortality Estimation and the Child Health Epidemiology Reference Group. Neonatal mortality levels for 193 countries in 2009 with trends since 1990: a systematic analysis of progress, projections, and priorities. PLoS Med 2011; 8: e1001080 10.1371/journal.pmed.1001080
    1. Lawn JE, Lee AC, Kinney M, Sibley L, Carlo WA, Paul VK, et al. Two million intrapartum-related stillbirths and neonatal deaths: where, why, and what can be done? Int J Gynaecol Obstet 2009; 107 Suppl 1: S5–18, S19 10.1016/j.ijgo.2009.07.016
    1. United Nations Statistics Division [Internet]. New York: United Nations; c2008. Millennium Development Goals Indicators. Available from: .
    1. Dzakpasu S, Soremekun S, Manu A, Ten Asbroek G, Tawiah C, Hurt L, et al. Impact of free delivery care on health facility delivery and insurance coverage in Ghana's Brong Ahafo Region. PLoS One 2012; 7: e49430 10.1371/journal.pone.0049430
    1. Lim SS, Dandona L, Hoisington JA, James SL, Hogan MC, Gakidou E. India's Janani Suraksha Yojana, a conditional cash transfer programme to increase births in health facilities: an impact evaluation. Lancet 2010; 375: 2009–23. 10.1016/S0140-6736(10)60744-1
    1. Hodgins S. Achieving better maternal and newborn outcomes: coherent strategy and pragmatic, tailored implementation. Glob Health Sci Pract 2013; 1: 146–153. 10.9745/GHSP-D-13-00030
    1. World Health Organization; Pregnancy, Childbirth, Postpartum and Newborn Care: A Guide for Essential Practice, Integrated Management of Pregnancy and Childbirth Toolkit. Geneva: WHO; 2006. 180 p.
    1. Shankar A, Bartlett L, Fauveau V, Islam M, Terreri N. Countdown to 2015 Maternal Health Group. Delivery of MDG 5 by active management with data. Lancet 2008; 371: 1223–4. 10.1016/S0140-6736(08)60536-X
    1. Miller S, Cordero M, Coleman AL, Figueroa J, Brito-Anderson S, Dabagh R, et al. Quality of care in institutionalized deliveries: The paradox of the Dominican Republic. Int J Gynaecol Obstet 2003; 82: 89, 103; discussion 87–8.
    1. Randive B, Diwan V, De Costa A. India's Conditional Cash Transfer Programme (the JSY) to Promote Institutional Birth: Is There an Association between Institutional Birth Proportion and Maternal Mortality? PLoS One 2013; 8: e67452
    1. Powell-Jackson T, Neupane BD, Tiwari S, Tumbahangphe K, Manandhar D. The impact of Nepal's national incentive programme to promote safe delivery in the district of Makwanpur. Adv Health Econ Health Serv Res 2009; 21: 221–49.
    1. Baral G. An assessment of the safe delivery incentive program at a tertiary level hospital in Nepal. J Nepal Health Res Counc 2012; 10: 118–24.
    1. Firoz T, Sanghvi H, Merialdi M, von Dadelszen P. Pre-eclampsia in low and middle income countries. Best Pract Res Clin Obstet Gynaecol 2011; 25: 537–48. 10.1016/j.bpobgyn.2011.04.002
    1. Harvey SA, Blandón YC, McCaw-Binns A, Sandino I, Urbina L, Rodríguez C, et al. Nicaraguan Maternal and Neonatal Health Quality Improvement Group. Are skilled birth attendants really skilled? A measurement method, some disturbing results and a potential way forward. Bull World Health Organ 2007; 85:783–90.
    1. Stanton C, Armbruster D, Knight R, Ariawan I, Gbangbade S, Getachew A, et al. Use of active management of the third stage of labour in seven developing countries. Bull World Health Organ 2009; 87: 207–15.
    1. Wall SN, Lee AC, Niermeyer S, English M, Keenan WJ, Carlo W, et al. Neonatal resuscitation in low-resource settings: what, who, and how to overcome challenges to scale up? Int J Gynaecol Obstet 2009; 107: S47–62, S63–4. 10.1016/j.ijgo.2009.07.013
    1. Souza JP, Gülmezoglu AM, Vogel J, Carroli G, Lumbiganon P, Qureshi Z, et al. Moving beyond essential interventions for reduction of maternal mortality (the WHO Multi-country Survey on Maternal and Newborn Health): a cross-sectional study. Lancet 2013; 381: 1747–55. 10.1016/S0140-6736(13)60686-8
    1. Campbell OM, Graham WJ; Lancet Maternal Survival Series steering group. Strategies for reducing maternal mortality: getting on with what works. Lancet 2006; 368: 1284–99.
    1. Lawn JE, Kerber K, Enweronu-Laryea C, Massee Bateman O. Newborn survival in low resource settings—are we delivering? BJOG 2009; 116: 49–59. 10.1111/j.1471-0528.2009.02328.x
    1. Ronsmans C, Campbell O. Quantifying the fall in mortality associated with interventions related to hypertensive diseases of pregnancy. BMC Public Health 2011; 11 Suppl 1: S8 10.1186/1471-2458-11-S1-S8
    1. Wall SN, Lee AC, Carlo W, Goldenberg R, Niermeyer S, Darmstadt GL, et al. Reducing intrapartum-related neonatal deaths in low- and middle-income countries-what works? Semin Perinatol 2010; 34:395–407. 10.1053/j.semperi.2010.09.009
    1. Hinderaker SG, Olsen BE, Bergsjo PB, Gasheka P, Lie RT, Havnen J, et al. Avoidable stillbirths and neonatal deaths in rural Tanzania. BJOG 2003; 110: 616–23.
    1. Kongnyuy EJ, Mlava G, van den Broek N. Facility-based maternal death review in three districts in the central region of Malawi: An analysis of causes and characteristics of maternal deaths. Womens Health Issues 2009; 19: 14–20. 10.1016/j.whi.2008.09.008
    1. Pattinson RC. Challenges in saving babies—avoidable factors, missed opportunities and substandard care in perinatal deaths in South Africa. S Afr Med J 2003; 93: 450–5.
    1. Abouchadi S, Alaoui AB, Meski FZ, Bezad R, De Brouwere V. Preventable maternal mortality in Morocco: the role of hospitals. Trop Med Int Health 2013; 18: 444–50. 10.1111/tmi.12065
    1. Kruk ME, Mbaruku G, McCord CW, Moran M, Rockers PC, Galea S. Bypassing primary care facilities for childbirth: A population-based study in rural Tanzania. Health Policy Plan 2009; 24: 279–88. 10.1093/heapol/czp011
    1. Parkhurst JO, Ssengooba F. Assessing access barriers to maternal health care: Measuring bypassing to identify health centre needs in rural Uganda. Health Policy Plan 2009; 24: 377–84. 10.1093/heapol/czp023
    1. Mselle LT, Moland KM, Mvungi A, Evjen-Olsen B, Kohi TW. Why give birth in health facility? Users' and providers' accounts of poor quality of birth care in Tanzania. BMC Health Serv Res 2013; 13: 174 10.1186/1472-6963-13-174
    1. World Health Organization; Managing Complications in Pregnancy and Childbirth: A Guide for Midwives and Doctors. Geneva, Switzerland: WHO; 2003. 19 p.
    1. Maine D. What’s So Special About Maternal Mortality? In: Barzelatto J, Berer M, Sundari RTK, editors. Safe motherhood initiatives: critical issues. Oxford: Blackwell Science/Reproductive Health Matters; 1999. p.175–182.
    1. Granja AC, Machungo F, Bergstrom S. Avoidability of maternal death in Mozambique: audit and retrospective risk assessment in 106 consecutive cases. Afr J Health Sci 2008; 7: 83–7.
    1. Donabedian A. The Definition of Quality and Approaches to Its Management, Vol 1: Explorations in Quality Assessment and Monitoring. Ann Arbor: Health Administration Press; 1980. 163 p.
    1. Donabedian A. The quality of care. How can it be assessed? JAMA 1988; 260: 1743–8.
    1. Salinas AM, Coria I, Reyes H, Zambrana M. Effect of quality of care on preventable perinatal mortality. Int J Qual Health Care 1997; 9: 93–9.
    1. Anwar I. Perceptions of quality of care for serious illness at different levels of facilities in a rural area of Bangladesh. J Health Popul Nutr 2009; 27: 396–405.
    1. Baltussen RM, Ye Y, Haddad S, Sauerborn RS. Perceived quality of care of primary health care services in Burkina Faso. Health Policy Plan 2002; 17: 42–8.
    1. Admasu K, Haile-Mariam A, Bailey P. Indicators for availability, utilization, and quality of emergency obstetric care in Ethiopia, 2008. Int J Gynaecol Obstet 2011; 115: 101–5. 10.1016/j.ijgo.2011.07.010
    1. Bailey P, Paxton A, Lobis S, Fry D. The availability of life-saving obstetric services in developing countries: an in-depth look at the signal functions for emergency obstetric care. Int J Gynaecol Obstet 2006; 93: 285–91.
    1. Spector JM, Agrawal P, Kodkany B, Lipsitz S, Lashoher A, Dziekan G, et al. Improving quality of care for maternal and newborn health: prospective pilot study of the WHO safe childbirth checklist program. PLoS One 2012; 7:e35151 10.1371/journal.pone.0035151
    1. Gouws E, Bryce J, Pariyo G, Armstrong Schellenberg J, Amaral J, Habicht JP. Measuring the quality of child health care at first-level facilities. Soc Sci Med 2005; 61:613–25.
    1. Broughton EI, Ikram AN, Sahak I. How accurate are medical record data in Afghanistan's maternal health facilities? An observational validity study. BMJ Open 2014; 3: 10.
    1. Chiba Y, Oguttu MA, Nakayama T. Quantitative and qualitative verification of data quality in the childbirth registers of two rural district hospitals in Western Kenya. Midwifery 2012; 28: 329–39. 10.1016/j.midw.2011.05.005
    1. Duffy S, Crangle M. Delivery room logbook—fact or fiction? Trop Doct 2009; 39: 145–9. 10.1258/td.2009.080433
    1. Hermida J, Nicholas DD, Blumenfeld SN. Comparative validity of three methods for assessment of the quality of primary health care. Int J Qual Health Care 1999; 11: 429–33
    1. Flood M, Small R. Researching labour and birth events using health information records: methodological challenges. Midwifery 2009; 25: 701–10. 10.1016/j.midw.2007.12.003
    1. Lain SJ, Hadfield RM, Raynes-Greenow CH, Ford JB, Mealing NM, Algert CS, et al. Quality of data in perinatal population health databases: a systematic review. Med Care 2012; 50: e7–20 10.1097/MLR.0b013e31821d2b1d
    1. Yasmeen S, Romano PS, Schembri ME, Keyzer JM, Gilbert WM. Accuracy of obstetric diagnoses and procedures in hospital discharge data. Am J Obstet Gynecol 2006; 194: 992–1001.
    1. Hulton LA, Matthews Z, Stones RW. Applying a framework for assessing the quality of maternal health services in urban India. Soc Sci Med 2007; 64: 2083–95.
    1. Bazant E, Rakotovao JP, Rasolofomanana JR, Tripathi V, Gomez P, Favero R, et al. [Quality of care to prevent and treat postpartum hemorrhage and pre-eclampsia/eclampsia: an observational assessment in Madagascar's hospitals]. Med Sante Trop 2013; 23: 168–75. 10.1684/mst.2013.0161
    1. Geller SE, Cox SM, Callaghan WM, Berg CJ. Morbidity and mortality in pregnancy: laying the groundwork for safe motherhood. Women’s Health Issues 2006; 16: 176–88.
    1. Holt J, Fagerli I, Holdø B, Vold IN. Audit of neonatal deaths of nonmalformed infants of 34 or more weeks' gestation: unavoidable catastrophic events or suboptimal care? Acta Obstet Gynecol Scand 2002; 81: 899–904.
    1. Lawn JE, Cousens S, Zupan J; Lancet Neonatal Survival Steering Team. 4 million neonatal deaths: when? Where? Why? Lancet 2005; 365: 891–900.
    1. Ronsmans C, Graham WJ; Lancet Maternal Survival Series steering group. Maternal mortality: who, when, where, and why. Lancet 2006; 368:1189–200.
    1. Boulkedid R, Abdoul H, Loustau M, Sibony O, Alberti C. Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review. PLoS One 2011; 6:e20476 10.1371/journal.pone.0020476
    1. Hsu C-C, Sandford BA. The Delphi technique: Making sense of consensus. Practical Assessment, Research and Evaluation [Internet]. 2007; 12. Available at: .
    1. UNICEF [Internet]. Info by Country. New York: UNICEF; c2012. Available at: .
    1. UNICEF. Levels and Trends in Child Mortality; Report 2010. Estimates Developed by the UN Inter-Agency Group for Child Mortality Estimation. New York: 2010. 24p.
    1. World Health Organization [Internet]. Geneva: WHO; c2011. Atlas of Health Statistics of the African Region 2011. Available at: .
    1. ACCESS Project. Best Practices in Maternal and Newborn Care: A Learning Resource Package for Essential and Basic Emergency Obstetric and Newborn Care. Baltimore: Jhpiego; 2008. 522 p.
    1. Prevention of Postpartum Hemorrhage Initiative [Internet]. Seattle: PATH; c2006. AMTSL Survey: Tools to Conduct a National Survey. Available at: .
    1. MCHIP [Internet]. Washington: MCHIP; c2012. Maternal and Newborn Quality of Care Surveys. Available: .
    1. Plotkin M, Tibaijuka G, Makene CL, Currie S, Lacoste M. Quality of Care for Prevention and Management of Common Maternal and Newborn Complications: A study of 12 regions in Tanzania. Baltimore: MCHIP/Jhpiego; 2011. 48 p.
    1. Rasolofomanana JR, Rakotovao JP, Bazant E, Tripathi V. Quality of Care of the Prevention and Management of Common Maternal and Newborn Complications in Health Facilities in Madagascar. Baltimore: MCHIP/Jhpiego; 2011. 43 p.
    1. Kagema F, Ricca J, Rawlins B, Rosen H, Lynam P, Kidula N. Quality of Care for Prevention and Management of Common Maternal and Newborn Complications: Findings from a National Health Facility Survey in Kenya: Are Services Provided According to International Standards? Baltimore: MCHIP/Jhpiego; 2011. 34 p.
    1. Kenya National Coordinating Agency for Population and Development, Kenya Ministry of Medical Services, Kenya Ministry of Public Health and Sanitation, Kenya National Bureau of Statistics, ICF Macro. Kenya Service Provision Assessment Survey 2010. Nairobi: National Coordinating Agency for Population and Development, Ministry of Medical Services, Ministry of Public Health and Sanitation, Kenya National Bureau of Statistics, and ICF Macro; 2011. 695 p.
    1. Makene C, Plotkin M, Currie S, Bishanga D, Ugwi P, Louis H, et al. Improvements in newborn care and newborn resuscitation following a quality improvement program at scale: results from a before and after study in Tanzania. BMC Pregnancy Childbirth 2014;14:381 10.1186/s12884-014-0381-3
    1. Akobeng AK. Understanding diagnostic tests 3: Receiver operating characteristic curves. Acta Paediatr 2007; 96: 644–7.
    1. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982; 143: 29–36.
    1. Leonard KL, Masatu MC. The use of direct clinician observation and vignettes for health services quality evaluation in developing countries. Soc Sci Med 2005; 61: 1944–51.
    1. Gabrysch S, Civitelli G, Edmond KM, Mathai M, Ali M, Bhutta ZA, et al. New signal functions to measure the ability of health facilities to provide routine and emergency newborn care. PLoS Med 2012; 9: e1001340 10.1371/journal.pmed.1001340
    1. De Bruin-kooistra M, Amelink-Verburg M, Buitendijk SE, Westert GP. Finding the right indicators for assessing quality midwifery care. Int J Qual Health Care 2012; 24: 301–10. 10.1093/intqhc/mzs006
    1. Lawn JE, Cousens S, Darmstadt GL, Paul V, Martines J. Why are 4 million newborn babies dying every year? Lancet 2004; 364: 2020
    1. Althabe F, Sosa C, Belizán JM, Gibbons L, Jacquerioz F, Bergel E. Cesarean section rates and maternal and neonatal mortality in low-, medium-, and high-income countries: an ecological study. Birth 2006; 33: 270–7.
    1. Souza JP, Cecatti JG, Haddad SM, Parpinelli MA, Costa ML, Katz L, et al.; Brazilian Network for Surveillance of Severe Maternal Morbidity Group; Brazilian Network for Surveillance of Severe Maternal Morbidity. The WHO maternal near-miss approach and the maternal severity index model (MSI): tools for assessing the management of severe maternal morbidity. PLoS One 2012; 7: e44129 10.1371/journal.pone.0044129
    1. Villar J, Valladares E, Wojdyla D, Zavaleta N, Carroli G, Velazco A, et al.; WHO 2005 global survey on maternal and perinatal health research group. Caesarean delivery rates and pregnancy outcomes: the 2005 WHO global survey on maternal and perinatal health in Latin America. Lancet 2006; 367: 1819–29.
    1. Bailit JL. Measuring the quality of inpatient obstetrical care. Obstet Gynecol Surv 2007; 62: 207–13
    1. Mainz J. Defining and classifying clinical indicators for quality improvement. Int J Qual Health Care 2003; 15: 523–30.
    1. Paxton A, Bailey P, Lobis S. The United Nations Process Indicators for emergency obstetric care: Reflections based on a decade of experience. Int J Gynaecol Obstet 2006; 95: 192–208.
    1. Goodburn EA. Using process indicators to monitor and evaluate obstetric services in developing countries. J Am Med Womens Assoc 2002; 57: 145–8.
    1. Dettrick Z, Firth S, Jimenez Soto E. Do strategies to improve quality of maternal and child health care in lower and middle income countries lead to improved outcomes? A review of the evidence. PLoS One 2013; 8: e83070 10.1371/journal.pone.0083070
    1. Nechochea E, Bossemeyer D. Standards-based management and recognition: A field guide. Baltimore: Jhpiego; 2003. 83 p.
    1. Rusa L, Ngirabega Jde D, Janssen W, Van Bastelaere S, Porignon D, et al. Performance-based financing for better quality of services in Rwandan health centres: 3-year experience. Trop Med Int Health 2009; 14: 830–7. 10.1111/j.1365-3156.2009.02292.x
    1. Eichler R, Auxila P, Pollock J. Performance-based payment to improve the impact of health services: Evidence from Haiti. World Bank Institute Online Journal: Flagship Program on Health Sector Reform and Sustainable Financing [Internet]. 2001. Available at: .
    1. Rowe AK. Potential of integrated continuous surveys and quality management to support monitoring, evaluation, and the scale-up of health interventions in developing countries. Am J Trop Med Hyg 2009; 80:971–9.

Source: PubMed

Sponsorer och medarbetare

Medicinska tillstånd

Läkemedelsinterventioner

3
Prenumerera