Data quality monitoring and performance metrics of a prospective, population-based observational study of maternal and newborn health in low resource settings

Shivaprasad S Goudar, Kristen B Stolka, Marion Koso-Thomas, Narayan V Honnungar, Shivanand C Mastiholi, Umesh Y Ramadurg, Sangappa M Dhaded, Omrana Pasha, Archana Patel, Fabian Esamai, Elwyn Chomba, Ana Garces, Fernando Althabe, Waldemar A Carlo, Robert L Goldenberg, Patricia L Hibberd, Edward A Liechty, Nancy F Krebs, Michael K Hambidge, Janet L Moore, Dennis D Wallace, Richard J Derman, Kodkany S Bhalachandra, Carl L Bose, Shivaprasad S Goudar, Kristen B Stolka, Marion Koso-Thomas, Narayan V Honnungar, Shivanand C Mastiholi, Umesh Y Ramadurg, Sangappa M Dhaded, Omrana Pasha, Archana Patel, Fabian Esamai, Elwyn Chomba, Ana Garces, Fernando Althabe, Waldemar A Carlo, Robert L Goldenberg, Patricia L Hibberd, Edward A Liechty, Nancy F Krebs, Michael K Hambidge, Janet L Moore, Dennis D Wallace, Richard J Derman, Kodkany S Bhalachandra, Carl L Bose

Abstract

Background: To describe quantitative data quality monitoring and performance metrics adopted by the Global Network's (GN) Maternal Newborn Health Registry (MNHR), a maternal and perinatal population-based registry (MPPBR) based in low and middle income countries (LMICs).

Methods: Ongoing prospective, population-based data on all pregnancy outcomes within defined geographical locations participating in the GN have been collected since 2008. Data quality metrics were defined and are implemented at the cluster, site and the central level to ensure data quality. Quantitative performance metrics are described for data collected between 2010 and 2013.

Results: Delivery outcome rates over 95% illustrate that all sites are successful in following patients from pregnancy through delivery. Examples of specific performance metric reports illustrate how both the metrics and reporting process are used to identify cluster-level and site-level quality issues and illustrate how those metrics track over time. Other summary reports (e.g. the increasing proportion of measured birth weight compared to estimated and missing birth weight) illustrate how a site has improved quality over time.

Conclusion: High quality MPPBRs such as the MNHR provide key information on pregnancy outcomes to local and international health officials where civil registration systems are lacking. The MNHR has measures in place to monitor data collection procedures and improve the quality of data collected. Sites have increasingly achieved acceptable values of performance metrics over time, indicating improvements in data quality, but the quality control program must continue to evolve to optimize the use of the MNHR to assess the impact of community interventions in research protocols in pregnancy and perinatal health.

Trial registration number: NCT01073475.

Figures

Figure 1
Figure 1
Pregnancy outcome metrics: Proportion of enrolled subjects with a delivery outcome (% of expected) in the Global Network’s Maternal Newborn Health Registry by year 2010-2013
Figure 2
Figure 2
Pregnancy outcome metrics: Month-to-month birth variability over 6-months at a given site in the Global Network from March to August 2013 – Blue lines represent clusters with high variability and red lines represent clusters with low variability.
Figure 3
Figure 3
Mortality outcome metrics: Proportion of clusters with a stillbirth to early neonatal death ratio in the following categories at a given Global Network site by year 2010-2013.
Figure 4
Figure 4
Key variable metrics: Proportion of missing, estimated, and measured birth weights obtained at a given Global Network site by year 2010-2013.
Figure 5
Figure 5
Process metrics: Proportion of deliveries at Global Network sites from 2010-2013 where time between delivery and completion of delivery form is <4 weeks.

References

    1. UNICEF. Committing to Child Survival: A Promise Renewed, Progress Report 2014. 2014. . Accessed on January 15, 2015.
    1. WHO; UNICEF; UNFPA. World Bank, United Nations Population Division: Trends in Maternal Mortality: 1990 to 2013. 2013. . Accessed on January 15, 2015.
    1. Målqvist M, Eriksson L, Nguyen TN, Fagerland LI, Dinh PH, Wallin L, Ewald U, Persson L-A. Unreported births and deaths, a severe obstacle for improved neonatal survival in low-income countries; a population based study. BMC Int Health Hum Rights. 2008;8:4. doi: 10.1186/1472-698X-8-4.
    1. Hill K, Choi Y. Neonatal mortality in the developing world. Demogr Res. 2006;14:429–452.
    1. Irgens LM. The Medical Birth Registry of Norway. Epidemiological research and surveillance throughout 30 years. Acta Obstet Gynecol Scand. 2000;79:435–439. doi: 10.1080/j.1600-0412.2000.079006435.x.
    1. Goudar SS, Carlo Wa, McClure EM, Pasha O, Patel A, Esamai F, Chomba E, Garces A, Althabe F, Kodkany B, Sami N, Derman RJ, Hibberd PL, Liechty Ea, Krebs NF, Hambidge KM, Buekens P, Moore J, Wallace D, Jobe AH, Koso-Thomas M, Wright LL, Goldenberg RL. The Maternal and Newborn Health Registry Study of the Global Network for Women’s and Children's Health Research. Int J Gynaecol Obstet. 2012;118:190–3. doi: 10.1016/j.ijgo.2012.04.022.
    1. Bergsjo P, Irgens LM, Lie RT. Registry based perinatal research. Acta Obs Gynecol Scand. 2000;79:433–434.
    1. Vaktskjold A, Talykova L, Chashchin V, Nieboer E, Odland JO. The Kola Birth Registry and perinatal mortality in Moncegorsk, Russia. Acta Obs Gynecol Scand. 2004;83
    1. Anda EE, Nieboer E, Voitov AV, Kovalenko AA, Lapina YM, Voitova EA, Kovalenko LF, Odland JO. Implementation, quality control and selected pregnancy outcomes of the Murmansk County Birth Registry in Russia. Int J Circumpolar Health. 2008;67:318–334.
    1. Chiba Y, Oguttu MA, Nakayama T. Quantitative and qualitative verification of data quality in the childbirth registers of two rural district hospitals in Western Kenya. Midwifery. 2012;28:329–39. doi: 10.1016/j.midw.2011.05.005.
    1. Bray F, Parkin DM. Evaluation of data quality in the cancer registry: principles and methods. Part I: comparability, validity and timeliness. Eur J Cancer. 2009;45:747–55. doi: 10.1016/j.ejca.2008.11.032.
    1. Parkin DM, Bray F. Evaluation of data quality in the cancer registry: principles and methods Part II. Completeness. Eur J Cancer. 2009;45:756–64. doi: 10.1016/j.ejca.2008.11.033.
    1. Larsen IK, Småstuen M, Johannesen TB, Langmark F, Parkin DM, Bray F, Møller B. Data quality at the Cancer Registry of Norway: an overview of comparability, completeness, validity and timeliness. Eur J Cancer. 2009;45:1218–31. doi: 10.1016/j.ejca.2008.10.037.
    1. Bose C, Bausserman M, Goldenberg R, McClure E. The Global Network Maternal Newborn Health Registry: An Overview. BMC Reprod Heal. 2015. in press .
    1. Pasha O, McClure EM, Wright LL, Saleem S, Goudar SS, Chomba E, Patel A, Esamai F, Garces A, Althabe F, Kodkany B, Mabeya H, Manasyan A, Carlo WA, Derman RJ, Hibberd PL, Liechty EK, Krebs N, Hambidge KM, Buekens P, Moore J, Jobe AH, Koso-Thomas M, Wallace DD, Stalls S, Goldenberg RL. A combined community- and facility-based approach to improve pregnancy outcomes in low-resource settings: a Global Network cluster randomized trial. BMC Med. 2013;11:12. doi: 10.1186/1741-7015-11-12.
    1. Althabe F, Belizán JM, Mcclure EM, Hemingway-foday J, Berrueta M, Mazzoni A, Ciganda A, Goldenberg RL, Esamai F, Nyongesa P, Ayunga S, Liechty EA, Garces AL, Figueroa L, Hambidge KM, Chiwila M, Manasyan A, Pineda S, Meleth S, Thorsten V, Stolka K, Wallace DD, Koso-thomas M, Jobe AH, Buekens PM. A population-based, multifaceted strategy to implement antenatal corticosteroid treatment versus standard care for the reduction of neonatal mortality due to preterm birth in low-income and middle-income countries: the ACT cluster- randomised trial. Lancet. 2014;6736:1–11.
    1. Bang A, Bellad R, Gisore P, Hibberd P, Patel A, Goudar S, Esamai F, Goco N, Meleth S, Derman RJ, Liechty Ea, McClure E, Carlo Wa, Wright LL. Implementation and evaluation of the Helping Babies Breathe curriculum in three resource limited settings: does Helping Babies Breathe save lives? A study protocol. BMC Pregnancy Childbirth. 2014;14:116. doi: 10.1186/1471-2393-14-116.
    1. Pasha O, Goudar S, Patel A, Garces A, Esamai F, Postpartum contraceptive use and unmet need for family planning in five low-income countries. Reprod Health. in press .
    1. Mahapatra P, Shibuya K, Lopez AD, Coullare F, Notzon FC, Rao C, Szreter S. Civil registration systems and vital statistics: successes and missed opportunities. Lancet. 2007;370:1653–63. doi: 10.1016/S0140-6736(07)61308-7.
    1. Mathers CD, Fat DM, Inoue M, Rao C, Lopez AD. Counting the dead and what they died from: an assessment of the global status of cause of death data. Bull World Health Organ. 2005;015784
    1. Cousens S, Blencowe H, Stanton C, Chou D, Ahmed S, Steinhardt L, Creanga Aa, Tunçalp O, Balsara ZP, Gupta S, Say L, Lawn JE. National, regional, and worldwide estimates of stillbirth rates in 2009 with trends since 1995: a systematic analysis. Lancet. 2011;377:1319–30. doi: 10.1016/S0140-6736(10)62310-0.
    1. Oestergaard MZ, Inoue M, Yoshida S, Mahanani WR, Gore FM, Cousens S, Lawn JE, Mathers CD. Neonatal mortality levels for 193 countries in 2009 with trends since 1990: a systematic analysis of progress, projections, and priorities. PLoS Med. 2011;8:e1001080. doi: 10.1371/journal.pmed.1001080.
    1. Glinianaia SV, Rankin J, Pless-Mulloli T, Pearce MS, Charlton M, Parker L. Temporal changes in key maternal and fetal factors affecting birth outcomes: a 32-year population-based study in an industrial city. BMC Pregnancy Childbirth. 2008;8:39. doi: 10.1186/1471-2393-8-39.
    1. Aqil A, Lippeveld T, Hozumi D. PRISM framework: a paradigm shift for designing, strengthening and evaluating routine health information systems. Health Policy Plan. 2009;24:217–28. doi: 10.1093/heapol/czp010.
    1. Registrar General. SRS BULLETIN: Sample Registration System India. 2013.

Source: PubMed

Sponsor e collaboratori

Condizioni mediche

Interventi farmacologici

3
Sottoscrivi