Comparison of psychometric properties between usual-week and past-week self-reported physical activity questionnaires: a systematic review

Kenji Doma, Renée Speyer, Anthony S Leicht, Reinie Cordier, Kenji Doma, Renée Speyer, Anthony S Leicht, Reinie Cordier

Abstract

The aim was to critically appraise the methodological quality of studies and determine the psychometric qualities of Past-week and Usual-week Physical Activity Questionnaires (PAQs). Data sources were obtained from Pubmed and Embase. The eligibility criteria for selecting studies included: 1) at least one psychometric property of PAQs was examined in adults; 2) the PAQs either had a recall period of usual 7-days (Usual-week PAQs) within the past 12 months or during the past 7-days (Past-week PAQs); and 3) PAQs were self-administered. Study quality was evaluated using the COSMIN taxonomy and the overall psychometric qualities evaluated using pre-established psychometric criteria. Overall, 45 studies were reviewed to assess the psychometric properties of 21 PAQs with the methodological quality of most studies showing good to excellent ratings. When the relationship between PAQs and other instruments (i.e., convergent validity) were compared between recall methods, Past-week PAQs appeared to have stronger correlations than Usual-week PAQs. For the overall psychometric quality, the Incidental and Planned Exercise Questionnaire for the Usual-week (IPEQ-WA) and for the Past-week (IPEQ-W) had the greatest number of positive ratings. For all included PAQs, very few psychometric properties were assessed with poor ratings for the majority of the overall qualities of psychometric properties indicating the limitation of current PAQs. More research that covers a greater spectrum of psychometric properties is required to gain a better understanding of the qualities of current PAQs.

Keywords: Physical activity questionnaires; Psychometrics; Recall methods; Reliability; Validity.

Figures

Fig. 1
Fig. 1
Flowchart of included studies and physical activity questionnaires

References

    1. Cunningham GO, Michael YL. Concepts guiding the study of the impact of the built environment on physical activity for older adults: a review of the literature. Am J Health Promot. 2004;18:435–443. doi: 10.4278/0890-1171-18.6.435.
    1. Bauer UE, Briss PA, Goodman RA, Bowman BA. Prevention of chronic disease in the 21st century: elimination of the leading preventable causes of premature death and disability in the USA. Lancet. 2014;384:45–52. doi: 10.1016/S0140-6736(14)60648-6.
    1. Rennie KL, Wareham NJ. The validation of physical activity instruments for measuring energy expenditure: problems and pitfalls. Public Health Nutr. 1998;1:265–271. doi: 10.1079/PHN19980043.
    1. Ainsworth B, Cahalin L, Buman M, Ross R. The current state of physical activity assessment tools. Prog Cardiovasc Dis. 2015;57:387–395. doi: 10.1016/j.pcad.2014.10.005.
    1. Bornstein DB, Beets MW, Byun W, McIver K. Accelerometer-derived physical activity levels of preschoolers: a meta-analysis. J Sci Med Sport. 2011;14:504–511. doi: 10.1016/j.jsams.2011.05.007.
    1. Lee PH, Macfarlane DJ, Lam TH, Stewart SM. Validity of the International Physical Activity Questionnaire Short Form (IPAQ-SF): a systematic review. Int J Behav Nutr Phys Act. 2011;8:115. doi: 10.1186/1479-5868-8-115.
    1. Durante R, Ainsworth BE. The recall of physical activity: using a cognitive model of the question-answering process. Med Sci Sports Exerc. 1996;28:1282–1291. doi: 10.1097/00005768-199610000-00012.
    1. Pettee Gabriel K, McClain JJ, Schmid KK, Storti KL, Ainsworth BE. Reliability and convergent validity of the past-week Modifiable Activity Questionnaire. Public Health Nutr. 2011;14:435–442. doi: 10.1017/S1368980010002612.
    1. Matthews CE, Ainsworth BE, Hanby C, Pate RR, Addy C, Freedson PS, Jones DA, Macera CA. Development and testing of a short physical activity recall questionnaire. Med Sci Sports Exerc. 2005;37:986–994.
    1. Ainsworth BE, Caspersen CJ, Matthews CE, Masse LC, Baranowski T, Zhu W. Recommendations to improve the accuracy of estimates of physical activity derived from self report. J Phys Act Health. 2012;9(Suppl 1):S76–S84. doi: 10.1123/jpah.9.s1.s76.
    1. Bernstein M, Sloutskis D, Kumanyika S, Sparti A, Schutz Y, Morabia A. Data-based approach for developing a physical activity frequency questionnaire. Am J Epidemiol. 1998;147:147–154. doi: 10.1093/oxfordjournals.aje.a009427.
    1. Blair SN, Haskell WL, Ho P, Paffenbarger RS, Jr, Vranizan KM, Farquhar JW, Wood PD. Assessment of habitual physical activity by a seven-day recall in a community survey and controlled experiments. Am J Epidemiol. 1985;122:794–804.
    1. Delbaere K, Hauer K, Lord SR. Evaluation of the incidental and planned activity questionnaire (IPEQ) for older people. Br J Sports Med. 2010;44:1029–1034. doi: 10.1136/bjsm.2009.060350.
    1. Kim Y, Park I, Kang M. Convergent validity of the international physical activity questionnaire (IPAQ): meta-analysis. Public Health Nutr. 2013;16:440–452. doi: 10.1017/S1368980012002996.
    1. Terwee CB, Mokkink LB, Knol DL, Ostelo RW, Bouter LM, de Vet HC. Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist. Qual Life Res. 2012;21:651–657. doi: 10.1007/s11136-011-9960-1.
    1. Silsbury Z, Goldsmith R, Rushton A. Systematic review of the measurement properties of self-report physical activity questionnaires in healthy adult populations. BMJ Open. 2015;5 doi: 10.1136/bmjopen-2015-008430.
    1. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42. doi: 10.1016/j.jclinepi.2006.03.012.
    1. Schellingerhout JM, Verhagen AP, Heymans MW, Koes BW, de Vet HC, Terwee CB. Measurement properties of disease-specific questionnaires in patients with neck pain: a systematic review. Qual Life Res. 2012;21:659–670. doi: 10.1007/s11136-011-9965-9.
    1. van Poppel MN, Chinapaw MJ, Mokkink LB, van Mechelen W, Terwee CB. Physical activity questionnaires for adults: a systematic review of measurement properties. Sports Med. 2010;40:565–600. doi: 10.2165/11531930-000000000-00000.
    1. Chinapaw MJ, Mokkink LB, van Poppel MN, van Mechelen W, Terwee CB. Physical activity questionnaires for youth: a systematic review of measurement properties. Sports Med. 2010;40:539–563. doi: 10.2165/11530770-000000000-00000.
    1. Forsen L, Loland NW, Vuillemin A, Chinapaw MJ, van Poppel MN, Mokkink LB, van Mechelen W, Terwee CB. Self-administered physical activity questionnaires for the elderly: a systematic review of measurement properties. Sports Med. 2010;40:601–623. doi: 10.2165/11531350-000000000-00000.
    1. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ. 2009;339:b2700. doi: 10.1136/bmj.b2700.
    1. Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994;6:284–290. doi: 10.1037/1040-3590.6.4.284.
    1. Aparicio-Ugarriza R, Mielgo-Ayuso J, Benito PJ, Pedrero-Chamizo R, Ara I, Gonzalez-Gross M, Group ES. Physical activity assessment in the general population; instrumental methods and new technologies. Nutr Hosp. 2015;31(Suppl 3):219–226.
    1. Godfrey A, Rochester L. Body-worn monitors: a lot done, more to do. J Epidemiol Community Health. 2015;69:1139–1140. doi: 10.1136/jech-2015-205699.
    1. Cordier R, Speyer R, Chen YW, Wilkes-Gillan S, Brown T, Bourke-Taylor H, Doma K, Leicht A. Evaluating the psychometric quality of social skills measures: a systematic review. PLoS One. 2015;10:e0132299. doi: 10.1371/journal.pone.0132299.
    1. Cohen J. Statistical power analysis for the behavioral sciences. Hillsdale: Lawrence Erlbaum Associates; 1988.
    1. Cordier R, Chen YW, Speyer R, Totino R, Doma K, Leicht A, Brown N, Cuomo B. Child-report measures of occupational performance: a systematic review. PLoS One. 2016;11:e0147751. doi: 10.1371/journal.pone.0147751.
    1. Cust AE, Smith BJ, Chau J, van der Ploeg HP, Friedenreich CM, Armstrong BK, Bauman A. Validity and repeatability of the EPIC physical activity questionnaire: a validation study using accelerometers as an objective measure. Int J Behav Nutr Phys Act. 2008;5:33. doi: 10.1186/1479-5868-5-33.
    1. DePew ZS, Garofoli AC, Novotny PJ, Benzo RP. Screening for severe physical inactivity in chronic obstructive pulmonary disease: the value of simple measures and the validation of two physical activity questionnaires. Chron Respir Dis. 2013;10:19–27. doi: 10.1177/1479972312464243.
    1. Wareham NJ, Jakes RW, Rennie KL, Mitchell J, Hennings S, Day NE. Validity and repeatability of the EPIC-Norfolk Physical Activity Questionnaire. Int J Epidemiol. 2002;31:168–174. doi: 10.1093/ije/31.1.168.
    1. Walter SD, Eliasziw M, Donner A. Sample size and optimal designs for reliability studies. Stat Med. 1998;17:101–110. doi: 10.1002/(SICI)1097-0258(19980115)17:1<101::AID-SIM727>;2-E.
    1. Prince SA, Reed JL, Martinello N, Adamo KB, Fodor JG, Hiremath S, Kristjansson EA, Mullen KA, Nerenberg KA, Tulloch HE, Reid RD. Why are adult women physically active? A systematic review of prospective cohort studies to identify intrapersonal, social environmental and physical environmental determinants. Obes Rev. 2016;17:919–944. doi: 10.1111/obr.12432.
    1. Link BG, Phelan J. Social conditions as fundamental causes of disease. J Health Soc Behav. 1995;Spec No:80–94. doi: 10.2307/2626958.
    1. Pols MA, Peeters PH, Ocke MC, Slimani N, Bueno-de-Mesquita HB, Collette HJ. Estimation of reproducibility and relative validity of the questions included in the EPIC Physical Activity Questionnaire. Int J Epidemiol. 1997;26(Suppl 1):S181–S189. doi: 10.1093/ije/26.suppl_1.S181.
    1. Belanger C, Speizer FE, Hennekens CH, Rosner B, Willett W, Bain C. The nurses’ health study: current findings. Am J Nurs. 1980;80:1333. doi: 10.1097/00000446-198007000-00024.
    1. Singh PN, Tonstad S, Abbey DE, Fraser GE. Validity of selected physical activity questions in white Seventh-day Adventists and non-Adventists. Med Sci Sports Exerc. 1996;28:1026–1037. doi: 10.1097/00005768-199608000-00013.
    1. Sallis JF, Haskell WL, Wood PD, Fortmann SP, Rogers T, Blair SN, Paffenbarger RS., Jr Physical activity assessment methodology in the Five-City Project. Am J Epidemiol. 1985;121:91–106.
    1. Dipietro L, Caspersen CJ, Ostfeld AM, Nadel ER. A survey for assessing physical activity among older adults. Med Sci Sports Exerc. 1993;25:628–642. doi: 10.1249/00005768-199305000-00016.
    1. Commission AS . In: Active Australia physical activity survey 1997. Commission AS, editor. Canberra: Australian Sports Commission; 1999.
    1. Paffenbarger RS, Jr, Wing AL, Hyde RT. Physical activity as an index of heart attack risk in college alumni. Am J Epidemiol. 1978;108:161–175.
    1. Masse LC, Fulton JE, Watson KB, Tortolero S, Kohl HW, 3rd, Meyers MC, Blair SN, Wong WW. Comparing the validity of 2 physical activity questionnaire formats in African-American and Hispanic women. J Phys Act Health. 2012;9:237–248. doi: 10.1123/jpah.9.2.237.
    1. General practice physical activity questionnaire (GPPAQ). .
    1. Tudor-Locke C, Ainsworth BE, Thompson RW, Matthews CE. Comparison of pedometer and accelerometer measures of free-living physical activity. Med Sci Sports Exerc. 2002;34:2045–2051. doi: 10.1097/00005768-200212000-00027.
    1. Cust AE, Armstrong BK, Smith BJ, Chau J, van der Ploeg HP, Bauman A. Self-reported confidence in recall as a predictor of validity and repeatability of physical activity questionnaire data. Epidemiology. 2009;20:433–441. doi: 10.1097/EDE.0b013e3181931539.
    1. Chau JY, Van Der Ploeg HP, Dunn S, Kurko J, Bauman AE. Validity of the occupational sitting and physical activity questionnaire. Med Sci Sports Exerc. 2012;44:118–125. doi: 10.1249/MSS.0b013e3182251060.
    1. Taylor N, Lawton R, Conner M. Development and initial validation of the determinants of physical activity questionnaire. Int J Behav Nutr Phys Act. 2013;10:74. doi: 10.1186/1479-5868-10-74.
    1. Washburn RA, Smith KW, Jette AM, Janney CA. The Physical Activity Scale for the Elderly (PASE): development and evaluation. J Clin Epidemiol. 1993;46:153–162. doi: 10.1016/0895-4356(93)90053-4.
    1. Timperio A, Salmon J, Crawford D. Validity and reliability of a physical activity recall instrument among overweight and non-overweight men and women. J Sci Med Sport. 2003;6:477–491. doi: 10.1016/S1440-2440(03)80273-6.
    1. Lowther M, Mutrie N, Loughlan C, McFarlane C. Development of a Scottish physical activity questionnaire: a tool for use in physical activity interventions. Br J Sports Med. 1999;33:244–249. doi: 10.1136/bjsm.33.4.244.
    1. Adams EJ, Goad M, Sahlqvist S, Bull FC, Cooper AR, Ogilvie D. iConnect C: reliability and validity of the transport and physical activity questionnaire (TPAQ) for assessing physical activity behaviour. PLoS One. 2014;9:e107039. doi: 10.1371/journal.pone.0107039.
    1. Espana-Romero V, Golubic R, Martin KR, Hardy R, Ekelund U, Kuh D, Wareham NJ, Cooper R, Brage S, scientific N. data collection t Comparison of the EPIC Physical Activity Questionnaire with combined heart rate and movement sensing in a nationally representative sample of older British adults. PLoS One. 2014;9:e87085. doi: 10.1371/journal.pone.0087085.
    1. Golubic R, Martin KR, Ekelund U, Hardy R, Kuh D, Wareham N, Cooper R, Brage S, scientific N. data collection t Levels of physical activity among a nationally representative sample of people in early old age: results of objective and self-reported assessments. Int J Behav Nutr Phys Act. 2014;11:58. doi: 10.1186/1479-5868-11-58.
    1. Wareham NJ, Jakes RW, Rennie KL, Schuit J, Mitchell J, Hennings S, Day NE. Validity and repeatability of a simple index derived from the short physical activity questionnaire used in the European Prospective Investigation into Cancer and Nutrition (EPIC) study. Public Health Nutr. 2003;6:407–413. doi: 10.1079/PHN2002439.
    1. Wolf AM, Hunter DJ, Colditz GA, Manson JE, Stampfer MJ, Corsano KA, Rosner B, Kriska A, Willett WC. Reproducibility and validity of a self-administered physical activity questionnaire. Int J Epidemiol. 1994;23:991–999. doi: 10.1093/ije/23.5.991.
    1. Singh PN, Fraser GE, Knutsen SF, Lindsted KD, Bennett HW. Validity of a physical activity questionnaire among African-American Seventh-day Adventists. Med Sci Sports Exerc. 2001;33:468–475. doi: 10.1097/00005768-200103000-00021.
    1. Jacobs DR, Jr, Ainsworth BE, Hartman TJ, Leon AS. A simultaneous evaluation of 10 commonly used physical activity questionnaires. Med Sci Sports Exerc. 1993;25:81–91. doi: 10.1249/00005768-199301000-00012.
    1. Resnicow K, McCarty F, Blissett D, Wang T, Heitzler C, Lee RE. Validity of a modified CHAMPS physical activity questionnaire among African-Americans. Med Sci Sports Exerc. 2003;35:1537–1545. doi: 10.1249/01.MSS.0000084419.64044.2B.
    1. Brown WJ, Burton NW, Marshall AL, Miller YD. Reliability and validity of a modified self-administered version of the Active Australia physical activity survey in a sample of mid-age women. Aust N Z J Public Health. 2008;32:535–541. doi: 10.1111/j.1753-6405.2008.00305.x.
    1. Ainsworth BE, Berry CB, Schnyder VN, Vickers SR. Leisure-time physical activity and aerobic fitness in African-American young adults. J Adolesc Health. 1992;13:606–611. doi: 10.1016/1054-139X(92)90375-L.
    1. Ainsworth BE, Leon AS, Richardson MT, Jacobs DR, Paffenbarger RS., Jr Accuracy of the college alumnus physical activity questionnaire. J Clin Epidemiol. 1993;46:1403–1411. doi: 10.1016/0895-4356(93)90140-V.
    1. Albanes D, Conway JM, Taylor PR, Moe PW, Judd J. Validation and comparison of eight physical activity questionnaires. Epidemiology. 1990;1:65–71. doi: 10.1097/00001648-199001000-00014.
    1. Bassett DR, Jr, Cureton AL, Ainsworth BE. Measurement of daily walking distance-questionnaire versus pedometer. Med Sci Sports Exerc. 2000;32:1018–1023. doi: 10.1097/00005768-200005000-00021.
    1. Strath SJ, Bassett DR, Jr, Swartz AM. Comparison of the college alumnus questionnaire physical activity index with objective monitoring. Ann Epidemiol. 2004;14:409–415. doi: 10.1016/j.annepidem.2003.07.001.
    1. Washburn RA, Goldfield SR, Smith KW, McKinlay JB. The validity of self-reported exercise-induced sweating as a measure of physical activity. Am J Epidemiol. 1990;132:107–113.
    1. Ahmad S, Harris T, Limb E, Kerry S, Victor C, Ekelund U, Iliffe S, Whincup P, Beighton C, Ussher M, Cook DG. Evaluation of reliability and validity of the General Practice Physical Activity Questionnaire (GPPAQ) in 60–74 year old primary care patients. BMC Fam Pract. 2015;16:113. doi: 10.1186/s12875-015-0324-8.
    1. McKeon M, Slevin E, Taggart L. A pilot survey of physical activity in men with an intellectual disability. J Intellect Disabil. 2013;17:157–167. doi: 10.1177/1744629513484666.
    1. Kaleth AS, Ang DC, Chakr R, Tong Y. Validity and reliability of community health activities model program for seniors and short-form international physical activity questionnaire as physical activity assessment tools in patients with fibromyalgia. Disabil Rehabil. 2010;32:353–359. doi: 10.3109/09638280903166352.
    1. Tierney M, Fraser A, Kennedy N. Criterion validity of the International Physical Activity Questionnaire Short Form (IPAQ-SF) for use in patients with rheumatoid arthritis: comparison with the SenseWear Armband. Physiotherapy. 2015;101:193–197. doi: 10.1016/j.physio.2014.07.005.
    1. Warner ET, Wolin KY, Duncan DT, Heil DP, Askew S, Bennett GG. Differential accuracy of physical activity self-report by body mass index. Am J Health Behav. 2012;36:168–178. doi: 10.5993/AJHB.36.2.3.
    1. Allison MJ, Keller C, Hutchinson PL. Selection of an instrument to measure the physical activity of elderly people in rural areas. Rehabil Nurs. 1998;23:309–314. doi: 10.1002/j.2048-7940.1998.tb01811.x.
    1. Ewald B, McEvoy M, Attia J. Pedometer counts superior to physical activity scale for identifying health markers in older adults. Br J Sports Med. 2010;44:756–761. doi: 10.1136/bjsm.2008.048827.
    1. Garfield BE, Canavan JL, Smith CJ, Ingram KA, Fowler RP, Clark AL, Polkey MI, Man WD. Stanford Seven-Day Physical Activity Recall questionnaire in COPD. Eur Respir J. 2012;40:356–362. doi: 10.1183/09031936.00113611.
    1. Granger CL, Parry SM, Denehy L. The self-reported Physical Activity Scale for the Elderly (PASE) is a valid and clinically applicable measure in lung cancer. Support Care Cancer. 2015;23:3211–3218. doi: 10.1007/s00520-015-2707-8.
    1. Harada ND, Chiu V, King AC, Stewart AL. An evaluation of three self-report physical activity instruments for older adults. Med Sci Sports Exerc. 2001;33:962–970. doi: 10.1097/00005768-200106000-00016.
    1. Martin KA, Rejeski WJ, Miller ME, James MK, Ettinger WH, Jr, Messier SP. Validation of the PASE in older adults with knee pain and physical disability. Med Sci Sports Exerc. 1999;31:627–633. doi: 10.1097/00005768-199905000-00001.
    1. Washburn RA, Ficker JL. Physical Activity Scale for the Elderly (PASE): the relationship with activity measured by a portable accelerometer. J Sports Med Phys Fitness. 1999;39:336–340.
    1. Washburn RA, McAuley E, Katula J, Mihalko SL, Boileau RA. The physical activity scale for the elderly (PASE): evidence for validity. J Clin Epidemiol. 1999;52:643–651. doi: 10.1016/S0895-4356(99)00049-9.
    1. Zalewski KR, Smith JC, Malzahn J, VanHart M, O’Connell D. Measures of physical ability are unrelated to objectively measured physical activity behavior in older adults residing in continuing care retirement communities. Arch Phys Med Rehabil. 2009;90:982–986. doi: 10.1016/j.apmr.2008.12.013.

Source: PubMed

스폰서 및 공동 작업자

건강 상태

약물 개입

3
구독하다