Quantifying Child-Appeal: The Development and Mixed-Methods Validation of a Methodology for Evaluating Child-Appealing Marketing on Product Packaging

Christine Mulligan, Monique Potvin Kent, Laura Vergeer, Anthea K Christoforou, Mary R L'Abbé, Christine Mulligan, Monique Potvin Kent, Laura Vergeer, Anthea K Christoforou, Mary R L'Abbé

Abstract

There is no standardized or validated definition or measure of "child-appeal" used in food and beverage marketing policy or research, which can result in heterogeneous outcomes. Therefore, this pilot study aimed to develop and validate the child-appealing packaging (CAP) coding tool, which measures the presence, type, and power of child-appealing marketing on food packaging based on the marketing techniques displayed. Children (n = 15) participated in a mixed-methods validation study comprising a binary classification (child-appealing packaging? Yes/No) and ranking (order of preference/marketing power) activity using mock breakfast cereal packages (quantitative) and focus group discussions (qualitative). The percent agreement, Cohen's Kappa statistic, Spearman's Rank correlation, and cross-classification analyses tested the agreement between children's and the CAP tool's evaluation of packages' child-appeal and marketing power (criterion validity) and the content analysis tested the relevance of the CAP marketing techniques (content validity). There was an 80% agreement, and "moderate" pairwise agreement (κ [95% CI]: 0.54 [0.35, 0.73]) between children/CAP binary classifications and "strong" correlation (rs [95% CI]: 0.78 [0.63, 0.89]) between children/CAP rankings of packages, with 71.1% of packages ranked in the exact agreement. The marketing techniques included in the CAP tool corresponded to those children found pertinent. Pilot results suggest the criterion/content validity of the CAP tool for measuring child-appealing marketing on packaging in accordance with children's preferences.

Trial registration: ClinicalTrials.gov NCT04294121.

Keywords: child-appealing marketing; food marketing; food packaging; marketing power; marketing techniques; marketing to kids; mixed methods; product packaging; validation.

Conflict of interest statement

The authors declare no conflict of interest.

Figures

Figure 1
Figure 1
Spearman correlation (rs) between children’s ranking of cereal boxes in order of preference and the CAP tool’s ranking of cereal boxes according to the marketing power. The plotted line depicts the Spearman rank correlation and 95% CI between children’s ranking of cereals (i.e., 1 to 6) in order of preference and the CAP tool’s ranking of cereals (i.e., 1 to 6) in order of marketing power. Individual data points indicate the CAP-child ranking pairs (e.g., child cereal rank of “2”/CAP tool rank of “1”), with larger data points corresponding to a larger number of ranking pairs at that intersection.
Figure 2
Figure 2
Cross-classification analyses of the agreement between children’s and the CAP tool’s ranking of cereal boxes, overall, and per cereal box. Cross-classification analyses were conducted between the CAP tool and children’s rankings (i.e., 1 to 6) of breakfast cereals according to the marketing power (CAP tool) and their appeal (children). Cross-classification analyses were conducted overall and per individual cereal box. Exact agreement was defined as the same ranking by both the CAP tool and children (e.g., CAP tool scored the cereal box with the 2nd highest marketing power and children ranked as their 2nd favorite). Agreement ±1 ranking (e.g., CAP tool scored the cereal box with the 2nd highest marketing power and children ranked as either their 1st or 3rd favorite) and disagreement (i.e., rankings ±2) were also calculated. If rankings were further apart than ±2 ranks, it was considered to be gross misclassification. Cereal boxes are ranked in order of least (A) to most (F) powerful marketing.
Figure 3
Figure 3
Number of coding references for each CAP tool marketing technique discussed by children during focus groups. Marketing techniques from the CAP tool were used as codes to analyze the transcripts from the focus group discussions with children. The number of times each marketing technique was mentioned by children was counted. A full description of the marketing techniques can be found in Appendix A.

References

    1. World Cancer Research Fund International Building Momentum: Lessons on Implementing Robust Restrictions of Food and Non-Alcoholic Beverage Marketing to Children. [(accessed on 28 January 2020)]; Available online: .
    1. Sadeghirad B., Duhaney T., Motaghipisheh S., Campbell N.R., Johnston B.C. Influence of unhealthy food and beverage marketing on children’s dietary intake and preference: A systematic review and meta-analysis of randomized trials. Obes. Rev. Off. J. Int. Assoc. Study Obes. 2016;17:945–959. doi: 10.1111/obr.12445.
    1. Jenkin G., Madhvani N., Signal L., Bowers S. A systematic review of persuasive marketing techniques to promote food to children on television. Obes. Rev. Off. J. Int. Assoc. Study Obes. 2014;15:281–293. doi: 10.1111/obr.12141.
    1. Boyland E.J., Nolan S., Kelly B., Tudur-Smith C., Jones A., Halford J.C., Robinson E. Advertising as a cue to consume: A systematic review and meta-analysis of the effects of acute exposure to unhealthy food and nonalcoholic beverage advertising on intake in children and adults. Am. J. Clin. Nutr. 2016;103:519–533. doi: 10.3945/ajcn.115.120022.
    1. Kelly B., Vandevijvere S., Ng S., Adams J., Allemandi L., Bahena-Espina L., Barquera S., Boyland E., Calleja P., Carmona-Garces I.C., et al. Global benchmarking of children’s exposure to television advertising of unhealthy foods and beverages across 22 countries. Obes. Rev. 2019;11:11. doi: 10.1111/obr.12840.
    1. Cairns G., Angus K., Hastings G., Caraher M. Systematic reviews of the evidence on the nature, extent and effects of food marketing to children. A retrospective summary. Appetite. 2013;62:209–215. doi: 10.1016/j.appet.2012.04.017.
    1. Boyland E.J., Whalen R. Food advertising to children and its effects on diet: Review of recent prevalence and impact data. Pediatric Diabetes. 2015;16:331–337. doi: 10.1111/pedi.12278.
    1. World Health Organization Set of Recommendations on the Marketing of Foods and Non-Alcoholic Beverages to Children. [(accessed on 28 January 2020)]; Available online:
    1. World Health Organization Report of the Commission on Ending Childhood Obesity. [(accessed on 3 March 2020)]; Available online: .
    1. Obesity Policy Coalition Policy Brief: Restrictions on Marketing Unhealthy Food to Children—International Comparison. [(accessed on 28 January 2020)]; Available online: .
    1. Taillie L.S., Busey E., Stoltze F.M., Dillman Carpentier F.R. Governmental policies to reduce unhealthy food marketing to children. Nutr. Rev. 2019;77:787–816. doi: 10.1093/nutrit/nuz021.
    1. Mediano Stoltze F., Reyes M., Smith T.L., Correa T., Corvalán C., Carpentier F.R.D. Prevalence of Child-Directed Marketing on Breakfast Cereal Packages before and after Chile’s Food Marketing Law: A Pre- and Post-Quantitative Content Analysis. Int. J. Environ. Res. Public Health. 2019;16:4501. doi: 10.3390/ijerph16224501.
    1. Taillie L.S., Reyes M., Colchero M.A., Popkin B., Corvalán C. An evaluation of Chile’s Law of Food Labeling and Advertising on sugar-sweetened beverage purchases from 2015 to 2017: A before-and-after study. PLoS Med. 2020;17:e1003015. doi: 10.1371/journal.pmed.1003015.
    1. Reyes M., Smith Taillie L., Popkin B., Kanter R., Vandevijvere S., Corvalán C. Changes in the amount of nutrient of packaged foods and beverages after the initial implementation of the Chilean Law of Food Labelling and Advertising: A nonexperimental prospective study. PLoS Med. 2020;17:e1003220. doi: 10.1371/journal.pmed.1003220.
    1. Mytton O.T., Boyland E., Adams J., Collins B., O’Connell M., Russell S.J., Smith K., Stroud R., Viner R.M., Cobiac L.J. The potential health impact of restricting less-healthy food and beverage advertising on UK television between 05.30 and 21.00 hours: A modelling study. PLoS Med. 2020;17:e1003212. doi: 10.1371/journal.pmed.1003212.
    1. Mulligan C., Kent M.P., Christoforou A.K., L’Abbé M.R. Inventory of marketing techniques used in child-appealing food and beverage research: A rapid review. Int. J. Public Health. 2020:1–11. doi: 10.1007/s00038-020-01444-w.
    1. Elliott C., Truman E. Measuring the Power of Food Marketing to Children: A Review of Recent Literature. Curr. Nutr. Rep. 2019;8:1–10. doi: 10.1007/s13668-019-00292-2.
    1. Mehta K., Phillips C., Ward P., Coveney J., Handsley E., Carter P. Marketing foods to children through product packaging: Prolific, unhealthy and misleading. Public Health Nutr. 2012;15:1763–1770. doi: 10.1017/S1368980012001231.
    1. Cao Z., Yan R. Health Creates Wealth? The use of Nutrition Claims and Firm Financial Performance. J. Public Policy Mark. 2016;35:58–75. doi: 10.1509/jppm.14.142.
    1. Eisend M., Tarrahi F. The Effectiveness of Advertising: A Meta-Meta-Analysis of Advertising Inputs and Outcomes. J. Advert. 2016;45:519–531. doi: 10.1080/00913367.2016.1185981.
    1. Bowman D.D., Minaker L.M., Simpson B.J., Gilliland J.A. Development of a Teen-Informed Coding Tool to Measure the Power of Food Advertisements. Int. J. Environ. Res. Public Health. 2019;16:4258. doi: 10.3390/ijerph16214258.
    1. Turner L., Kelly B., Boyland E., Bauman A.E. Measuring Food Brand Awareness in Australian Children: Development and Validation of a New Instrument. PLoS ONE. 2015;10:e0133972. doi: 10.1371/journal.pone.0133972.
    1. Signal L., Stanley J., Smith M., Barr M., Chambers T., Zhou J., Duane A., Gurrin C., Smeaton A., McKerchar C. Children’s everyday exposure to food marketing: An objective analysis using wearable cameras. Int. J. Behav. Nutr. Phys. Act. 2017;14:137. doi: 10.1186/s12966-017-0570-3.
    1. Nevo B. Face validity revisited. J. Educ. Meas. 1985;22:287–293. doi: 10.1111/j.1745-3984.1985.tb01065.x.
    1. Onwuegbuzie A.J., Dickinson W.B. Mixed methods analysis and information visualization: Graphical display for effective communication of research results. Qual. Rep. 2008;13:204–225.
    1. Townsend M.S. Where is the science? What will it take to show that nutrient profiling systems work? Am. J. Clin. Nutr. 2010;91:1109S–1115S. doi: 10.3945/ajcn.2010.28450F.
    1. McDonald M.P. Encyclopedia of Social Measurement, Kempf-Leonard, K., Ed. Elsevier; New York, NY, USA: 2005. Validity, Data Sources; pp. 939–948.
    1. Salkind N.J. Encyclopedia of Research Design. Sage; Thousand Oaks, CA, USA: 2010.
    1. Social Development Finance and Administration—City of Toronto City of Toronto: The Changing Landscape of Toronto’s Population. [(accessed on 10 February 2020)]; Available online: .
    1. Potvin Kent M., Cameron C., Philippe S. The healthfulness and prominence of sugar in child-targeted breakfast cereals in Canada. Health Promot. Chronic Dis. Prev. Can. 2017;37:266–273. doi: 10.24095/hpcdp.37.9.02.
    1. Labonté M.-È., Poon T., Mulligan C., Bernstein J.T., Franco-Arellano B., L’Abbé M.R. Comparison of global nutrient profiling systems for restricting the commercial marketing of foods and beverages of low nutritional quality to children in Canada. Am. J. Clin. Nutr. 2017;106:1471–1481. doi: 10.3945/ajcn.117.161356.
    1. Mulligan C., Labonté M.-È., Vergeer L., L’Abbé M.R. Assessment of the Canadian Children’s Food and Beverage Advertising Initiative’s Uniform Nutrition Criteria for Restricting Children’s Food and Beverage Marketing in Canada. Nutrients. 2018;10:803. doi: 10.3390/nu10070803.
    1. Elliott C., Scime N.V. Nutrient Profiling and Child-Targeted Supermarket Foods: Assessing a “Made in Canada” Policy Approach. Int. J. Environ. Res. Public Health. 2019;16:639. doi: 10.3390/ijerph16040639.
    1. Cheyne A.D., Dorfman L., Bukofzer E., Harris J.L. Marketing Sugary Cereals to Children in the Digital Age: A Content Analysis of 17 Child-Targeted Websites. J. Health Commun. 2013;18:563–582. doi: 10.1080/10810730.2012.743622.
    1. Subar A.F., Krebs-Smith S.M., Cook A., Kahle L.L. Dietary Sources of Nutrients among US Children, 1989–1991. Pediatrics. 1998;102:913–923. doi: 10.1542/peds.102.4.913.
    1. Fox M.K., Condon E., Briefel R.R., Reidy K.C., Deming D.M. Food Consumption Patterns of Young Preschoolers: Are They Starting Off on the Right Path? J. Am. Diet. Assoc. 2010;110:S52–S59. doi: 10.1016/j.jada.2010.09.002.
    1. Morgan M., Gibbs S., Maxwell K., Britten N. Hearing children’s voices: Methodological issues in conducting focus groups with children aged 7-11 years. Qual. Res. 2002;2:5–20. doi: 10.1177/1468794102002001636.
    1. Ronen G.M., Rosenbaum P., Law M., Streiner D.L. Health-related quality of life in childhood disorders: A modified focus group technique to involve children. Qual. Life Res. 2001;10:71–79. doi: 10.1023/A:1016659917227.
    1. Clark L. Focus Group Research with Children and Youth. J. Spéc. Pediatric Nurs. 2009;14:152–154. doi: 10.1111/j.1744-6155.2009.00187.x.
    1. McHugh M.L. Interrater reliability: The kappa statistic. Biochem. Med. 2012;22:276–282. doi: 10.11613/BM.2012.031.
    1. Akoglu H. User’s guide to correlation coefficients. Turk. J. Emerg. Med. 2018;18:91–93. doi: 10.1016/j.tjem.2018.08.001.
    1. Columbia University Public Health Population Health Methods: Content Analysis. [(accessed on 23 December 2020)]; Available online: .
    1. Baumeister R.F., Vohs K.D. Encyclopedia of Social Psychology. Volume 1 Sage; Thousand Oaks, CA, USA: 2007.
    1. Cho J.Y., Lee E.-H. Reducing Confusion about Grounded Theory and Qualitative Content Analysis: Similarities and Differences. Qual. Rep. 2014;19:1. doi: 10.46743/2160-3715/2014.1028.
    1. Cavanagh S. Content analysis: Concepts, methods and applications. Nurse Res. 1997;4:5–16. doi: 10.7748/nr1997.04.4.3.5.c5869.
    1. Kondracki N.L., Wellman N.S., Amundson D.R. Content Analysis: Review of Methods and Their Applications in Nutrition Education. J. Nutr. Educ. Behav. 2002;34:224–230. doi: 10.1016/S1499-4046(06)60097-3.
    1. Hebden L., King L., Kelly B., Chapman K., Innes-Hughes C. A Menagerie of Promotional Characters: Promoting Food to Children through Food Packaging. J. Nutr. Educ. Behav. 2011;43:349–355. doi: 10.1016/j.jneb.2010.11.006.
    1. Ogba I.E., Johnson R. How packaging affects the product preferences of children and the buyer behaviour of their parents in the food industry. Young Consum. 2010;11:77–89. doi: 10.1108/17473611011026037.
    1. Hawkes C. Food packaging: The medium is the message. Public Health Nutr. 2010;13:297–299. doi: 10.1017/S1368980009993168.
    1. Letona P., Chacon V., Roberto C., Barnoya J. A qualitative study of children’s snack food packaging perceptions and preferences. BMC Public Health. 2014;14:1274. doi: 10.1186/1471-2458-14-1274.
    1. Elliott C.D., Carruthers Den Hoed R., Conlon M.J. Food Branding and Young Children’s Taste Preferences: A Reassessment. Can. J. Public Health. 2013;104:e364–e368. doi: 10.17269/cjph.104.3957.
    1. Lapierre M.A., Vaala S.E., Linebarger D.L. Influence of licensed spokescharacters and health cues on children’s ratings of cereal taste. Arch. Pediatrics Adolesc. Med. 2011;165:229–234. doi: 10.1001/archpediatrics.2010.300.
    1. Roberto C.A., Baik J., Harris J.L., Brownell K.D. Influence of licensed characters on children’s taste and snack preferences. Pediatrics. 2010;126:88–93. doi: 10.1542/peds.2009-3433.
    1. Letona P., Chacon V., Roberto C., Barnoya J. Effects of licensed characters on children’s taste and snack preferences in Guatemala, a low/middle income country. Int. J. Obes. 2014;38:1466–1469. doi: 10.1038/ijo.2014.38.
    1. Robinson T.N., Borzekowski D.L., Matheson D.M., Kraemer H.C. Effects of Fast Food Branding on Young Children’s Taste Preferences. Arch. Pediatrics Adolesc. Med. 2007;161:792–797. doi: 10.1001/archpedi.161.8.792.
    1. Dixon H., Scully M., Niven P., Kelly B., Chapman K., Donovan R., Martin J., Baur L.A., Crawford D., Wakefield M. Effects of nutrient content claims, sports celebrity endorsements and premium offers on pre-adolescent children’s food preferences: Experimental research. Pediatric Obes. 2014;9:e47–e57. doi: 10.1111/j.2047-6310.2013.00169.x.
    1. Soldavini J., Crawford P., Ritchie L.D. Nutrition Claims Influence Health Perceptions and Taste Preferences in Fourth- and Fifth-Grade Children. J. Nutr. Educ. Behav. 2012;44:624–627. doi: 10.1016/j.jneb.2012.04.009.
    1. Brierley M., Elliott C. Nutritional components and children’s interpretations of packaged food. Int. J. f Health Promot. Educ. 2015;53:230–243. doi: 10.1080/14635240.2015.1010654.
    1. Elliott C., Den Hoed R.C. Do apples need an Elmo sticker? Children’s classification of unprocessed edibles. Crit. Public Health. 2017;27:617–623. doi: 10.1080/09581596.2016.1262942.
    1. Wardle J., Huon G. An experimental investigation of the influence of health information on children’s taste preferences. Health Educ. Res. 2000;15:39–44. doi: 10.1093/her/15.1.39.
    1. Ares G., Arrúa A., Antúnez L., Vidal L., Machín L., Martínez J., Curutchet M.R., Giménez A. Influence of label design on children’s perception of two snack foods: Comparison of rating and choice-based conjoint analysis. Food Qual. Prefer. 2016;53:1–8. doi: 10.1016/j.foodqual.2016.05.006.
    1. Elliott C. Healthy Food Looks Serious: How Children Interpret Packaged Food Products. Can. J. Commun. 2009;34:34. doi: 10.22230/cjc.2009v34n3a2220.
    1. Elliott C., Brierley M. Healthy Choice?: Exploring How Children Evaluate the Healthfulness of Packaged Foods. Can. J. Public Health. 2012;103:e453–e458. doi: 10.1007/BF03405637.
    1. Leonard B., Campbell M.C., Manning K.C. Kids, Caregivers, and Cartoons: The Impact of Licensed Characters on Food Choices and Consumption. J. Public Policy Mark. 2019;38:214–231. doi: 10.1177/0743915619827919.
    1. Ogle A.D., Graham D.J., Lucas-Thompson R.G., Roberto C.A. Influence of Cartoon Media Characters on Children’s Attention to and Preference for Food and Beverage Products. J. Acad. Nutr. Diet. 2017;117:265–270.e2. doi: 10.1016/j.jand.2016.08.012.

Source: PubMed

3
Iratkozz fel