Can a Coding Tool Accurately Evaluate How Kids Respond to Marketing on Food Packaging?

September 29, 2021 updated by: Mary L'Abbe, University of Toronto

Testing the Validity of a Novel Method for Identifying and Measuring Child-appealing Marketing on Product Packaging Using Focus Groups of School-aged Children (<13 Years) and Their Parents.

Child-appealing marketing for unhealthy foods and beverages is a global public health concern, and marketing on product packaging is one of children's top sources of exposure to this type of marketing. However, there is currently no consistent method for evaluating the extent and power of child-appealing marketing on packaging, and therefore, the child-appealing packaging (CAP) coding tool was developed. This study aims to validate this novel tool by testing if the coding tool can accurately evaluate how kids respond to marketing on food packaging. The hypothesis for this study is that the CAP tool will be able to classify and rank marketing on product packaging similarly to how children and their parents rank the same food packages. In order to test this hypothesis, children and their parents will complete an activity where they classify breakfast cereals displaying different degrees of child-appealing marketing power as "child-appealing" or "non-child-appealing" and then rank them in order of their preference. Children and parents will also complete a focus group discussion to talk about why they classified and ranked the cereals the way that they did in the previous activity. Analyses will determine how well participants classifications and rankings agree with the CAP tool's classifications and rankings.

Study Overview

Status

Completed

Conditions

Detailed Description

RATIONALE & OBJECTIVES

In Canada, the Child Health Protection Act (Bill S-228) was introduced in September 2016 by Senator Greene Raine to amend the current Food and Drugs Act to prohibit food and beverage marketing directed at children under 13 years of age. Shortly after, to support Bill S-228, Health Canada committed to introducing marketing restrictions as part of its Healthy Eating Strategy. The proposed restrictions will apply to a broad range of marketing platforms, including product packaging, which has been shown to be a top source of children's exposure to food and beverage advertising. Research has also assessed child-appealing marketing within the packaged food environment in Canada; however, these studies are limited due to the significant heterogeneity in the criteria that has been used for identifying child-appealing marketing techniques, with most only recording a few broad techniques, thus hindering their ability to capture the full scope of this marketing practice. Furthermore, despite recommendations from the World Health Organization (WHO) to limit both the exposure and the power of child-appealing marketing, there has been no formal quantification of the power of child-appealing marketing on product packaging.

In response to this gap, the child-appealing packaging (CAP) coding tool was developed to systematically assess the extent, nature and power of child-appealing marketing on product packaging. However, the CAP tool requires formal validation before being implemented in practice. This study will test the criterion and content validity of the CAP tool. Criterion validity is defined as the "extent to which the method is accurately based on an externally derived gold standard; examines whether method correlates in a predicted manner with variables with which, theoretically, it should correlate". Content validity is defined as the "extent to which the system covers the full range of meaning for the concept being measured".

Upon the validation of the CAP tool, its application will enable a comprehensive and updated assessment of the current Canadian marketing environment and be crucial to our ability to continue to accurately track the presence of child-appealing marketing in Canada. Findings from the use of the CAP tool will help inform ongoing policy and regulatory development and provide baseline data from which to monitor the 5-year impact of Bill S-228 as part of the mandatory monitoring period which will be implemented with the legislation.

Objectives: The objectives of this study are to use a product classification activity and focus groups of children and their parents to:

  1. Test the criterion validity of the CAP tool by comparing: a) How the CAP tool distinguishes between child-appealing and non-child-appealing products with how children and parents distinguish between these types of products and b) how the CAP tool scores the marketing power of a product's packaging with how children and parents rank their preference of products with child-appealing marketing with varying marketing power
  2. Test the content validity of the CAP tool by comparing the marketing techniques included in the tool with the aspects of packaging that children and parents identify as important for appealing to children and parents.

Hypothesis: It is hypothesized that the CAP tool's distinction between child-appealing and non-child-appealing products, scoring of marketing power, and inclusion of marketing techniques will align with how children and parents respond to child-appealing products.

Significance: This research will be conducted as part of a grant funded by the Joannah and Brian Lawson Centre for Child Nutrition entitled "Evaluating Food Environment Policies to Support Healthy Eating among Children" as well as a Project Grant funded by the Canadian Institutes of Health Research entitled "The IMPACT of food environment policies on the Canadian food supply, dietary intakes and health: evidence to inform policy action". The research team will share the results of this study with Health Canada to inform the monitoring of the impact of Bill S-228 on reducing the exposure and power of child-appealing marketing on product packaging. Results will be presented at scientific conferences and published in the peer-reviewed scientific literature. Results will also be shared with the participants through infographics or other lay materials provided to the participating Centres and available on our lab website (labbelab.utoronto.ca).

METHODOLOGICAL OVERVIEW

This mixed methods validation study will compare children and parent's assessments of child-appealing products with the CAP tool's assessments of child-appealing products. This validity testing will be conducted through a brief classification activity, followed by focus group discussions with children and parents. The sessions for children and parents will be conducted separately, but concurrently. Given that the primary goal of the CAP tool is to identify and score marketing on product packaging that may appeal to children, this study will use children to validate the CAP tool's ability to score products that appeal to them. Furthermore, since parents are the primary purchasers of the food that children consume, we aim to validate the CAP tool's ability to score products that may appeal to parents when they are purchasing for their children, as increased marketing to parents may be an unintended consequence of restricting child-appealing marketing.

Child-appealing Packaging (CAP) coding tool: Drawing on a comprehensive list of marketing techniques derived from a review of the scientific literature, the CAP tool was developed to measure the extent, nature and power of child-appealing marketing on product packaging. Despite the knowledge that the number of marketing instances that occur on a package can increase the persuasiveness or intensity of the marketing message, and WHO recommendations to limit both the exposure and power of child-appealing marketing, there has been no formal quantification of marketing power as it relates to child-appealing food and beverage products. The CAP tool provides a novel method for assessing this construct.

Design of sample products: In order to reduce any response bias based on brand-familiarity or preference, a set of 6 mock breakfast cereal packages were designed for use in this study. Cereals were chosen as the example product type given their frequent display of child-appealing marketing on packaging and because they are a food category that is commonly consumed by children. The cereals were designed to portray both child-appealing and non-child appealing marketing with a range of marketing power scores, as would be measured using the CAP tool.

Validation Study Procedures: In order to test the validity of the CAP tool, an independent classification activity will be conducted, followed by separate focus group discussions among children and parents (conducted concurrently).

Children Classification Activity: Children will be welcomed and explained the instructions and expectations all together as a group. Children will then be accompanied one by one to view the set of 6 cereals. A researcher will remind them of the instructions and ask them to decide 1) if each cereal is for children (YES or NO) and 2) to put the cereals in order of which they like the most to which they like the least (1-6). The researcher will record their answers on a response sheet.

Children Focus Group Discussion: Immediately following the completion of the children's classification activity, children will be directed to another room where a focus group discussion will take place. Discussion will prompt children to explain their choices in the classification activity to gain valuable insight into the rationale behind how they classified the cereals in the activity. The moderator will also probe children for examples of aspects of packaging that they think are important for making children like it. A second researcher will record the focus group discussions (audio only) as well as take notes during the discussion to supplement the audio recordings.

Parents Classification Activity: Following the completion of the children's classification activity, parents will be instructed to complete a similar classification activity. A second researcher will facilitate this portion of the study. Parents will be explained the instructions all together as a group and given a response form to fill out. One by one, parents will view the same set of 6 cereals and record 1) if they think each cereal is for children (YES or NO) and 2) their ranking of cereals (1-6) in order of which they would be most likely to purchase for their children to which they would be least likely to purchase for their children.

Parents Focus Group Discussion: Immediately following the completion of the parent's classification activity, parents will be directed to another room where a focus group discussion will take place. Discussion will prompt parents to explain their choices in the classification activity to gain valuable insight into the rationale behind how they classified the cereals in the activity. The moderator will also probe parents for examples of aspects of packaging that they think are important for influencing parents to make purchases for their children. A second researcher will record the focus group discussions (audio only) as well as take notes during the discussion to supplement the audio-recordings.

Study Type

Interventional

Enrollment (Actual)

27

Phase

  • Not Applicable

Contacts and Locations

This section provides the contact details for those conducting the study, and information on where this study is being conducted.

Study Locations

    • Ontario
      • Toronto, Ontario, Canada, M5S1A8
        • University of Toronto

Participation Criteria

Researchers look for people who fit a certain description, called eligibility criteria. Some examples of these criteria are a person's general health condition or prior treatments.

Eligibility Criteria

Ages Eligible for Study

5 years and older (Child, Adult, Older Adult)

Accepts Healthy Volunteers

Yes

Genders Eligible for Study

All

Description

Inclusion Criteria:

  • Children: 5-13 years of age
  • Parents: must be parents or guardians of children participating in the study
  • Must be able to speak/comprehend English
  • Must be somewhat familiar with packaged breakfast cereal (e.g., has consumed or seen it before)

Exclusion Criteria:

  • N/A

Study Plan

This section provides details of the study plan, including how the study is designed and what the study is measuring.

How is the study designed?

Design Details

  • Primary Purpose: Other
  • Allocation: Non-Randomized
  • Interventional Model: Parallel Assignment
  • Masking: None (Open Label)

Arms and Interventions

Participant Group / Arm
Intervention / Treatment
Experimental: Children
Children aged 5-13 years, all genders, will be exposed to a set of breakfast cereals displaying varying child-appealing and parent-appealing marketing techniques as well as varying degrees of child-appealing marketing power on their packaging. Children will be asked to determine if each individual cereal is "child-appealing" (i.e., yes or no). Children will also be asked to rank the cereals in order of their preference (i.e., Most (1) to Least (6)). Children will then participate in a focus group discussion about the why they classified/ranked the cereals the way that they did.
Participants will be exposed to product packages displaying varying child- and parent-appealing marketing techniques and different degrees of marketing power
Experimental: Parents
Parents or guardians of the children in the study will be exposed to a set of breakfast cereals displaying varying child-appealing and parent-appealing marketing techniques as well as varying degrees of child-appealing marketing power on their packaging. Parents will be asked to determine if each individual cereal is "child-appealing" (i.e., yes or no). Parents will also be asked to rank the cereals in order of which they would be most likely to purchase for a child (i.e., Most (1) to Least (6)). Parents will then participate in a focus group discussion about the why they classified/ranked the cereals the way that they did.
Participants will be exposed to product packages displaying varying child- and parent-appealing marketing techniques and different degrees of marketing power

What is the study measuring?

Primary Outcome Measures

Outcome Measure
Measure Description
Time Frame
Kappa agreement between participants' binary ranking of cereals and the child-appealing packaging (CAP) coding tool's binary ranking of cereals
Time Frame: Through study completion, approximately 1 year
Kappa statistics will evaluate the agreement between how children and parents rank breakfast cereals as either "child-appealing" or "non-child-appealing" and how the CAP tool ranks the same cereals.
Through study completion, approximately 1 year
Correlation between participants' ordinal ranking of cereals and the child-appealing packaging (CAP) coding tool's ordinal ranking of cereals according to their marketing power.
Time Frame: Through study completion, approximately 1 year
Spearman Rank Correlation analysis will evaluate the correlation between how children and parents rank breakfast cereals in terms of their ranked preference (children) or ranked purchasing intentions (parents) and how the CAP tool ranks the same cereals according to their marketing power.
Through study completion, approximately 1 year
Thematic content analysis of focus group transcripts and qualitative agreement with CAP tool
Time Frame: Through study completion, approximately 1 year
Thematic content analysis will elucidate key themes from the focus group discussions with children and parents, and qualitatively compare them to the contents of the CAP coding tool.
Through study completion, approximately 1 year

Collaborators and Investigators

This is where you will find people and organizations involved with this study.

Publications and helpful links

The person responsible for entering information about the study voluntarily provides these publications. These may be about anything related to the study.

General Publications

Study record dates

These dates track the progress of study record and summary results submissions to ClinicalTrials.gov. Study records and reported results are reviewed by the National Library of Medicine (NLM) to make sure they meet specific quality control standards before being posted on the public website.

Study Major Dates

Study Start (Actual)

May 21, 2019

Primary Completion (Actual)

December 31, 2020

Study Completion (Actual)

December 31, 2020

Study Registration Dates

First Submitted

February 26, 2020

First Submitted That Met QC Criteria

February 29, 2020

First Posted (Actual)

March 3, 2020

Study Record Updates

Last Update Posted (Actual)

September 30, 2021

Last Update Submitted That Met QC Criteria

September 29, 2021

Last Verified

September 1, 2021

More Information

Terms related to this study

Other Study ID Numbers

  • 37436

Plan for Individual participant data (IPD)

Plan to Share Individual Participant Data (IPD)?

NO

Drug and device information, study documents

Studies a U.S. FDA-regulated drug product

No

Studies a U.S. FDA-regulated device product

No

This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.

Clinical Trials on Food Marketing

Clinical Trials on Food marketing on product packaging

3
Subscribe