Study Smart! Effectiveness of a Smartphone Use Intervention on Students' Performance and Well-being

Study Smart! A Randomized Control Trial Examining the Effectiveness of an Individual Planning Intervention to Reduce Smartphone Interferences on Students' Academic Performance and Well-being

Smartphone use in academic contexts (e.g., in lectures or while studying for an exam) appears to go along with negative effects on students' academic performance (i.e., concentration, perceived learning achievement, and grades) and well-being (e.g., anxiety, positive and negative affect). Despite these alarming effects, intervention studies aiming at reducing smartphone interference are generally scarce and evidential inconsistent. For instance, existing studies suggest that short separation phases from smartphones accelerate anxiety and lead to cravings and smartphone overuse after the separation period. Other studies, however, conclude that separation phases enhance individual well-being and academic performance.

RESEARCH QUESTIONS. The present study aims at rigorously studying the effects of smartphone separation during exam phases on university students' performance and well-being. To do so, smartphone use reduction is incorporated into students' everyday life and encouraged through a planning intervention. The main research questions concern whether the intervention can reduce smartphone use in students, whether planning is effective in this regard, whether the intervention positively affects students' academic performance (e.g., concentration, perceived performance, grades), and whether the intervention enhances students' well-being (e.g., increased positive and decreased negative affect, lower anxiety). Furthermore, possible moderating (e.g., smartphone dependence, FoMO) and mediating variables (e.g., exam preparation-related flow, smartphone usage time, used mobile applications) are examined.

METHOD. Students are to develop action plans (BCT 1.4; plans on how to reduce smartphone use during exam phases) and coping plans (BCT 1.2; plans on how to uphold reduced smartphone use during exam phases despite potential stressors or urges). The relevant variables are assessed over the course of 5 measurement points (t1-t3 take place on a weekly basis, t4 takes place after the last exam, t5 takes place 2 months after t4). Furthermore, smartphone use (smartphone use time, used mobile applications) is objectively measured via a mobile application.

Study Overview

• Status: Recruiting
• Conditions: Control Group; Experimental Group: Smartphone Use Reduction
• Intervention / Treatment: Behavioral: Smartphone Use Reduction in Academic Context; Behavioral: Control

Detailed Description

Smartphones have become integral parts of students' everyday life. Research has shown that students excessively use their smartphones during semester times, in lectures, and while studying and that their smartphone use seldomly serves educational purposes. Unsurprisingly, smartphone interferences within such academically relevant situations can impair students' performance. For instance, it has been shown that students are more distracted, experience less study-related flow, evaluate their own performance more negatively, and achieve lower grades when engaging with their smartphones in academic contexts. Besides these performance-related downsides, research also suggests that smartphone use can impair students' well-being. Excessive use of smartphones and social media applications has been linked to various well-being-related issues such as negative affect, stress, and anxiety. As students have been identified as a high-risk group prone to smartphone overuse and smartphone addiction, they should be particularly susceptible to such well-being-related consequences.

The overall goal of all institutions of higher education must be the promotion of students' academic success as well as students' well-being as these two interrelated factors act as important predictors for both individual and public health and functioning. Consequently, while it is valuable to examine the negative effects of smartphone use on performance and well-being in academic contexts and understand their underlying processes, it is just as important to explore possible interventions to mitigate such negative outcomes. Here, it is necessary to answer questions regarding the effectiveness of such interventions (e.g., smartphone abstinence) on a variety of outcome variables and incorporate possible mediating or moderating influences relevant to the effects of such interventions on students' performance and well-being. Unfortunately, intervention studies in this regard are scarce. Yet, existing research indicates inconsistent findings. In fact, there is some evidence that short separation phases from smartphones result in higher anxiety levels. Moreover, phases of smartphone and social media abstinence appear to go along with smartphone cravings and potential overuse after the intervention is over. However, some studies found promising effects of separation phases on well-being, life satisfaction, procrastination, perceived stress or depression. A first study that investigated separation phases from smartphones among students revealed positive effects on individual well-being and performance by enhancing personal lifestyle, health, and academic management and reducing smartphone overuse. Yet, such intervention studies are extremely limited and need to be studied more rigorously. Especially moderating or mediating variables need to be taken into account to explain the effectiveness of smartphone abstinence interventions. In this light, smartphone addiction and fear of missing out (FOMO) seem to play an important role concerning the detrimental effect of smartphone abstinence on well-being. Finally, existing studies have mainly focused on the effects of smartphone separation phases lasting several hours or even days. As these are rather unrealistic settings, future interventions should be designed in ways that integrate pauses from smartphone use into people's everyday life.

Consequently, the present study aims at investigating the effectiveness of an intervention in which students are to develop action plans (BCT 1.4; ) as well as coping plans (BCT 1.2) allowing them to study without smartphone interferences. Planning is a very simple strategy with impressive effects, as indicated by medium to large effect sizes on behavior observed across various populations and behaviors. During a planning intervention, an individual is linking a situational cue (when/where) to an intended behavioral response (how) by mental simulation of anticipated situations. Thus, the goal is to link a specific cue to an intended action in order to translate goal intentions into behavior. In addition, planning is often complemented by coping planning (anticipation of barriers and the formation of plans on how to overcome them). In this study, individuals are to complete a planning sheet that contains both action and coping plans to restrict their own smartphone use during learning periods.

The measured outcomes include a variety of performance- (i.e., ability to concentrate, perceived learning achievement, exam grade, exam-related stress) and well-being-related variables (e.g., positive and negative affect, anxiety, subjective well-being). Furthermore, in this study, the mediating role of variables sought to be promoted through the intervention (i.e. decreased daily smartphone use, decreased daily use of social media applications, increased exam preparation-related flow) and possible moderators (i.e. smartphone addiction, FoMO) are also investigated.

The aims of the present study are threefold. First, the effectiveness of planning a separation from the smartphone during an exam phase is compared against a control group on a device-based assessment of smartphone use. Besides this first main aim, it is also aimed at specifically comparing the effectiveness of the planning intervention to a control group on academic performance and well-being among students. Third, this study examines the assumed underlying mechanisms as well as possible moderators of the planning intervention.

Research questions and hypotheses

Research question 1: Is planning an effective strategy to reduce smartphone use among students during an exam period?

Hypotheses 1.a - 1.b: Students in the planning intervention group will display a) shorter overall smartphone use, b) decreased use of social media applications than students in the control group.

Research question 2: What are the underlying mechanisms of the planning intervention in students regarding smartphone use reduction?

Hypotheses 2.a - 2.b: The effect of planning on smartphone use reduction is mediated by a) individual action planning, and b) individual coping planning.

Research question 3: Does the planning intervention result in higher academic performance?

Hypotheses 3.a - 3.d.: Students in the planning intervention group will a) display greater ability to concentrate, b) experience lower study-related stress, c) evaluate their perceived learning achievement more positively, and d) achieve better exam grades than students in the control group.

Research question 4: What are possible moderators of the relationship between the planning intervention and academic performance?

Hypotheses 4.a - 4.b.: The effect of the intervention on students' academic performance will be moderated by their levels of a) fear of missing out, and b) smartphone addiction.

Research question 5: What are the underlying mechanisms of the planning intervention regarding academic performance in students?

Hypotheses 5.a - 5.d.: The effect of the planning intervention on students' academic performance will be mediated by a) shorter overall smartphone use, b) decreased use of social media applications, and c) enhanced exam preparation-related flow.

Research question 6: Does the planning intervention result in more well-being in students?

Hypotheses 6.a - 6.d.: Students in the planning intervention group will a) display higher levels of positive affect, b) lower levels of negative affect, c) less anxiety, and d) higher subjective well-being than students in the control group.

Research question 7: What are possible moderators of the relationship between the planning intervention and well-being in students?

Hypotheses 7.a - 7.b.: The effect of the intervention on students' well-being will be moderated by their levels of a) fear of missing out and b) smartphone addiction.

Research question 8: What are the underlying mechanisms of the planning intervention in students regarding well-being?

Hypotheses 8.a - 8.d.: The effect of the planning intervention on students' well-being will be mediated by a) shorter overall smartphone use and b) decreased use of social media applications.

Study Design

The present study utilizes an online longitudinal randomized control trial conducted at nationwide universities in Germany over a course of 3 months per data collection period. Assessments will be conducted in a student sample weekly before the examination phase (t1-t3), after the first exam (t4), and after the exam grades have been announced (t5). Students will be randomly assigned to an intervention and a control group.

First, interested individuals have to fill in a prescreening questionnaire. In case all inclusion criteria are met, students have to fill in the Baseline assessment. At the end of the Baseline measurement, all students will be given general advice on how to organize their study environment and behavior to improve their overall learning performance (e.g., organization of materials for exam preparation, pauses during exam preparation). Participants in the intervention group will also be instructed to develop individual action and coping plans to decrease smartphone interferences when studying. Students in the control group have to fill out questionnaires on general health behavior instead. Students in both groups will also be asked to install a mobile application on their smartphones which objectively measures each participants' daily smartphone use, screen activations, and specific application usage. The application will not inform participants about their smartphone use but log the data in the background. Participants will be instructed to not uninstall the application before the measurement time point t4.

One week after the Baseline measurement and the intervention, participants receive the online questionnaire t2, and two weeks after the Baseline measurement, questionnaire t3 follows. After the first exam which was asked for in the Baseline assessment, participants will receive questionnaire t4. Two month later participants will receive a short questionnaire (t5) that ask for the exam grades. All participants will be debriefed at the end of the study. Through their participation, students can participate in a voucher raffle; this information is provided before study participation and again at the end of each questionnaire.

Additional analyses according to the COVID-19 pandemic:

During data collection of the originally planned study "Study Smart", the global pandemic COVID-19 occurred. Because this gives us data from students across different phases of the pandemic, we plan to conduct additional analyses of the data as described below.

In this additional analyses, we compare the emotional well-being (i.e., positive and negative affect, general well-being, and perceived stress) and academic functioning (i.e., academic well-being encompassing study-related stress and test anxiety, academic self-perception encompassing students' academic self-concept and perceived study-related self-efficacy, academic motivation encompassing students' achievement motivation and study-related flow, and academic self-regulation encompassing students' concentration, frequency of study activities, and procrastination) of three student cohorts. The first student cohort was assessed before the COVID-19 pandemic, and therefore represents a pre-pandemic control group. The second cohort was assessed after the first lockdown in Germany. These students experienced emergency remote learning and eased lockdown measures. The third student cohort was assessed during the second lockdown in Germany, when coronavirus cases dramatically increased. These students experienced both emergency remote learning and social detriments from rigorous lockdown measures.

Students' general emotional well-being

Research indicates that COVID-19-related lockdown measures engender affective detriments in students (e.g., negative emotions, stress, and depression). However, research also shows that students' general emotional well-being appears to rapidly improve to pre-pandemic levels when lockdown measures are eased. In line with this, for students' general emotional well-being (H1), we hypothesize the following:

H1.1: The third student cohort will report (a) less positive and (b) more negative affect, (c) less general well-being, and (d) higher perceived stress than the first cohort.

H1.2: The third student cohort will report (a) less positive and (b) more negative affect, (c) less general well-being, and (d) higher perceived stress than the second cohort.

H1.3: The second student cohort will report similar levels of (a) positive and (b) negative affect, (c) general well-being, and (d) perceived stress to the first cohort.

Students' academic functioning

Research also indicates that COVID-19-related lockdown measures can impair students' academic functioning. Furthermore, the transition to emergency remote learning can result in academic detriments. We therefore assume that the student cohort assessed during the second lockdown in Germany (i.e., students experiencing both emergency remote learning and social detriments from rigorous lockdown measures) will exhibit a severe decline in their academic functioning compared to the pre-pandemic cohort. Yet, the student cohort assessed after the first lockdown (i.e., students experiencing emergency remote learning and eased lockdown measures) should also be affected in their academic functioning due to remaining emergency remote learning albeit not as pronounced as those students assessed during the second lockdown. Therefore, as for students' academic functioning encompassing academic well-being (H2), academic self-perception (H3), academic motivation (H4), and academic self-regulation (H5), we hypothesize the following:

H2.1: The third student cohort will report (a) more study-related stress and (b) more test anxiety than the first cohort.

H2.2: The third student cohort will report (a) more study-related stress and (b) more test anxiety than the second cohort.

H2.3: The second student cohort will report (a) more study-related stress and (b) more test anxiety than the first cohort.

H3.1: The third student cohort will report (a) a lower academic self-concept and (b) less study-related self-efficacy than the first cohort.

H3.2: The third student cohort will report (a) a lower academic self-concept and (b) less study-related self-efficacy than the second cohort.

H3.3: The second student cohort will report (a) a lower academic self-concept and (b) less study-related self-efficacy than the first cohort.

H4.1: The third student cohort will report (a) less study-related motivation and (b) less study-related flow than the first cohort.

H4.2: The third student cohort will report (a) less study-related motivation and (b) less study-related flow than the second cohort.

H4.3: The second student cohort will report (a) less study-related motivation and (b) less study-related flow than the first cohort.

H5.1: The third student cohort will report (a) less concentration and (b) lower frequency of study activities, and (c) more procrastination than the first cohort.

H5.2: The third student cohort will report (a) less concentration and (b) lower frequency of study activities, and (c) more procrastination than the second cohort.

H5.3: The second student cohort will report (a) less concentration and (b) lower frequency of study activities, and (c) more procrastination than the first cohort.

• Study Type: Interventional
• Enrollment (Anticipated): 140
• Phase: Not Applicable

Contacts and Locations

• Study Contact: Name: Tania R. Nunez, M.A.; Phone Number: +49 (0)2302/926-884; Email: tania.nunez@uni-wh.de
• Study Contact Backup: Name: Theda Radtke, PhD; Email: theda.radtke@uni-wh.de

Study Locations

• Germany
  • NRW
    • Witten, NRW, Germany, 58454
      • Recruiting
      • Witten/Herdecke University
      • Contact: Theda Radtke, Prof. Dr.; Email: Theda.Radtke@uni-wh.de
      • Contact: Tania Nuñez, Msc; Email: Tania.Nunez@uni-wh.de

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: 16 years and older (ADULT, OLDER_ADULT, CHILD)
• Accepts Healthy Volunteers: Yes
• Genders Eligible for Study: All

Description

Inclusion Criteria:

• Students from universities and universities of applied science
• At least one written or oral exam during the data collection period
• Ownership of an Android smartphone
• Daily usage of the smartphone
• Experience of distractions due to the smartphone during exam phases
• At least 16 years of age
• At least good German language skills

Exclusion Criteria:

• Withholding consent to the data security regulations
• Withholding consent to the installation of the study application
• Students who are currently being treated for exam anxiety

Study Plan

How is the study designed?

Design Details

• Primary Purpose: PREVENTION
• Allocation: RANDOMIZED
• Interventional Model: PARALLEL
• Masking: SINGLE

Number of Arms

2

Arms and Interventions

Participant Group / Arm	Intervention / Treatment
EXPERIMENTAL: Intervention Group; Intervention points in time include: Baseline measure; Installation of the study app; Advice on general enhancements regarding study environment and behavior (BCT 4.1); Students are to develop up to three action plans (BCT 1.4) and coping plans (BCT 1.2) to reduce smartphone interference during exam preparation periods by putting the smartphone away; Students receive weekly questionnaire (t1-t3) and one questionnaire after their first exam (t4). All these questionnaires concern their academic performance and well-being. A short questionnaire (t5) asks for the participants' exam grades approx. 2 months after their exam. A time period of 2 months has been chosen to ensure that universities have enough time to announce the grades.; During the whole period of the study, the mobile application tracks the students' smartphone behavior (i.e., daily smartphone use, daily screen activations, and specific app usage).	Behavioral: Smartphone Use Reduction in Academic Context; Students will be given general advice on how to organize their exam preparation environment and behavior to improve their overall learning performance (e.g., organization of materials for exam preparation, pauses during exam preparation). This refers to the behavior change techniques (BCT 4.1, instructions on how to perform the behavior; Michie et al.; 2013). In the next step, participants in the intervention group complete planning sheets. Each student has to develop up to three action plans (BCT 1.4) including when, where, and for how long the smartphone will be put away during the daily exam preparation period (cf. Radtke et al., 2018). In addition, each participant should try to anticipate possible barriers to engaging in the planned behavior and plan what he or she could do to overcome these possible barriers (i.e., coping planning; BCT 1.2; Michie et al., 2013).
ACTIVE_COMPARATOR: Control Group; Control points in time include all parts except for number 4. Here students in the control group will receive questionnaires on general health behavior in order to achieve an equal questionnaire completion time compared to the intervention group.	Behavioral: Control; Students will be given general advice on how to organize their exam preparation environment and behavior to improve their overall learning performance (e.g., organization of materials for exam preparation, pauses during exam preparation).

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Objective measure of smartphone use	The daily smartphone use will be assessed via the mobile application Murmuras measuring daily smartphone use in minutes and specific application use concerning the 10 most used applications.	Continuously from time point 1 (baseline) through time point 2 (1 weeks after baseline), time point 3 (2 weeks after baseline) to time point 4 (after final exam in the current semester, approx. 4 - 6 weeks after baseline)
Subjective measure of academic performance: Ability to concentrate	Changes in students' ability to concentrate will be assessed through subjective self-report measures. Measure: LIST; Inventory for assessing learning strategies in students; score: 1 [not at all agreed] to 5 [completely agreed]).	Time point 1 (baseline), time point 2 (1 week after baseline), time point 3 (2 weeks after baseline), time point 4 (after final exam in the current semester, approx. 4 - 6 weeks after baseline)
Subjective measure of academic performance: Experienced study-related stress	Changes in students' experienced study-related stress will be assessed through subjective self-report measures. Measure: Self-developed based on STQL-S; Stress coping and quality of life in students; score: 1 [not at all] to 5 [extremely]).	Time point 1 (baseline), time point 2 (1 week after baseline), time point 3 (2 weeks after baseline)
Subjective measure of academic performance: Perceived learning achievement	Students' perceived learning achievement will be assessed through subjective self-report measures. Measure: Self-developed. Measure: Self-developed; score: 1 [not at all agreed] to 6 [completely agreed]).	Time point 4 (after final exam in the current semester, approx. 4 - 6 weeks after baseline)
Subjective measure of academic performance: Exam grades	Students' exam grades will be assessed through subjective self-report measures. Measure: Self-developed.	Time point 5 (2 months after final exam in the current semester)
Subjective measure of well-being: Positive and negative affect	Changes in students' positive and negative affect will be assessed through subjective self-report measures. Measure: PANAS; Positive and negative affect schedule; score: 1 [not at all] to 5 [extremely]).	Time point 1 (baseline), time point 2 (1 week after baseline), time point 3 (2 weeks after baseline), time point 4 (after final exam in the current semester, approx. 4 - 6 weeks after baseline)
Subjective measure of well-being: Anxiety	Changes in students' anxiety will be assessed through subjective self-report measures. Measure: PSS; Perceived stress scale - German version; score: 1 [never] to 5 [very often]).	Time point 1 (baseline), time point 2 (1 week after baseline), time point 3 (2 weeks after baseline), time point 4 (after final exam in the current semester, approx. 4 - 6 weeks after baseline)
Subjective measure of well-being: Subjective well-being	Changes in students' subjective well-being will be assessed through subjective self-report measures. Measure: WHO-5 Well-being-Index; score: 1 [never] to 6 [all the time]).	Time point 1 (baseline), time point 2 (1 week after baseline), time point 3 (2 weeks after baseline), time point 4 (after final exam in the current semester, approx. 4 - 6 weeks after baseline)

Secondary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Subjective measure of moderating variables: Smartphone dependence	The possible moderator smartphone dependence will be assessed through subjective self-report measures. Measure: Quick test for smartphone addiction; score: 1 [not at all agreed] to 6 [completely agreed]).	Time point 1 (baseline)
Subjective measure of moderating variables: Fear of missing out	The possible moderator fear of missing out (FoMO) will be assessed through subjective self-report measures. Measure: FoMOs; Fear of missing out scale; score: 1 [not at all agreed] to 5 [completely agreed]).	Time point 1 (baseline)
Subjective measure of mediating variables: Individual action planning	Changes in the possible mediator individual action planning will be assessed through subjective self-report measures. Measure: According to the Health Action Process Approach [HAPA]; score: 1 [not at all agreed] to 6 [completely agreed])	Time point 1 (baseline), time point 2 (1 week after baseline), time point 3 (2 weeks after baseline), time point 4 (after final exam in the current semester, approx. 4 - 6 weeks after baseline)
Subjective measure of mediating variables: Individual coping planning	Changes in the possible mediator individual coping planning will be assessed through subjective self-report measures. Measure: According to the Health Action Process Approach [HAPA]; score: 1 [not at all agreed] to 6 [completely agreed]).	Time point 1 (baseline), time point 2 (1 week after baseline), time point 3 (2 weeks after baseline), time point 4 (after final exam in the current semester, approx. 4 - 6 weeks after baseline)
Subjective measure of mediating variables: Exam preparation-related flow	Changes in the possible mediator exam preparation-related flow will be assessed through subjective self-report measures. Measure: FKS; Flow-short scale; score: 1 [not at all agreed] to 5 [completely agreed]).	Time point 1 (baseline), time point 2 (1 week after baseline), time point 3 (2 weeks after baseline), time point 4 (after final exam in the current semester, approx. 4 - 6 weeks after baseline)

Collaborators and Investigators

• Sponsor: University of Witten/Herdecke
• Investigators: Principal Investigator: Theda Radtke, Witten/Herdecke University

Study record dates

Study Major Dates

• Study Start (ACTUAL): January 13, 2020
• Primary Completion (ANTICIPATED): October 31, 2021
• Study Completion (ANTICIPATED): October 31, 2021

Study Registration Dates

• First Submitted: July 6, 2020
• First Submitted That Met QC Criteria: September 8, 2020
• First Posted (ACTUAL): September 16, 2020

Study Record Updates

• Last Update Posted (ACTUAL): June 8, 2021
• Last Update Submitted That Met QC Criteria: June 2, 2021
• Last Verified: June 1, 2021

More Information

Terms related to this study

• Other Study ID Numbers: 215/2019

Plan for Individual participant data (IPD)

• Plan to Share Individual Participant Data (IPD)?: YES
• IPD Plan Description: The data underlying publications will be shared to make the published results reproducible.
• IPD Sharing Time Frame: The data underlying publications will be shared to make the published results reproducible after submission of the papers.
• IPD Sharing Access Criteria: Upon request

Drug and device information, study documents

• Studies a U.S. FDA-regulated drug product: No
• Studies a U.S. FDA-regulated device product: No