A Cross-over Randomised Trial Comparing Two Teaching Methods

Comparison Between Different Asynchronous Teaching Methods in an Undergraduate Orthodontic Course: A Crossover Randomised Trial

The aim of the study aim to test the null hypothesis which states that there are no significant differences in knowledge retention and exam performance of dental undergraduate students in a Saudi Dental School using two different asynchronous teaching methods . The secondary aim is to analyse students' perceptions to the two teaching methods.

Study Overview

• Status: Completed
• Conditions: Educational Problems
• Intervention / Treatment: Other: Flipped classroom teaching method

Detailed Description

Design: The trial was designed as a crossover clustered randomized trial whereby each group/ cluster acted as their control for their learning performance and perception.

Setting: College of Dentistry, Princes Sattam Bin Abdulaziz University, Riyadh, Saudi Arabia.

Consents: The ethical approval was obtained from the Scientific Research Unit at the College of Dentistry, Prince Sattam Bin Abdulaziz University, Alkharj, Riyadh (ethical approval PSAU2020030). Written consent was obtained from students before commencing the trial.

Participants: Fourth-year undergraduate dental students enrolled in the preclinical orthodontic course at Prince Sattam University were invited to participate in the study. Students who were registered in the course for the second time were excluded to lessen the bias associated with previous experience of orthodontic teaching. The sample size was based on the total number of students registered in the course at the time of the study.

Randomization: Computer-generated randomization was performed to allocate participants to one of two groups. The sequence of random allocation was concealed from researchers who analyzed the results. Participants in the control group were taught through the virtual traditional learning method (VTL) using live-video streaming, while participants in the intervention group were taught through the virtual flipped learning method (VFL). VTL group included 16 students, while the VFL group included 17 students. We use the term control group to refer to students who studied using the VTL format method across both periods. We also use the term intervention group to refer to students who studied using VFL format across both periods.

Intervention: 4 lectures were delivered asynchronously using two different teaching methods as mentioned above. Participants in VFL had monitored remote access to the recorded lectures for one week, followed by 4 additional small group online discussion sessions. The students in both groups remotely attended all pre-recorded and live-video virtual lectures.

Intervention implementation rounds The intervention was implemented in 3 consecutive weeks. The first lecture (L1: Adult Orthodontics) was taught in the first week. Before L1, all students were asked to complete a set of multiple-choice questions (MCQs) formative exam (i.e., pre-test). Following the pre-test, the lecture was delivered to participants of the VTL group using a passive online teaching format (live-video streaming). L1 was also recorded after obtaining verbal consent from the attendees. After the lecture was completed, students were asked to re-take the same pre-test exam and complete a questionnaire regarding the VTL experience.

Within 24 hours following L1, participants of VFL had 7-day monitored remote access to the recorded lecture of L1, and they were taught using an active teaching model, referred to as the VFL model. Like the participants of the VTL group, participants of the VFL group were asked to complete the relevant pre-test.

At the expiry of remote access to the recorded lecture, participants from VFL were invited to attend post-lecture discussion sessions. To enhance the effectiveness of post-lecture discussion, participants were randomly divided into two smaller subgroups, and the same lecturer facilitated the discussions for each group separately. At the end of each discussion session, participants were asked to re-take the pre-test of L1 and a complete questionnaire regarding their VFL experience.

Following the small group's discussion session, participants of VFL were given a 30-minute break before the start of the second lecture related to the topic of Orthognathic Surgery (L2). However, the intervention was crossed over; hence, the cohort of VFL in week 1 acted as a control group while teaching L2 and vice versa. The same protocol of teaching models that were applied in week 1 was adopted.

Participants of both groups were taught by the same instructor using the same materials, irrespective of the teaching methods. The lectures were delivered using the same presentation platform (PowerPoint, Microsoft Corp, Redmond, WA) and the same virtual learning platform (Zoom live-streaming software - Zoom Video Communications, Inc, San Jose, California, Version 5.4.3). The duration of each lecture was 60 minutes, while the post-lecture discussion in the VFL design lasted 15 minutes. Learning outcomes were based on each lecture's learning objectives and outcomes that aligned with what is specified by the National Commission for Academic Accreditation and Assessment in Saudi Arabia.

• Study Type: Interventional
• Enrollment (Actual): 32
• Phase: Not Applicable

Contacts and Locations

Study Locations

• Saudi Arabia
  • Al Kharjah, Saudi Arabia
    • Prince Sattam bin Abdulaziz University

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: 22 years to 28 years (ADULT)
• Accepts Healthy Volunteers: Yes
• Genders Eligible for Study: Male

Description

Inclusion Criteria:

• Fourth-year undergraduate students enrolled in the course, in a Saudi Dental college.

Exclusion Criteria:

• Students who are enrolled in the course for a second time

Study Plan

How is the study designed?

Design Details

• Primary Purpose: OTHER
• Allocation: RANDOMIZED
• Interventional Model: CROSSOVER
• Masking: SINGLE

Number of Arms

2

Arms and Interventions

Participant Group / Arm	Intervention / Treatment
ACTIVE_COMPARATOR: Passive online; Before L1, all students will be asked to complete a set of multiple-choice questions (MCQs), formative exam (i.e. pre-test). Following the test , the lecture will be delivered to the participants of PG using a passive online teaching format for 60 minutes (i.e., live-video streaming). After the lecture is completed, students will be asked to re-take the same pre-test exam and complete questionnaire regarding their experience with the teaching methods.	Other: Flipped classroom teaching method; Participants will have 7 -day monitored remote access to a recorded lecture about orthodontic topic. At the expiry of remote access to the recorded lecture, participants from FG will be invited to attend post-lecture discussion sessions. To enhance the effectiveness of flipped classroom teaching method, the cohort of FG will be randomly, using computer generated randomisation, subdivided to two smaller groups in which each group will be consisted of half of the FG cohort. The same lecturer will moderate the discussions for each group separately.
EXPERIMENTAL: Flipped classroom; Participants of FG will have an access to a recorded lecture. and they will be taught using an active teaching model known as flipped classroom model. In this model, participants will have 7 -day monitored remote access to the recorded L1. Similar to PG, completing the online pre-test formative exam will be preliminary requirement to access the published recorded L1. At the expiry of remote access to the recorded lecture, participants from FG will be invited to attend post-lecture discussion sessions. To enhance the effectiveness of flipped classroom teaching method, the cohort of FG will be randomly, using computer generated randomisation, subdivided to two smaller groups in which each group will be consisted of half of the FG cohort. The same lecturer will moderate the discussions for each group separately. After the lecture is completed, students will be asked to re-take the same pre-test of L1 and complete questionnaire regarding their experience with the teaching methods.	Other: Flipped classroom teaching method; Participants will have 7 -day monitored remote access to a recorded lecture about orthodontic topic. At the expiry of remote access to the recorded lecture, participants from FG will be invited to attend post-lecture discussion sessions. To enhance the effectiveness of flipped classroom teaching method, the cohort of FG will be randomly, using computer generated randomisation, subdivided to two smaller groups in which each group will be consisted of half of the FG cohort. The same lecturer will moderate the discussions for each group separately.

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Formative exam	Before each lecture, students will complete a set of multiple-choice questions (MCQs), formatively (i.e. pre-test). These questions will be related to the taught topics, and will be administered remotely using learning management system (Blackboard). After each lecture, students will be asked to re-take the same pre-test via Blackboard. This formative assessment test will measure students' learning gain. Two investigators will construct the pre-test questions to ensure its content validity and reliability. Content validity will be tested using test matrix and experts judgment. The reliability test will estimated using inter-rater reliability. A correlation of more than 0.7 will be considered acceptable.	7-days

Secondary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Perception to the two teaching methods.	At the end of each lecture, students will be asked to answer a questionnaire regarding their experience with the teaching methods they have received. We will use the validated Web-Based Learning Environment Inventory (WELEI), developed by Chang and Fisher (2001). In addition to demographic section, the questionnaire consists of items that captures students' perceptions of web-based learning environments. Regarding the flipped classroom teaching method, we will include additional questions adapted from previous studies that examined students' perception of the flipped classroom (Johnson, 2013 and Butt, 2014). The questionnaire will be distributed online via SurveyMonkey (San Mateo, California, United States).	7-days

Collaborators and Investigators

• Sponsor: Prince Sattam Bin Abdulaziz University
• Investigators: Study Chair: Fahad Alharbi, PhD, Prince Sattam bin Abdulaziz University

Publications and helpful links

General Publications

• Alharbi F, Alwadei SH, Alwadei A, Asiri S, Alwadei F, Alqerban A, Almuzian M. Comparison between two asynchronous teaching methods in an undergraduate dental course: a pilot study. BMC Med Educ. 2022 Jun 23;22(1):488. doi: 10.1186/s12909-022-03557-7.

Study record dates

Study Major Dates

• Study Start (ACTUAL): August 30, 2020
• Primary Completion (ACTUAL): December 30, 2021
• Study Completion (ACTUAL): January 30, 2022

Study Registration Dates

• First Submitted: December 28, 2020
• First Submitted That Met QC Criteria: December 28, 2020
• First Posted (ACTUAL): December 31, 2020

Study Record Updates

• Last Update Posted (ACTUAL): April 26, 2022
• Last Update Submitted That Met QC Criteria: April 19, 2022
• Last Verified: April 1, 2022

More Information

Terms related to this study

• Keywords: Teaching methods; Learning; Dental education; Dental Students
• Other Study ID Numbers: PSAU2020030

Plan for Individual participant data (IPD)

• Plan to Share Individual Participant Data (IPD)?: YES
• IPD Plan Description: Data will be shared upon asking.
• IPD Sharing Time Frame: Within one year
• IPD Sharing Access Criteria: Eligible researcher who does a similar research.
• IPD Sharing Supporting Information Type: STUDY_PROTOCOL

Drug and device information, study documents

• Studies a U.S. FDA-regulated drug product: No
• Studies a U.S. FDA-regulated device product: No