Impact of Formative OSCE on Students' Summative Clinical Performance (OSCE)

Impact of Formative Objective Structured Clinical Examination (OSCE) on Students' Summative Clinical Performance: A Randomized Controlled Trial

Assessment is now seen as a learning experience. there is little literature on objective structured clinical examination role for formative assessment especially in developing world Many studies showed that formative-OSCE contributes positively to final summative examination performance though most studies address this point through the students' perception toward the formative-OSCE.

Having research that evaluates the effect of formative-OSCE introduction on a subsequent summative-OSCE in randomised controlled design may be of benefit for institutions considering the establishment of their own formative-OSCEs particularly in low resource countries.

Study Overview

• Status: Completed
• Conditions: Clinical Performance; Objective Structured Clinical Examination
• Intervention / Treatment: Other: Formative objective structured clinical examination (OSCE)

Detailed Description

Formative assessments are systematically designed instructional interventions to assess and provide feedback on students' strengths and weaknesses in the course of teaching and learning and educational experts recommend its use in addition to summative assessment. Moreover, it is a requirement in undergraduate medical education and must be at the heart of student training not just included to satisfy accreditation requirement, yet unlike other professional training culture such as music in which feedback is expected, respected and given regularly to all learners, the investigators haven't cultivated a true feedback culture in medical education.

In a performance-based assessment, the Objective Structured Clinical Examination (OSCE) has gained importance because of its reliability and could be in a summative or formative manner to measure clinical competence. Clinical skills development requires time and practice at a rate that can accelerated by feedback to optimize experiential learning and improve future performance for which a learner should enter a reflection period during which available feedback is examined.

There are some medical schools where formative assessments are institutionalized and carried out systematically, unfortunately, this kind of assessment is not very frequent in Mediterranean countries.

Undergraduate medical education in Iraq is currently going through a transitional period. The Medical college of Hawler medical university (HMU) which provides a 6-year MBChB program, has started the process of changing its curriculum to competency-based medical education (CBME) and formative assessment is a requirement in this process. In the traditional curriculum training in pediatric is introduced in 5th year with summative assessment composed of 50% written test, 30% OSCE, 10% logbook, 10% history taking skills. Students should be competent to record case history, examine children, make a provisional diagnosis, interpret investigations and communicate with children and their families given that at the allotted time end, students present the case findings and evaluated by the faculty. However, a faculty member doesn't actively observe the students' actual performance of these skills or competencies so the purpose of formative assessment is not fully met. Use of OSCE as formative assessment can overcome this problem.

Attempts have been made in OSCE implementation for summative assessment, however, formative-OSCEs introduction and evaluation in Iraqi medical colleges is lacking. Iraqi medical schools are facing challenges in staff recruitment and adequate resource provision. The latter is one of the numerous concerns and challenges to the CBME implementation.

Many studies showed that formative-OSCE contributes positively to final summative examination performance though most studies address this point through the students' perception toward the formative-OSCE.

• Study Type: Interventional
• Enrollment (Actual): 119
• Phase: Not Applicable

Contacts and Locations

Study Locations

• Iraq
  • Kurdistan Region
    • Erbil, Kurdistan Region, Iraq, 441001
      • Hawler Medical University

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: 19 years to 23 years (Adult)
• Accepts Healthy Volunteers: No
• Genders Eligible for Study: All

Description

Inclusion Criteria:

• 5th-year students of both gender

Exclusion Criteria:

• students who did not fulfill the 4th year requirements.
• absent on the day of performing formative OSCE
• did not agree to participate in formative OSCE

Study Plan

How is the study designed?

Design Details

• Primary Purpose: Other
• Allocation: Randomized
• Interventional Model: Parallel Assignment
• Masking: Single

Number of Arms

2

Arms and Interventions

Participant Group / Arm	Intervention / Treatment
Active Comparator: intervention( formative OSCE); students attended a formative objective structured clinical examination (OSCE) on the first day of their pediatric module to assess the competencies they gained from previous modules. the formative OSCE composed of 8 stations, which were both interactive and static. The interactive stations include history taking, examination, communication (counseling about breastfeeding), and procedural skills (pediatric basic life support) while non-interactive stations include data interpretation, management (linked-station) and a video-station (emergency). assessed at end of the module(7 weeks) through summative OSCE	Other: Formative objective structured clinical examination (OSCE)
No Intervention: control; students in this group have attended pediatric module without formative OSCE and assessed at end of the module(7 weeks) through summative OSCE

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
performance in a summative OSCE test ( OSCE scores)	The randomized groups of students with and without formative OSCE were compared on mean summative OSCE score they obtained at the end of pediatric module	after 7 weeks from formative OSCE assessment

Secondary Outcome Measures

Outcome Measure	Measure Description	Time Frame
student feedback on formative OSCE	measure students' agreement on Likert scale-based questionnaire(a scale used to represent people's attitudes to a topic.) regarding their experience in formative-OSCE (distributed to students of intervention group) the format of the scale was composed of 5 level likert items ( 5 indicating strongly agree where as 1 indicating strongly disagree); Strongly disagree (minimum); Disagree; Neither agree nor disagree; Agree; Strongly agree ( maximum) the percentage of student who tick agree and strongly agree were summed to indicate student agreement on each statement in the questionnaire	after completing the summative OSCE ( 7weeks after formative OSCE)

Collaborators and Investigators

• Sponsor: Hawler Medical University
• Investigators: Principal Investigator: Nazdar E. Alkhateeb, Master, Hawler Medical University; Study Director: Ali A. Al-Dabbagh, Professor, Hawler Medical University; Study Chair: Mohammed Ibrahim, MRCPCH, Queensland Health Service, Australia.; Study Chair: Namir G. Al-Tawil, Professor, Hawler Medical University

Study record dates

Study Major Dates

• Study Start (Actual): September 17, 2016
• Primary Completion (Actual): May 20, 2017
• Study Completion (Actual): May 20, 2017

Study Registration Dates

• First Submitted: June 24, 2018
• First Submitted That Met QC Criteria: July 23, 2018
• First Posted (Actual): July 26, 2018

Study Record Updates

• Last Update Posted (Actual): July 26, 2018
• Last Update Submitted That Met QC Criteria: July 23, 2018
• Last Verified: July 1, 2018

More Information

Terms related to this study

• Keywords: feedback; Iraq; impact; formative assessment; objective structured clinical examination (OSCE)
• Other Study ID Numbers: NAlkhateeb

Drug and device information, study documents

• Studies a U.S. FDA-regulated drug product: No
• Studies a U.S. FDA-regulated device product: No