Examining Clinical Reasoning With Eye-tracking

Examining Clinical Reasoning With Eye Tracking

The process of medical information intake, interpretation and diagnosis, commonly referred to as clinical reasoning, involves a complex interaction between visual perception and multiple cognitive processes. Assessing students' clinical reasoning skills is a challenging but critical task in developing an optimal teaching curriculum. In this project, the investigators plan to apply the eye-tracking technology to medical education with a specific goal of examining cognitive processing during reading medical chart and x-ray films. Data collected by eye tracking technology will help investigate the perceptual and cognitive underpinnings of clinical reasoning (CR), misinterpretation and misdiagnosis among three participant groups with different levels of clinical experience. Knowledge gained from this project will help to decode the intricate cognitive loop involved in medical interpretation. Further, this study will help to develop alternative methods of assessing student's clinical reasoning skills and promote medical education with novel eye tracking technology.

Study Overview

• Status: Completed
• Conditions: Diagnosis; Educational Problems
• Intervention / Treatment: Behavioral: Eye tracking

Detailed Description

Objective:

In this project, the investigators plan to apply the eye-tracking technology to medical education with a specific goal of examining cognitive processing during clinical reasoning (CR). The investigators expect that by checking the eye movements of medical trainees during case and image reading, a list of valid behavioral markers could be created, to quantitatively classify the expertise, identify the moment of decision-making difficulty, and decode the source of the judgement errors. To examine differences in CR processes across varying levels of expertise, three categories of participants (novice, intermediate, and expert) will be recruited. While participants' eye motions are tracked, participants will read a trauma case, provide a diagnosis and propose a suitable treatment plan. The investigators postulate that 1) different participant groups will produce significantly different CR outcomes, measured by their score on diagnostic judgement and treatment plan; 2) participants will display different gaze fixation patterns; and 3) combining evidence from clinical judgement and eye behavior analysis will provide useful information regarding the source of judgment errors.

Research Method/Procedures:

Staff and students in the SSRL (Surgical Simulation Research Lab) with a difficulty level of health training background will be enrolled as participants in the study. A trauma case with complex life-threatening situations will be presented. The case is a trauma cases with multiple internal injuries. The case will be summarized into a one-page description and 3 x-ray films. Our participants will need to make a diagnosis and give a treatment plan based on case information displayed on a screen. The total reading time will be 4 minutes. During the case reading, the Tobii X2-60, a high-resolution remote eye-tracker, will be used to capture the participant's eye movements. In addition, the investigators will develop a 15-20 quiz regarding the patient's condition and the participant's final diagnosis. The total score and errors in the quiz will be used to describe participants' overall quality of their clinical reasoning.

The investigators will carefully examine participants' eye motions and report their scanning patterns during case reading. Specifically, the investigators will look for moments when participants rapidly move their eyes (saccade) over a sentence before fixating on a particular word (fixation). These eye behavior parameters have previous associations with mental workload and reasoning processing methods, which can be used to further analyze results.

Plan for Data Analysis:

The investigators will firstly compare quiz scores and eye behaviors variables across the three participant groups with different clinical experience levels. The investigators will then analyze eye-scanning patterns on case readings across the three different groups. Specifically, The investigators predict that experts will achieve the highest score in quiz. The investigators therefore will examine the expert's short and long fixation locations over the case reading. The assumption is that experts know where to find key information in the case description and mentally connect separate information together to generate an correct judgement in the short period of time. Fixation spots recorded from the novice and intermediate groups will be compared with experts'. Differences will help us identify different visual searching strategies over different stages in the development of clinical reasoning skills. Lastly, the investigators will examine clinical judgement errors and check the root cause by connecting quiz errors with eye behaviors. If a participant failed to give a long fixation to key case features in the case description, the clinical decision error may be due to a checking problem. If a participant performs a long fixation to key case features, the clinical decision error may due to recognition or decision-making problems.

• Study Type: Observational
• Enrollment (Actual): 42

Contacts and Locations

Study Locations

• Canada
  • Alberta
    • Edmonton, Alberta, Canada, T6G 2R3
      • University of Alberta

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: Child; Adult; Older Adult
• Accepts Healthy Volunteers: Yes

• Sampling Method: Non-Probability Sample

Study Population

Physicians in neurology department and medical students registered in medical school.

Description

Inclusion Criteria:

• Adult
• Has normal or corrected to normal vision
• Healthcare provider

Exclusion Criteria:

-Non healthcare provider

Study Plan

How is the study designed?

Number of groups / cohorts

2

Cohorts and Interventions

Group / Cohort	Intervention / Treatment
Expert; Physicians	Behavioral: Eye tracking; Recording the eye movement of participants while they read medical cases.
Novice; Medical Students	Behavioral: Eye tracking; Recording the eye movement of participants while they read medical cases.

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Eye Fixation	Eye fixation over key reading area	During case reading (about 5 minutes)

Secondary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Eye Saccade	Rapid eye shift between key reading areas	During case reading (about 5 minutes)

Collaborators and Investigators

• Sponsor: University of Alberta

Study record dates

Study Major Dates

• Study Start (Actual): May 1, 2023
• Primary Completion (Actual): January 30, 2024
• Study Completion (Actual): May 30, 2024

Study Registration Dates

• First Submitted: June 17, 2024
• First Submitted That Met QC Criteria: June 17, 2024
• First Posted (Actual): June 24, 2024

Study Record Updates

• Last Update Posted (Actual): August 2, 2024
• Last Update Submitted That Met QC Criteria: July 31, 2024
• Last Verified: July 1, 2024

More Information

Terms related to this study

• Keywords: Cognitive Development; Eye tracking; Clinical Reasoning
• Other Study ID Numbers: Pro00102074

Plan for Individual participant data (IPD)

• Plan to Share Individual Participant Data (IPD)?: NO

Drug and device information, study documents

• Studies a U.S. FDA-regulated drug product: No
• Studies a U.S. FDA-regulated device product: No