Adapting web-based instruction to residents' knowledge improves learning efficiency: a randomized controlled trial

Abstract

Background: Increased clinical demands and decreased available time accentuate the need for efficient learning in postgraduate medical training. Adapting Web-based learning (WBL) to learners' prior knowledge may improve efficiency.

Objective: We hypothesized that time spent learning would be shorter and test scores not adversely affected for residents who used a WBL intervention that adapted to prior knowledge.

Design: Randomized, crossover trial.

Setting: Academic internal medicine residency program continuity clinic.

Participants: 122 internal medicine residents.

Interventions: Four WBL modules on ambulatory medicine were developed in standard and adaptive formats. The adaptive format allowed learners who correctly answered case-based questions to skip the corresponding content.

Measurements and main results: The measurements were knowledge posttest, time spent on modules, and format preference. One hundred twenty-two residents completed at least 1 module, and 111 completed all 4. Knowledge scores were similar between the adaptive format (mean +/- standard error of the mean, 76.2 +/- 0.9) and standard (77.2 +/- 0.9, 95% confidence interval [CI] for difference -3.0 to 1.0, P = .34). However, time spent was lower for the adaptive format (29.3 minutes [CI 26.0 to 33.0] per module) than for the standard (35.6 [31.6 to 40.3]), an 18% decrease in time (CI 9 to 26%, P = .0003). Seventy-two of 96 respondents (75%) preferred the adaptive format.

Conclusions: Adapting WBL to learners' prior knowledge can reduce learning time without adversely affecting knowledge scores, suggesting greater learning efficiency. In an era where reduced duty hours and growing clinical demands on trainees and faculty limit the time available for learning, such efficiencies will be increasingly important. For clinical trial registration, see http://www.clinicaltrials.gov NCT00466453 ( http://www.clinicaltrials.gov/ct/show/NCT00466453?order=1 ).

Figures

Figure 1

Participant flow. Module topics were: Module A—diabetes mellitus, Module B—hyperlipidemia, Module C—asthma, and Module D—depression.

Figure 2

Time to complete module and module sequence. Residents completed modules in any sequence they chose. Shown here is the average time required to finish modules according to the completion order. The adaptive format required, on average, 29.3 minutes per module; the standard format required 35.6 minutes per module.