Development and Evaluation of a Large Language Model - Based Training Program for Nurses in Public Health Emergencies

The goal of this randomized controlled trial is to evaluate the immediate efficacy of a Large Language Model (LLM)-assisted training program in enhancing nurses' emergency response capabilities in 204 practicing nurses with ≤5 years of experience from tertiary hospitals in Guiyang, China, focusing on public health emergencies (PHEs). The main questions it aims to answer are:

1. Does LLM-assisted training improve nurses' comprehensive emergency response capabilities in PHEs?
2. Does it specifically enhance rescue skills and occupational protection abilities? Researchers will compare the experimental group (receiving routine PHE training + LLM-assisted learning) to the control group (receiving routine PHE training only) to see if LLM supplementation leads to significantly greater improvements in targeted emergency competencies.

Participants will:

Complete pre- and post-training assessments (Nurse Self-Assessment Scale for Emergency Response Ability, Nurse's Emergency Response Capacity Scale for PHEs).

Undergo a one-month PHE training program. (Experimental Group Only): Use LLMs for knowledge review, question answering, and exploring unfamiliar concepts during the training period.

Study Overview

• Status: Completed
• Conditions: The Emergency Response Capabilities of Nurses (Including Occupational Protection, Critical Thinking, Communication Skills and Humanistic Care, Etc.)
• Intervention / Treatment: Other: LLM-Assisted Public Health Emergency Training Program; Other: Standard Public Health Emergency Training Program

• Study Type: Interventional
• Enrollment (Actual): 204
• Phase: Not Applicable

Contacts and Locations

Study Locations

• China
  • Guizhou
    • Guiyang, Guizhou, China, 550004
      • The Affiliated Hospital of Guizhou Medical University

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: Child
• Accepts Healthy Volunteers: Yes

Description

Inclusion Criteria:

• Holds a valid nursing professional qualification certificate；
• ≤5 years of nursing work experience；
• Voluntarily agrees to participate in the training program。

Exclusion Criteria:

• Inability to complete the 1-month training program (e.g., planned leave, transfer, or resignation during the study period)
• Prior experience using Large Language Models (LLMs) for professional training (to avoid confounding effects)
• Refusal to comply with group assignment protocols (e.g., control group participants attempting to use LLMs)

Study Plan

How is the study designed?

Design Details

• Primary Purpose: Supportive Care
• Allocation: Randomized
• Interventional Model: Parallel Assignment
• Masking: Double

Number of Arms

2

Arms and Interventions

Participant Group / Arm	Intervention / Treatment
Other: LLM-Assisted PHE Training Group; Participants in this arm receive the routine hospital-based public health emergency (PHE) training program supplemented with Large Language Model (LLM) technology for auxiliary learning. During the 1-month training period, they are instructed and encouraged to use LLMs for: Reviewing knowledge covered in training sessions; Answering questions and clarifying uncertainties; Exploring unfamiliar concepts related to PHE response (Intervention: Standard PHE curriculum + LLM-enabled interactive learning support)	Other: LLM-Assisted Public Health Emergency Training Program; A hybrid training program integrating the hospital's standard public health emergency (PHE) curriculum with Large Language Model (LLM) technology as an auxiliary learning tool. Participants receive: Standardized PHE training (online lectures + offline simulations) covering professional knowledge, skills, and emergency drills (e.g., infectious disease response, trauma management).; LLM-enabled interactive support: Structured guidance to use LLMs for: Reviewing session content Resolving knowledge uncertainties via Exploring unfamiliar PHE concepts • Duration: 1 month, with 20-minute sessions. Distinguishing feature: Uses LLMs to dynamically adapt to individual learning needs, enabling on-demand knowledge reinforcement and overcoming spatiotemporal limitations of traditional training.; Other: Standard Public Health Emergency Training Program; The hospital's existing public health emergency (PHE) training program without AI augmentation. Participants receive: Identical core content as the experimental group: Professional knowledge, skills training, and emergency drills for PHE response (e.g., disaster protocols, infection control).; Explicit restriction: Prohibited from using LLMs or any AI tools for learning support.; Delivery: Hybrid format (online + offline), 1-month duration, 20-minute sessions. Distinguishing feature: Represents traditional training methods reliant on instructor-led content without personalized, on-demand AI-driven reinforcement.
Other: Standard PHE Training Group; Participants in this arm receive only the routine hospital-based public health emergency (PHE) training program. They are explicitly restricted from using LLMs or any other artificial intelligence tools for assisted learning throughout the 1-month training period. (Intervention: Standard PHE curriculum without AI augmentation)	Other: Standard Public Health Emergency Training Program; The hospital's existing public health emergency (PHE) training program without AI augmentation. Participants receive: Identical core content as the experimental group: Professional knowledge, skills training, and emergency drills for PHE response (e.g., disaster protocols, infection control).; Explicit restriction: Prohibited from using LLMs or any AI tools for learning support.; Delivery: Hybrid format (online + offline), 1-month duration, 20-minute sessions. Distinguishing feature: Represents traditional training methods reliant on instructor-led content without personalized, on-demand AI-driven reinforcement.

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Time Frame
Comprehensive Emergency Response Capability Total Score Nurse's Self-Assessment Capability Total Score	Baseline (pre-training) and immediately post-intervention (after 1 month of training)

Collaborators and Investigators

• Sponsor: The Affiliated Hospital Of Guizhou Medical University

Study record dates

Study Major Dates

• Study Start (Actual): October 1, 2024
• Primary Completion (Actual): December 31, 2024
• Study Completion (Actual): December 31, 2024

Study Registration Dates

• First Submitted: August 19, 2025
• First Submitted That Met QC Criteria: August 19, 2025
• First Posted (Estimated): August 26, 2025

Study Record Updates

• Last Update Posted (Estimated): August 26, 2025
• Last Update Submitted That Met QC Criteria: August 19, 2025
• Last Verified: August 1, 2025

More Information

Terms related to this study

• Other Study ID Numbers: [2022]-4-2-2

Plan for Individual participant data (IPD)

• Plan to Share Individual Participant Data (IPD)?: NO

Drug and device information, study documents

• Studies a U.S. FDA-regulated drug product: No
• Studies a U.S. FDA-regulated device product: No