Train the Trainer Curriculum to Scale up AI Supported Echo for RHD Screening in a Public Health System (ADD-RHD 2B)

Design and Evaluation of a Train the Trainer Curriculum to Scale Up Automated Intelligence Supported Echocardiography for Rheumatic Heart Disease Screening in a Public Health Care System

The first primary objective of this study is to determine the diagnostic performance (sensitivity and specificity) of primary MOH nurses who have completed certification in focused echocardiography acquisition and interpretation by expert trainers to accurately identify patients who are screen positive and screen negative for rheumatic heart disease. The second primary objective is to determine the diagnostic performance (sensitivity and specificity) of secondary MOH nurses who have completed certification in focused echocardiography acquisition and interpretation by MOH nurse trainers to accurately identify patients who are screen positive and screen negative for rheumatic heart disease.

Study Overview

• Status: Completed
• Conditions: Rheumatic Heart Disease
• Intervention / Treatment: Other: Primary Training Phase; Other: Primary Assessment Phase; Other: Primary Screening Phase; Other: Secondary Training Phase; Other: Secondary Assessment Phase; Other: Secondary Screening Phase

Detailed Description

Objective 1:

4 ultrasound naïve nurses (Primary) employed at the HCIII/IVs participating in ADD-RHD Part 1 (SOMREC REF 2021-61) in Lira, will be trained and certified by experts in echocardiography for RHD on focused RHD echocardiographic screening examination and interpretation using a novel AI guided software.

Focused RHD screening echocardiograms by the 4 nurses will be integrated into routine clinical practice at their assigned HCIII/IVs for 1 month.

Screen positive patients will be referred to LRRH for confirmatory echocardiogram using a Standard echocardiographic machine under the National RHD registry (SOMREC REF 2014-137).

All echocardiograms will be uploaded to a secure cloud-based server and over-read by a cardiologist with in one - two (1 - 2) weeks to ensure patient safety and to determine trainee performance.

Diagnostic accuracy, sensitivity, specificity, positive and negative predictive values will be calculated.

4 MOH trainees will use pre-recorded PowerPoint presentations to conduct hands-on training for phase 2 (secondary) nurses.

Objective 2:

Similar to Phase 1 with just a few exceptions. 12 MOH nurses will be trained and certified by MOH nurse trainers from phase 1 to acquire and interpret RHD focused screening echocardiograms using a novel AI guided software.

Screening will be integrated into routine care for 2 months and diagnostic performance assessed.

• Study Type: Interventional
• Enrollment (Actual): 1628
• Phase: Not Applicable

Contacts and Locations

Study Locations

• Uganda
  • Kampala, Uganda
    • Uganda Heart Institute

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: 5 years to 40 years (Child, Adult)
• Accepts Healthy Volunteers: Yes

Description

Inclusion Criteria:

• Attend same HCIII/IV sites that the MOH nurses work at
• Agree to participate via the study's informed consent

Exclusion Criteria:

• Very sick participants requiring transfer to higher level facility or inpatient care

Study Plan

How is the study designed?

Design Details

• Primary Purpose: Health Services Research
• Allocation: Non-Randomized
• Interventional Model: Sequential Assignment
• Masking: None (Open Label)

Number of Arms

2

Arms and Interventions

Participant Group / Arm	Intervention / Treatment
Experimental: Primary Training; 4 Ministry of Health nurses will be trained by expert trainers to become certified in focused echocardiography acquisition and interpretation in order to screen patients for rheumatic heart diseases	Other: Primary Training Phase; A four-day training program taken over the course of two weekends will include materials on RHD and RHD echocardiographic screening using focused artificial intelligence navigational guided echocardiographic acquisition to identify patients who are screen positive or screen negative for RHD. The echo protocol will be limited to the parasternal long axis-view (2D and color Doppler) focusing on mitral and aortic valve morphology and function and a single 2D apical 4 chamber view for auto EF. The curriculum package will include online modules, instructor delivered PowerPoint presentations, and hands on practice on volunteers with and without RHD.; Other: Primary Assessment Phase; A pre- and post-training test on RHD knowledge and diagnosis will be administered. A rapid competency assessment, including obtaining imaging on volunteers with or without RHD and an online test with pre-recorded cases of RHD, LV dysfunction and Pericardial effusions, will be utilized at the end of the 4-day training sessions. Trainees will be monitored by trained study personnel and at the end of the practicum training, the expert users will blindly review and assess the quality of each study using the standardized scale and competency scorecard provided below. Additionally, they will be asked to pass the knowledge quiz (80% or better). If competency is not achieved, an additional weekend of training can be added.; Other: Primary Screening Phase; Following certification, the certified MOH nurses will integrate echocardiographic screening into the routine workflow at the 4 HCIII/IV clinics with each nurse carrying out screening at the assigned HC on patients (aged 5-40) presenting to the health center for routine care. Screening will be done daily over a period of one month. A minimum total of 400 participants will be screened during this period; each nurse will screen as many patients as they can, with a minimum of 100 participants (at least 5 participants per day). At the end of each screen, the trainees will interpret the screen as screen negative or screen positive. They will go ahead to refer participants identified as screen positives to the district hospital (LRRH) for a confirmatory echo. At the end of each screening day, all images will be uploaded to a cloud server for a confirmatory review by a cardiology fellow or cardiology attending physician, within in 1 - 2 weeks.
Experimental: Secondary Training; The 4 Ministry of Health nurses trained in Aim 1 will then train and certify 3 other nurses from their clinics in focused echocardiography acquisition interpretation.	Other: Secondary Training Phase; Each Primary Trained MOH Nurse will train 3 other nurses from their Health Center using pre-recorded PowerPoints.; Other: Secondary Assessment Phase; The secondarily trained nurses will be assessed and certified by the nurse trainer.; Other: Secondary Screening Phase; Following certification, the certified MOH nurses will integrate echocardiographic screening into the routine workflow at the 4 HCIII/IV clinics with each nurse carrying out screening at the assigned HC on patients (aged 5-40) presenting to the health center for routine care. Screening will be done daily over a period of two months. A minimum total of 1200 participants will be screened during this period; each nurse will screen as many patients as they can, with a minimum of 100 participants. At the end of each screen, the trainees will interpret the study as screen negative or screen positive. They will go ahead to refer participants identified as screen positives to the district hospital (LRRH) for a confirmatory echo. At the end of each screening day, all images will be uploaded to a cloud server for a confirmatory review by a cardiology fellow or cardiology attending physician, within in 1 - 2 weeks.

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
RHD Echocardiographic Diagnostic accuracy, sensitivity, specificity of MOH nurses	Diagnostic performance of MOH nurses who have completed certification in focused echocardiography acquisition and interpretation by expert trainers will be assessed. Diagnostic accuracy, sensitivity, specificity, positive and negative predictive values will be calculated to determine diagnostic performance of MOH nurses who have completed certification on focused echocardiography acquisition and interpretation. The ability of trainees to correctly identify screen positive and negative patients for RHD using known expert diagnosis as the reference. Correct determination of RHD screen positive/negative in at least 80% of cases is the benchmark	2 months after completion of training

Secondary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Knowledge Assessment	Questionnaire to test compare pre and post training knowledge about Rheumatic Heart Disease administered to nurse trainees.	Immediately before the training session and immediately after completion of training
Computer Based Testing	Computer based testing designed to determine positive and negative screening referrals of patients with RHD and other cardiac diseases	Immediately following training
Rapid Competency assessment	This assessment will be administered post training to nurse trainees. It is an observation- based assessment designed to assess correct use of the technology, basic image acquisition proficiency, diagnostic accuracy and image quality.	Immediately following training
Provider satisfaction	Surveys questions on training and screening experience along with guided discussions on the training and screening experiences will be administered to nurse trainees	Immediately post training
Longitudinal Image Quality	Expert Echocardiographers will access each image acquired by nurses using the ACEP scale. A scale of 1-5 (1) being no recognizable structure and (5) being excellent image quality of all structures. A score of 3 and above will be considered diagnostic.	Daily assessment for 1 month
Provider confidence	Nurses will subjectively report their level of confidence regarding image quality. The levels of confidence will be assessed. (1) Very confident, image quality is good and adequate for diagnosis. (2) Fairly confident, image is good but confirmation of diagnosis by expert trainer needed, (3) Not confident, image quality not adequate.	Daily assessment for 1 month
Diagnostic performance for other common categories of cardiac diseases	Assess nurse's ability to accurately identify left ventricular dysfunction and pericardial effusion as compared to the same standard applied by an expert.	Through completion of screening phase, average of 1 month
Time to certification	Determine the time from the first day of training to certification for participants including remediation time.	Trough first day of training to study completion, average of 1 year

Collaborators and Investigators

• Sponsor: Children's Hospital Medical Center, Cincinnati
• Collaborators: Uganda Heart Institute
• Investigators: Principal Investigator: Andrea Z Beaton, Children's Hospital Medical Center, Cincinnati

Study record dates

Study Major Dates

• Study Start (Actual): January 3, 2023
• Primary Completion (Actual): December 20, 2023
• Study Completion (Actual): December 20, 2023

Study Registration Dates

• First Submitted: October 26, 2022
• First Submitted That Met QC Criteria: December 19, 2022
• First Posted (Actual): December 30, 2022

Study Record Updates

• Last Update Posted (Estimated): February 6, 2024
• Last Update Submitted That Met QC Criteria: February 5, 2024
• Last Verified: February 1, 2024

More Information

Terms related to this study

• Additional Relevant MeSH Terms: Cardiovascular Diseases; Infections; Musculoskeletal Diseases; Connective Tissue Diseases; Bacterial Infections; Bacterial Infections and Mycoses; Streptococcal Infections; Gram-Positive Bacterial Infections; Rheumatic Fever; Heart Diseases; Rheumatic Diseases; Rheumatic Heart Disease
• Other Study ID Numbers: 2022-0312

Plan for Individual participant data (IPD)

• Plan to Share Individual Participant Data (IPD)?: NO

Drug and device information, study documents

• Studies a U.S. FDA-regulated drug product: No
• Studies a U.S. FDA-regulated device product: No