AI Augmented Training for Skin Specialists (AISC-SS)

Artificial Intelligence Augmented Training in Skin Cancer Diagnostics for Skin Cancer Specialists

Background:

The worldwide incidence of skin cancer has been rising for 50 years, in particular the incidence of malignant melanoma has increased approx. 2-7% annually and is the most common cancer amongst Danes aged 15-34. Currently there is a significant amount of misdiagnosis of skin cancer and mole cancer, and most excised skin lesions are benign.

Previous studies have shown that there is no significant increase in doctors diagnostic accuracy during the first 6 years of clinical work.

The resources spend on healthy people could be put to better use, if the Benign-Malignant Ratio could be lowered. This could potentially be done by better educating the doctors during their everyday clinical practice.

Aim:

The aim of this study is to investigate the dose/response effect of an AI augmented training and clinical feedback on the diagnostic accuracy of skin cancer and clinical decisions among doctors from specialized skin cancer centers.

Research question: How much specialized doctors need to train before their diagnostic accuracy and clinical decisions change?

Study Overview

• Status: Completed
• Conditions: Melanoma; Skin Cancer
• Intervention / Treatment: Other: DermLoop Learn

Detailed Description

Design:

This study is a superiority trial designed as an international multicenter randomized controlled trial of doctors in highly specialized centers that diagnose and/or treat skin- and mole cancer.

Randomization Eligible participants will be randomized into either the intervention or control group, ratio 1:1.

Intervention:

The participants of group A are given access to a digital educational online system developed by the research group, are asked to register all skin lesions seen with a registration app (clinical and dermoscopic photos and clinical data), also developed by the research group, and will be given clinical feedback on every registered skin lesion.

Participants in group B are also asked from day one to register all skin lesions and will receive feedback on these as the participants of group A, but are withheld their access to the digital educational online system for 2 months.

Feedback on removed/biopsied skin lesions is given directly from the pathologist, who in turn are given easy access to photographs and clinical data of the patient and skin lesion in question.

Statistics:

The average increase in diagnostic accuracy for the population of participating doctors as an effect of the hours spent with the digital educational online system is calculated using Generalized Estimating Equations (GEE).

As benign lesions can be excised/treated for other reasons than suspicion of malignancy we will analyze correctly diagnosed benign lesions treated for different reasons (cosmetic or functional complaints etc.) separately.

We expect a majority of registered lesions to be benign, despite most of the patients already having been seen by GPs before referral.

Ethical considerations:

Patient participation contains no immediate strain or discomfort for the patient, and no change to current clinical practice, as dermoscopic evaluation is part of the clinical examination of skin lesions. The images captured are stored safely and anonymously with no risk for the patient.

With the current low diagnostic accuracy of young doctors the educational nature of the intervention justifies the study for the sake of all future patients with skin lesions that are less likely to be misdiagnosed.

Educational interventions on doctors do not require approval by The National Committee on Health Research Ethics in Denmark. However ethical considerations have been made and the project is in concordance with the Helsinki Declaration II.

• Study Type: Interventional
• Enrollment (Actual): 1500
• Phase: Not Applicable

Contacts and Locations

Study Locations

• Denmark
  • Copenhagen, Denmark, 2730
    • Herlev Hospital
  • Copenhagen, Denmark, 2900
    • Gentofte Hospital

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: Child; Adult; Older Adult
• Accepts Healthy Volunteers: Yes

Description

Inclusion Criteria:

• Doctors are required to work at a specialized skin department (dermatology or plastic surgery or the like).
• Doctors must be registered authorized health personnel

Exclusion Criteria:

• Doctors that have previously received access to the DermLoop Learn educational intervention
• Doctors with less than 2 months left of their affiliation with their current department of employment

Study Plan

How is the study designed?

Design Details

• Primary Purpose: Diagnostic
• Allocation: Randomized
• Interventional Model: Parallel Assignment
• Masking: Single

Number of Arms

2

Arms and Interventions

Participant Group / Arm	Intervention / Treatment
Other: Group A; This group will receive access to the AI augmented digital online educational system and its two modules (Training Module and Clinical Feedback Module). They will receive continuous clinical feedback on their registered lesions.	Other: DermLoop Learn; DermLoop Learn is our AI augmented digital online educational system with case training on a library of 10,000+ benign and malignant skin lesion as well as written learning modules for the most common skin lesion diagnosis.
No Intervention: Group B; This group is withheld their access to the AI augmented digital online educational system for 2 months. After the 2 months delay, the subjects in the group are given the same access as the participants in Group A.

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Dose/Response	Dose/response between hours spent with the education system and change in diagnostic accuracy for the participating doctors	2 years

Secondary Outcome Measures

Outcome Measure	Measure Description	Time Frame
BMR	Difference in Benign to Malignant ratio (BMR) in treated/referred/sent home lesions suspected of skin cancer.	2 years
Multiple-Choice-Questionnaire predictability of diagnostic accuracy	Correlation between diagnostic accuracy and score measured on the MCQ at baseline and at 0 and 2 months.	2 months
Referrals	Change in the amount of referrals between the control and intervention group of the departments of dermatology to the departments of plastic surgery in the time before and after the intervention.	2 years

Collaborators and Investigators

• Sponsor: Herlev Hospital
• Investigators: Principal Investigator: Gustav G Nervil, MD, Herlev Hospital

Study record dates

Study Major Dates

• Study Start (Actual): September 15, 2021
• Primary Completion (Actual): April 30, 2024
• Study Completion (Actual): April 30, 2024

Study Registration Dates

• First Submitted: February 12, 2021
• First Submitted That Met QC Criteria: February 13, 2021
• First Posted (Actual): February 17, 2021

Study Record Updates

• Last Update Posted (Actual): October 16, 2024
• Last Update Submitted That Met QC Criteria: October 14, 2024
• Last Verified: October 1, 2024

More Information

Terms related to this study

• Keywords: Skin Cancer; Melanoma; Artificial Intelligence; Education; Diagnostic Accuracy; Feedback loop
• Additional Relevant MeSH Terms: Skin Diseases; Neoplasms by Histologic Type; Neoplasms; Neoplasms by Site; Neuroectodermal Tumors; Neoplasms, Germ Cell and Embryonal; Neoplasms, Nerve Tissue; Neuroendocrine Tumors; Nevi and Melanomas; Melanoma; Skin Neoplasms
• Other Study ID Numbers: AISC-SS

Drug and device information, study documents

• Studies a U.S. FDA-regulated drug product: No
• Studies a U.S. FDA-regulated device product: No
• product manufactured in and exported from the U.S.: No