- ICH GCP
- US Clinical Trials Registry
- Clinical Trial NCT07428941
Evaluating an Artificial Intelligence Tool to Help Primary Care Doctors Diagnose Skin Conditions. (LegitHealth PH)
A Multi-Reader Multi-Case (MRMC) Study Assessing the Impact of Legit.Health Plus on the Diagnostic Accuracy and Referral Decision-Making of Primary Care Physicians for Skin Lesions.
This study aims to determine if an artificial intelligence (AI) medical device can help primary care doctors more accurately identify and manage various skin conditions. Skin issues are a frequent reason for doctor visits, but differences in expertise between general practitioners and specialists can sometimes lead to misdiagnoses or unnecessary referrals.
The researchers hypothesized that the information provided by the AI device would increase the true diagnostic accuracy of primary care practitioners for multiple dermatological conditions. To test this, the study followed a prospective, self-controlled design where each participating doctor served as their own comparison.
During the study, 9 primary care physicians evaluated 30 clinical images representing a variety of skin pathologies. For each image, the doctors followed a two-step process:
- First, they provided a diagnosis based only on the image and the patient's medical history.
- Second, they were shown the AI's analysis-including the top 5 suggested diagnoses and confidence levels-and asked to provide a final diagnosis.
The study also investigated if the AI could help doctors decide whether a patient truly needs a referral to a specialist or if the condition could be handled remotely via teledermatology. The primary question was whether using this AI support would significantly increase the number of correct diagnoses made by primary care doctors and lead to more efficient patient care.
Study Overview
Status
Conditions
Intervention / Treatment
Detailed Description
This detailed description outlines the clinical methodology, technical framework, and data integrity protocols utilized in the investigation of the Legit Health Plus medical device for skin pathologies in primary care.
Study Design and Technical Methodology The research was conducted as a prospective observational and cross-sectional self-controlled study. It utilized a Multi-Reader Multi-Case (MRMC) framework to measure the impact of Computer-Aided Diagnosis (CAD) on clinician performance.
- Self-Controlled Framework: Each primary care practitioner (PCP) served as their own comparator, providing diagnoses first without and then with device support.
- Sequential Evaluation Workflow: Participants accessed a secure web-based platform to review 30 clinical cases. For each case, doctors provided an initial diagnosis based on an image and medical history, followed by a final diagnosis after reviewing the AI's top 5 suggested ICD-11 categories and confidence levels.
- Clinical Decision Support: The study also evaluated clinician decisions regarding dermatology referrals and the feasibility of remote management (teledermatology) based on AI-provided data, such as malignancy indices.
- Case Distribution: The 30 clinical images represented nine different conditions, including Melanoma, Basal Cell Carcinoma, Psoriasis, and Hidradenitis Suppurativa, all previously confirmed by dermatologists and anatomical pathology.
Quality Assurance and Data Management
To ensure the scientific integrity of the clinical investigation, the following quality and monitoring protocols were implemented:
- Centralized Case Report Forms (CRF): All data were collected via a secure web platform where entries were time-stamped and stored in a central database.
- Data Validation and Checks: Validation rules were applied using computer filters to automatically identify missing values or logical inconsistencies. This was supplemented by manual editing and exploratory statistical techniques to detect errors.
- Monitoring Plan: An independent clinical monitor oversaw the investigation. Monitoring included remote video or telephone meetings every three months to ensure compliance with the Clinical Investigation Plan (CIP) and ISO 14155:2020.
- Bias Minimization: Random selection of practitioners helped ensure that outcomes were not influenced by pre-existing group characteristics. Standardized protocols ensured all participants were evaluated under identical conditions.
Study Type
Enrollment (Actual)
Contacts and Locations
Study Locations
-
-
Basque Country
-
Bilbao, Basque Country, Spain, 48001
- AI Labs Group S.L.
-
-
Participation Criteria
Eligibility Criteria
Ages Eligible for Study
- Adult
- Older Adult
Accepts Healthy Volunteers
Sampling Method
Study Population
The study population consists of board-certified healthcare professionals recruited from the clinical fields of general medicine. The participant group includes:
- Primary Care Practitioners: General practitioners who often serve as the first point of contact for patients with dermatological symptoms.
- Experience Level: The cohort includes practitioners with at least 5 years of clinical experience in their respective specialities.
Participants were recruited to engage in a remote, web-based evaluation environment rather than being selected from a single physical hospital or town. The clinical images evaluated as part of the study "cases" were sourced from international public dermatology atlases and existing research databases from the sponsor, representing a diverse global patient population.
Description
Inclusion Criteria:
- Board-certified primary care physicians regardless of their professional experience.
- High-quality images of patients with different skin conditions.
Exclusion Criteria:
- Low-quality images of patients which can not be properly analyzed.
Study Plan
How is the study designed?
Design Details
Cohorts and Interventions
Group / Cohort |
Intervention / Treatment |
|---|---|
|
Primary Care Physicians
This group is composed of board-certified healthcare professionals (HCPs) who serve as the "readers" in this multi-reader multi-case (MRMC) study. The cohort is uniquely characterized by its internal comparison: each participant acts as their own control.
|
The intervention consists of a Computer-Aided Diagnosis (CAD) software-only medical device that utilizes computer vision algorithms to analyze digital images of skin structures.
During the study, healthcare professionals use the tool as a diagnostic support system to assist in the evaluation of complex dermatological conditions.
|
What is the study measuring?
Primary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
Diagnostic Accuracy for Multiple Dermatological Conditions with and without Artificial Intelligence Support.
Time Frame: Day 1
|
This measure evaluates the "Top-1" diagnostic accuracy of primary care practitioners (PCPs).
Accuracy is determined by comparing the clinician's identified diagnosis-both before and after receiving the AI's top 5 suggestions-against a confirmed reference standard (confirmed by dermatologists or anatomical pathology).
|
Day 1
|
Secondary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
|---|---|---|
|
Change in Dermatology Referral Rate Assisted by Artificial Intelligence.
Time Frame: Day 1
|
This outcome validates the percentage of cases that practitioners determine should be referred to a dermatology specialist after reviewing the AI-provided information, including malignancy indices and tool recommendations.
The goal is to evaluate if the device helps optimize resource allocation by reducing unnecessary referrals
|
Day 1
|
|
Percentage of Cases Deemed Manageable via Remote Consultation.
Time Frame: Day 1
|
This measure assesses the practitioners' evaluation of whether a case can be confirmed and treated remotely through teledermatology based on the AI analysis.
A Pearson's chi-squared test is used to analyze the association between referral necessity and remote consultation feasibility.
|
Day 1
|
Collaborators and Investigators
Sponsor
Collaborators
Investigators
- Principal Investigator: Antonio Martorell, PhD, Hospital Universitari de Manises
Study record dates
Study Major Dates
Study Start (Actual)
Primary Completion (Actual)
Study Completion (Actual)
Study Registration Dates
First Submitted
First Submitted That Met QC Criteria
First Posted (Actual)
Study Record Updates
Last Update Posted (Actual)
Last Update Submitted That Met QC Criteria
Last Verified
More Information
Terms related to this study
Keywords
Additional Relevant MeSH Terms
- Neoplasms by Site
- Neoplasms
- Immune System Diseases
- Infections
- Neoplasms by Histologic Type
- Hypersensitivity, Immediate
- Hypersensitivity
- Neoplasms, Glandular and Epithelial
- Carcinoma
- Precancerous Conditions
- Neuroectodermal Tumors
- Neoplasms, Germ Cell and Embryonal
- Neoplasms, Nerve Tissue
- Bacterial Infections
- Bacterial Infections and Mycoses
- Skin Diseases, Vascular
- Sweat Gland Diseases
- Skin Diseases, Bacterial
- Skin Diseases, Infectious
- Suppuration
- Neuroendocrine Tumors
- Nevi and Melanomas
- Skin Neoplasms
- Keratosis
- Neoplasms, Basal Cell
- Nevus
- Hidradenitis
- Skin and Connective Tissue Diseases
- Hidradenitis Suppurativa
- Melanoma
- Skin Diseases
- Carcinoma, Basal Cell
- Keratosis, Actinic
- Urticaria
- Nevus, Pigmented
Other Study ID Numbers
- Legit.Health_PH_2024
- EUPAS1000000644 (Other Identifier: European Medicines Agency)
Plan for Individual participant data (IPD)
Plan to Share Individual Participant Data (IPD)?
Drug and device information, study documents
Studies a U.S. FDA-regulated drug product
Studies a U.S. FDA-regulated device product
This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.
Clinical Trials on Plaque Psoriasis
-
Usynova Pharmaceuticals Ltd.RecruitingPlaque Psoriasis | Moderate to Severe Plaque PsoriasisChina
-
Qilu Pharmaceutical Co., Ltd.Not yet recruitingPlaque Psoriasis
-
Xiangya Hospital of Central South UniversityNot yet recruiting
-
Hangzhou Zhongmei Huadong Pharmaceutical Co., Ltd.MC2 TherapeuticsRecruiting
-
Beijing InnoCare Pharma Tech Co., Ltd.Recruiting
-
Haisco Pharmaceutical Group Co., Ltd.Not yet recruiting
-
Sun Pharmaceutical Industries, Inc.CompletedPlaque PsoriasisUnited States
-
UCB Biopharma SRLActive, not recruitingModerate Chronic Plaque Psoriasis | Severe Chronic Plaque Psoriasis | Mixed Guttate/Plaque PsoriasisUnited States, Canada, Puerto Rico
-
Oruka Therapeutics, Inc.RecruitingPlaque PsoriasisUnited States, Canada
-
Oruka Therapeutics, Inc.RecruitingPlaque PsoriasisUnited States, Canada
Clinical Trials on AI-based medical device for aided diagnosis in dermatological conditions
-
AI Labs Group S.LCompletedPlaque Psoriasis | Seborrheic Dermatitis | Palmoplantar Pustulosis | Acne | Impetigo | Hidradenitis Suppurativa (HS) | Generalized Pustular Psoriasis (GPP) | Tinea Corporis | Acute Generalized Exanthematous Pustulosis | Pustular Psoriasis (PP) | Acne Conglobata | Eczema Atopic Dermatitis | Seborrheic Keratoses | Pemphigus...Spain
-
AI Labs Group S.LCompletedPsoriasis | Dermatitis | Nevus | Tinea | Alopecia | Urticaria | Acne | Herpes | Melanoma (Skin Cancer) | Granuloma Annulare | Onychomychosis | Seborrheic Keratoses | Pressure Ulcer (PU)Spain
-
AI Labs Group S.LHospital de Basurto; Osakidetza; Hospital de Cruces; Servicio Vasco de Salud Osakidetza...CompletedMelanoma | Melanoma, SkinSpain
-
Mayo ClinicCompletedMalignant Solid Neoplasm | Hematopoietic and Lymphoid System Neoplasm | Obesity-Related Malignant NeoplasmUnited States