- ICH GCP
- US Clinical Trials Registry
- Clinical Trial NCT06040723
Hill-grade Knowledge Via Integrated Neural-network for Gastroscopy (HillKING)
Real Time Determination of the Hill Grade During Gastroscopy Using Artificial Intelligence
Study Overview
Detailed Description
Objective:
The primary goal of this study is to compare the accuracy in determining the Hill classification during gastroscopy between an artificial intelligence (AI) based system and physicians performing the examination. Secondary outcomes include evaluation of the per-class accuracy and other statistical measures such as precision, recall and f1 score.
Study Design:
Single center, endoscopist blinded study. The model considered in a previous study achieved a mean accuracy of 88%. All participants initially attended a lecture serving as a refresher regarding the Hill classification. Subsequently, physicians were asked to provide the Hill classification for test images expert annotated images depicting different Hill grades, achieving mean accuracy of 72%. Thus 127 paired measurements are required. Taking patient drop-out into consideration, at least 159 patients need to be recruited. Upon examination of the flap-valve during endoscopy, the physician is required to store an image of the flap-valve during retroflexion, which is part of the standard procedure, based on which they determine the Hill classification. The prediction of the AI model on this image is considered the model output and is considered the model's output. A group of three expert endoscopists determines the Hill classification for each image, based on majority vote, which is treated as the gold standard.
AI setup and limitations:
There are no limitations caused by the AI. The method performs a frame-by-frame analysis of the recording. These images are parsed from the AI based system in order to obtain predictions. The only interactions required with the method is a button press that initiates the examination recording process and a second button press to terminate the recording. This is performed at the beginning and end of the examination respectively. The model used in this study is an updated version of the model reported in a preliminary study, that has been trained with more data together with an auxiliary output for predicting if the Hill classification is relevant to the shown image.
Study population:
All adult patients appointed for gastroscopy that do not match the exclusion criteria will be asked for informed consent. Exclusion criteria include previous surgical interventions or altered anatomy that prevents the proper examination of the flap valve, examinations where the flap-valve is not inspected, and examinations where the expert committee does not produce a majority vote.
Intervention:
The physician performs the examination as usual. Upon inspection of the flap valve, the physician captures an image of the examination, as usual, and gives their assessment of the Hill grade. The output of the model for the same image is considered the model prediction. The physician is blinded to the model's prediction.
Study Type
Enrollment (Actual)
Contacts and Locations
Study Locations
-
-
Bayern
-
Würzburg, Bayern, Germany, 97080
- Universitatsklinikum Wurzburg
-
-
Participation Criteria
Eligibility Criteria
Ages Eligible for Study
- Adult
- Older Adult
Accepts Healthy Volunteers
Sampling Method
Study Population
Description
Inclusion Criteria:
- Adult patients (>18 years)
- Scheduled gastroscopy
Exclusion Criteria:
Examination level
- Previous surgical interventions or altered anatomy that prevents the proper examination of the flap valve
- Flap-valve not inspected
Data Level:
- Image during flap-valve inspection not stored
- Expert committee not resulting in a majority vote
Study Plan
How is the study designed?
Design Details
Cohorts and Interventions
Group / Cohort |
Intervention / Treatment |
---|---|
Experimental: Intervention arm
All patients within the study are included in the intervention arm: The Hill classification is determined by the physician and the AI method.
|
The EndoMind system is equipped with an AI model for predicting the Hill grade during gastroscopy.
|
What is the study measuring?
Primary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
---|---|---|
Accuracy of assessments for the Hill classification for physicians and AI method.
Time Frame: Through study completion, an average of 5 months
|
Binary assessment of physician vs AI correct and erroneous predictions.
|
Through study completion, an average of 5 months
|
Secondary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
---|---|---|
Accuracy of assessments for each Hill grade for physicians and AI method.
Time Frame: Through study completion, an average of 5 months
|
Description: The correct and erroneous predictions for each specific Hill class.
|
Through study completion, an average of 5 months
|
Precision and recall of the assessments for each Hill from endoscopists and AI method.
Time Frame: Through study completion, an average of 5 months
|
The precision, and recall statistics for each class (1v0) over the four different Hill classes.
|
Through study completion, an average of 5 months
|
Distance for label assessment from gold standard label.
Time Frame: Through study completion, an average of 5 months
|
Comparison of the distance between the gold standard label and the label assigned by the physician and AI method.
|
Through study completion, an average of 5 months
|
Collaborators and Investigators
Sponsor
Study record dates
Study Major Dates
Study Start (Actual)
Primary Completion (Actual)
Study Completion (Actual)
Study Registration Dates
First Submitted
First Submitted That Met QC Criteria
First Posted (Actual)
Study Record Updates
Last Update Posted (Actual)
Last Update Submitted That Met QC Criteria
Last Verified
More Information
Terms related to this study
Additional Relevant MeSH Terms
Other Study ID Numbers
- AI04
Plan for Individual participant data (IPD)
Plan to Share Individual Participant Data (IPD)?
Drug and device information, study documents
Studies a U.S. FDA-regulated drug product
Studies a U.S. FDA-regulated device product
This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.
Clinical Trials on Gastroesophageal Hernia
-
University of BolognaCompletedParaesophageal Hernia | Gastroesophageal Reflux Disease With Hiatal HerniaItaly
-
University of NebraskaLifeCellCompletedHiatal Hernia | Gastroesophageal Reflux Disease | Paraesophageal HerniaUnited States
-
University of Southern CaliforniaEnrolling by invitationHiatal Hernia Large | Reflux, GastroesophagealUnited States
-
Children's Mercy Hospital Kansas CityUniversity of Alabama at BirminghamCompletedHiatal Hernia | Gastroesophageal Reflux DiseaseUnited States
-
Grubnik VolodymyrCompletedHiatal Hernia | Gastroesophageal Reflux Disease
-
EndoGastric SolutionsCompletedHiatal Hernia | Gastroesophageal Reflux DiseaseUnited States
-
University of BolognaThe European Society of EsophagologyCompletedHiatal Hernia | Gastroesophageal Reflux DiseaseItaly
-
Foregut Research FoundationRecruitingHiatal Hernia Large | Gastro Esophageal Reflux | Hiatal Hernia | Hiatal Hernia, Paraesophageal | Reflux, Gastroesophageal | Reflux AcidUnited States
-
The Heartburn FoundationActive, not recruitingHiatal Hernia | Gastroesophageal Reflux DiseaseUnited States
-
Miromatrix Medical Inc.CompletedGastroesophageal Reflux | GERD | Hiatal Hernia With Gastroesophageal Reflux DiseaseUnited States
Clinical Trials on EndoMind
-
Wuerzburg University HospitalKlinikum StuttgartCompletedArtificial Intelligence | Polyps of Colon | Surveillance Endoscopy for Colorectal Cancer | CADeGermany
-
Wuerzburg University HospitalRecruiting
-
Wuerzburg University HospitalRecruitingColorectal Adenoma | Colorectal PolypGermany