- ICH GCP
- US Clinical Trials Registry
- Clinical Trial NCT04877535
Pilot Study for Postoperative Machine Learning
A Pilot Study for the Effect of Risk Prediction on Anticipatory Guidance and Team Coordination for Postoperative Care
Study Overview
Status
Conditions
Intervention / Treatment
Detailed Description
Although surgery and anesthesia have become much safer on average, many patients still experience complications after surgery. Some of these complications are likely to be avoided or less severe with early detection and treatment. Barnes-Jewish Hospital has recently started using an Anesthesia Control Tower (ACT), which is a remote group lead by an anesthesiologist who reviews live data from BJH operating rooms and calls the anesthesia provider with concerns to improve reaction times and improve use of best-practices treatments. The ACT also uses machine learning (ML) to calculate patient risks during surgery as a way of measuring when the patient is doing better or worse.
The study team suspects that two mechanisms may allow risk prediction to improve postoperative care. First, is that it may make some data more actionable to clinicians. Although intraoperative data is extremely rich with many monitors, drug-response events, and surgical stress reactions to reveal the physiolgical state of the patient, that data is also extremely specialized and difficult to access. The study team thinks that many times the right interpretation of intraoperative data or the right treatment to give isn't clear until the surgery is nearly finished. The medical team in the recovery room (post-anesthesia care unit, PACU) and surgical wards is responsible for deciding the treatment strategy, but they don't have access to the information from the intraoperative monitors and events. Those providers also lack the familiarity to directly interpret that information and time to review it in detail. Even preoperative information may be less than fully available because the patient may still be too sedated or confused from the anesthesia to explain much about their history. By summarizing these diverse sources of information into a risk profile, machine learning outputs may directly improve the understanding of postoperative providers or improve the identification of patients at elevated risk for postoperative adverse outcomes.
A second mechanism derives from behavior changes which may occur in providers in reaction to machine-generated risk profiles. The study team has observed many handoffs from the operating room and PACU include lists of "important" data, but it is common for the handoff-giver to provide no interpretation (what problem is this information related to) or anticipatory guidance (having identified a potential or actual problem, what should the handoff receiver do). The study team has also observed than once a major risk has been clearly identified along the chain of handoff it tends to be propagated forward with connection to the underlying data, any changes noticed by the current provider, and the current plan. The study team suspects that in the subset of patients with substantially elevated predictions on their risk profile, handoff communication and team coordination for the identified problems may improve.
The larger goal is to deploy a "report card" for each patient that summarizes the preoperative assessment and intraoperative data in a way that is useful for postoperative providers. In this study these ML reports will be integrated into the clinical workflow and determine if it does affect handoff behavior. The study team will also evaluate the information-effect and test the report card for safety by determining if clinicians identify any major inaccuracies related to the implementation.
This study is a substudy of a randomized trial of ACT-intraoperative contact (TECTONICS IRB# 201903026), and only patients in the contact (treatment) group will be eligible. The screened patients will be all adults having surgery at BJH with the division of Acute and Critical Care Surgery. Exclusion criteria are a planned ICU admission. For each included patient, the ACT clinician will review the report card information, and the postoperative providers will either be directly contacted or receive an Epic Best Practices Advisory. Our study will be a before-after quasi-experiment, meaning that after a fixed date, all eligible patients will receive the intervention, and the outcome measures will be compared to patients before that date. The outcome measure we will study is handoff effectiveness from the recovery room to wards. Providers will be surveyed on information value, any inaccurate items, or major omissions.
The ML report card will not recommend specific treatments, and decisions will remain the hands of the physician in the PACU or wards. The postoperative provider will also be given information about the report card and its limitations.
Study Type
Enrollment (Estimated)
Phase
- Not Applicable
Contacts and Locations
Study Contact
- Name: Sherry L McKinnon, MS
- Phone Number: 314-286-1768
- Email: smckinnon@wustl.edu
Study Contact Backup
- Name: Christopher R King, MD, PhD
- Phone Number: 314-362-6978
- Email: christopherking@wustl.edu
Study Locations
-
-
Missouri
-
Saint Louis, Missouri, United States, 63110
- Recruiting
- Barnes-Jewish Hospital
-
Contact:
- Christopher R King, MD, PhD
- Phone Number: 314-362-6978
- Email: christopherking@wustl.edu
-
Contact:
- Sherry L McKinnon, MS
- Phone Number: 3142861768
- Email: smckinnon@wustl.edu
-
Sub-Investigator:
- Philip Payne, PhD
-
Sub-Investigator:
- Yixin Chen, PhD
-
Sub-Investigator:
- Troy S Wildes, MD
-
Sub-Investigator:
- Joanna Abraham, PhD
-
Sub-Investigator:
- Michael S Avidan, MBBCh
-
-
Participation Criteria
Eligibility Criteria
Ages Eligible for Study
Accepts Healthy Volunteers
Description
Inclusion Criteria:
ODIN-Pilot will intervene on a subset of TECTONICS participants meeting all the following criteria:
- Within the TECTONICS contact arm (adults undergoing OR procedures)
- Operating room at BJH South campus (including all of "Pod 2", "Pod 3", "Pod 5") (excluding all procedure suites such as Interventional Radiology, Parkview Tower "Pod 1", Center for Advanced Medicine "Pod 4", Labor and Delivery suites)
- Surgeon is a member of the Acute and Critical Care Surgery division or the postoperative bed is 16300 observation unit.
- Planned non-ICU disposition ("floor" and "observation unit" collectively "ward" patients).
Exclusion Criteria:
- Not enrolled in TECTONICS Study
- Randomized to the observation arm in TECTONICS study
- Planned ICU admission
Study Plan
How is the study designed?
Design Details
- Primary Purpose: Other
- Allocation: Non-Randomized
- Interventional Model: Parallel Assignment
- Masking: None (Open Label)
Arms and Interventions
Participant Group / Arm |
Intervention / Treatment |
---|---|
Experimental: Intervention
ML will be used to create a report card for each patient that summarizes the preoperative assessment and intraoperative data.
Report card data will be made available to providers through multiple methods: integration into electronic health records workflows, electronic health records notifications, mobile device notifications, and print outs in the paper chart
|
PACU and ward providers caring for participants will be notified by Anesthesia Control Tower clinicians before arrival if the patient's report card.
The notification will contain a report card of the patient's forecast risk of major adverse events, explanatory machine-learning outputs, most influential pre- and intraoperative data, and predicted treatments.The ML risk profile generated for each patient will include risk of 30 day mortality, risk of respiratory failure, risk of acute kidney injury, and risk of postoperative delirium
|
No Intervention: Pre-intervention
The standard of care.
The report card will be electronically generated (to determine eligibility) but it will not be visible to clinicians.
|
What is the study measuring?
Primary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
---|---|---|
Provider self-reported handoff effectiveness.
Time Frame: 8 hours postop
|
Providers will answer survey questions regarding the handoff
|
8 hours postop
|
Secondary Outcome Measures
Outcome Measure |
Measure Description |
Time Frame |
---|---|---|
Direct observation of handoff
Time Frame: 8 hours postop
|
A subset of 50 handoffs will be directly observed for handoff behavior using the survey instrument of (Weinger et al., 2015)
|
8 hours postop
|
Provider information value of ML report card
Time Frame: 8 hours postop
|
Providers will answer survey questions regarding the value of the report card in assessing patients including any major errors or omissions
|
8 hours postop
|
Workflow effectiveness of the interventions
Time Frame: 1 day postop
|
20-30 debriefing interviews will be conducted with ward and PACU clinicians on their perception of handoff effectiveness and the usefulness of the report card in their workflow.
|
1 day postop
|
Collaborators and Investigators
Investigators
- Principal Investigator: Christopher R King, MD, PhD, Washington Univeristy School of Medicine
Study record dates
Study Major Dates
Study Start (Actual)
Primary Completion (Estimated)
Study Completion (Estimated)
Study Registration Dates
First Submitted
First Submitted That Met QC Criteria
First Posted (Actual)
Study Record Updates
Last Update Posted (Actual)
Last Update Submitted That Met QC Criteria
Last Verified
More Information
Terms related to this study
Keywords
Other Study ID Numbers
- 202103210
- KL2TR002346 (U.S. NIH Grant/Contract)
Plan for Individual participant data (IPD)
Plan to Share Individual Participant Data (IPD)?
IPD Plan Description
Drug and device information, study documents
Studies a U.S. FDA-regulated drug product
Studies a U.S. FDA-regulated device product
product manufactured in and exported from the U.S.
This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.
Clinical Trials on Surgery--Complications
-
Duke UniversityWithdrawnSurgical Complications From Surgery | Surgical Complications From Bladder Surgery | Surgical Complications From Bowel Surgery
-
Poudre Valley Health SystemTerminatedSurgery | Surgery--ComplicationsUnited States
-
University of KwaZuluMedical Research Council, South AfricaCompletedMortality | Surgery | Surgery- ComplicationsSouth Africa, Algeria, Benin, Burundi, Cameroon, Congo, The Democratic Republic of the, Congo, Egypt, Ethiopia, Gambia, Ghana, Kenya, Libyan Arab Jamahiriya, Madagascar, Mali, Mauritius, Namibia, Nigeria, Niger, Senegal, Tanzania, Tog... and more
-
Baylor Research InstituteChiesi USA, Inc.RecruitingSurgery | Cardiac Surgery | Surgery--Complications | Percutaneous Coronary InterventionUnited States
-
Western University, CanadaNot yet recruitingSurgery | Surgery--Complications | Pulmonary Complication
-
Faiza GabaQueen Mary University of London; University of Hertfordshire; University of Aberdeen and other collaboratorsRecruitingGynecologic Cancer | Surgery | Surgery--ComplicationsUnited Kingdom
-
Hacettepe UniversityCompletedSurgery--Complications | Newborn Morbidity | Neonatal SurgeryTurkey
-
Washington University School of MedicineNational Institute of Nursing Research (NINR)CompletedSurgery | Surgery--Complications | Perioperative/Postoperative ComplicationsUnited States
-
Hospices Civils de LyonRecruitingPost-operative Complications After Colorectal Surgery | Post-operative Complications After Gastric Surgery | Post-operative Complications After Bariatric SurgeryFrance
-
Henan Cancer HospitalThe First Affiliated Hospital of Zhengzhou University; Henan Provincial People... and other collaboratorsRecruitingSurgery--ComplicationsChina
Clinical Trials on ML-based report card
-
University of PennsylvaniaCompletedUtilization | Laboratory, Hospital
-
University of PittsburghALS AssociationCompleted
-
Denver Health and Hospital AuthorityAgency for Healthcare Research and Quality (AHRQ)Completed
-
University of California, Los AngelesUCLA Health Department of MedicineActive, not recruiting
-
State University of New York at BuffaloFlorida International UniversityCompletedAttention Deficit Hyperactivity DisorderUnited States
-
University of North Carolina, Chapel HillEunice Kennedy Shriver National Institute of Child Health and Human Development... and other collaboratorsRecruitingContraceptive Usage | Unintended PregnancyKenya
-
Mayo ClinicTerminatedGastroesophageal Reflux | Hernia, Hiatal | Surveys and Questionnaires | FundoplicationUnited States
-
Florida International UniversityUniversity of South Florida; Florida State University; Nova Southeastern UniversityRecruitingAttention Deficit Hyperactivity DisorderUnited States
-
University of PennsylvaniaCompleted