NLP-Based Feedback to Improve Risk Comms and Informed Shared Decision Making

July 29, 2025 updated by: Timothy J. Daskivich, Cedars-Sinai Medical Center

Natural Language Processing-Based Feedback to Improve Physician Risk Communication and Informed Shared Decision Making in Men With Clinically Localized Prostate Cancer

In this pilot study, the investigators will show feasibility of the NLP-based feedback system in 20 consultations of men with newly diagnosed prostate cancer. The investigators will recruit from the practices of up to 10 physicians who typically see these patients. The investigators will report the top five sentences from each consultation across key content areas (cancer prognosis, life expectancy, erectile dysfunction, urinary incontinence, and irritative urinary symptoms) to both patients and physicians within 2 weeks of the consultation.

Study Overview

Status

Recruiting

Conditions

Intervention / Treatment

Detailed Description

The primary research procedures are:

  1. Audio recording and transcribing treatment counseling discussions for 20 men with newly diagnosed clinically localized prostate cancers and utilize NLP to extract key content using the system described above.
  2. Reports including the top five sentences by NLP probability for key content areas will be generated and will be provided to patients and providers within 2 weeks after each case.
  3. For patients, decisional conflict and risk perception will be assessed before and after receiving the NLP-based feedback.
  4. For physicians, the investigators will assess baseline quality of risk communication, any changes in individual physician communication over time, and accuracy of risk estimates for key content areas.
  5. Within 2 weeks of receiving the NLP-based feedback, the investigators will conduct a 30-minute semi-structured interview with patients to obtain their opinions on the utility and ideal implementation strategy for the NLP-based feedback.
  6. At the conclusion of the pilot trial, the investigators will conduct 30-minute semi-structured interview with counseling physicians to obtain their opinions on the utility and ideal implementation strategy for the NLP-based feedback.

Study Type

Interventional

Enrollment (Estimated)

30

Phase

  • Not Applicable

Contacts and Locations

This section provides the contact details for those conducting the study, and information on where this study is being conducted.

Study Contact

Study Contact Backup

Study Locations

    • California
      • Los Angeles, California, United States, 90048
        • Recruiting
        • Cedars-Sinai Medical Center
        • Principal Investigator:
          • Timothy Daskivich, MD
        • Contact:
        • Contact:

Participation Criteria

Researchers look for people who fit a certain description, called eligibility criteria. Some examples of these criteria are a person's general health condition or prior treatments.

Eligibility Criteria

Ages Eligible for Study

  • Adult
  • Older Adult

Accepts Healthy Volunteers

No

Description

Inclusion Criteria:

  1. Men undergoing initial treatment consultation for clinically localized prostate cancer;
  2. Men with upgraded prostate cancer on active surveillance considering conversion to definitive local therapy.
  3. Cedars-Sinai patient.
  4. Ability to read and write in English.

Exclusion Criteria:

  1. Under 18 years of age;
  2. Subjects with difficulty communicating or dementia;
  3. Non-English speakers, given that our NLP-based tools cannot be used with languages other than English;
  4. Men with locally advanced or metastatic prostate cancer;
  5. Men who have already been treated for clinically localized prostate cancer

Study Plan

This section provides details of the study plan, including how the study is designed and what the study is measuring.

How is the study designed?

Design Details

  • Primary Purpose: Health Services Research
  • Allocation: N/A
  • Interventional Model: Single Group Assignment
  • Masking: None (Open Label)

Arms and Interventions

Participant Group / Arm
Intervention / Treatment
Experimental: NLP Intervention Experimental Arm
20 men with newly diagnosed clinically localized prostate cancers and utilize NLP to extract key content using the top five sentences by NLP probability for key content areas will be generated and will be provided to patients and providers within 2 weeks after each case.
Audio recordings will be made using either digital recorders or telehealth platform-generated transcripts. Patient reports will include only the extracted sentences related to content areas. Physician reports will note the extracted statements across each content area, the quality scores for individual statements based on the pre-specified hierarchy, the statements that achieved the highest score across each content area, and feedback on what could be improved. For patients, decisional conflict and risk perception will be assessed before and after receiving the NLP-based feedback. For physicians, the investigators will assess baseline quality of risk communication by pre-specified hierarchy, any changes in individual physician communication over time, and accuracy of risk estimates for key content areas.

What is the study measuring?

Primary Outcome Measures

Outcome Measure
Measure Description
Time Frame
Change in Decisional Conflict Scale Scores before and after intervention (patient-level outcome)
Time Frame: Measured directly after treatment consultation and after NLP-based feedback given to patients within 2 weeks of consultation
The investigators will employ the validated Decisional Conflict Scale (DCS), to estimate uncertainty associated with treatment choice. Effect sizes of 0.3 to 0.4 are considered meaningful. Variability (standard deviation) in DCS scores before and after receiving NLP-based feedback will be assessed and used in planning a larger trial.
Measured directly after treatment consultation and after NLP-based feedback given to patients within 2 weeks of consultation
Change in risk perception before and after intervention (patient-level outcome)
Time Frame: Measured directly after treatment consultation and after NLP -based feedback given to patients within 2 weeks of consultation
The investigators will evaluate concordance of cancer risk perception with actual cancer risk at the patient level before and after the intervention. Cancer risk perception will be assessed by multiple-choice questions. Concordance of patient answers with actual cancer risk as estimated by outcomes of the SPCG-4 randomized trial comparing surgery versus watchful waiting at the patient's PCCI-predicted life expectancy will be assessed as a binary outcome. Risk perception will be assessed before and after their consultation. Variability (standard deviation) in risk perception scores before and after receiving NLP-based feedback will be assessed and used in planning a larger trial.
Measured directly after treatment consultation and after NLP -based feedback given to patients within 2 weeks of consultation
Physician attitudes regarding integration of NLP-based information (physician-level outcome)
Time Frame: Interviews will be conducted within 2 weeks of the intervention.
30-minute semi-structured interviews with counseling physicians will be conducted within 2 weeks of the intervention to obtain their opinions on the utility and ideal implementation strategy for the NLP-based feedback.
Interviews will be conducted within 2 weeks of the intervention.
Difference between reported risk of side effects and prognosis with gold standard (physician-level outcome)
Time Frame: Data will be captured during the treatment consultation-for the duration of the study up to 1 year
The difference in reported risk estimates given by physicians during the consultation as compared with the gold standards for these risks (i.e. for side effects, estimates from the CAESAR study; for cancer risk with and without treatment, risks of cancer mortality in the WW group of SPCG-4 trial at the patient's life expectancy as determined by the prostate cancer comorbidity index). Variability (standard deviation) in accuracy of estimates will be assessed and used in planning a larger trial. Accuracy of estimates for the interventional period will be compared with physician-specific historical references from a previously conducted trial using the standard of care (i.e. no NLP-based intervention).
Data will be captured during the treatment consultation-for the duration of the study up to 1 year
Quality of composite physician risk communication score in treatment consultation (physician-level outcome)
Time Frame: Data will be captured during the treatment consultation, for duration of the study up to 1 year
Quality of risk communication scores will be calculated by qualitatively analyzing treatment consultation transcripts to assess the highest quality of communication used to transmit information regarding all key tradeoffs (cancer prognosis, life expectancy, erectile dysfunction, urinary incontinence, and irritative urinary symptoms). The quality of risk communication scale ranges from 0 to 5 for each outcome, with 0 representing the lowest score and 5 representing the highest score (Daskivich et al, J Urol 2022; Naser-Tavakolian et al, J Urol 2022). Scores for all key tradeoffs will be averaged to yield a composite quality of risk communication score. Variability (standard deviation) in quality scores will be assessed and used in planning a larger trial.
Data will be captured during the treatment consultation, for duration of the study up to 1 year
Patient attitudes regarding integration of NLP-based information
Time Frame: within 4 weeks of patients using NLP system.
30-minute semi-structured interviews with patients will be conducted at the conclusion of the study period to obtain their opinions on the utility and ideal implementation strategy for the NLP-based feedback
within 4 weeks of patients using NLP system.

Collaborators and Investigators

This is where you will find people and organizations involved with this study.

Investigators

  • Principal Investigator: Timothy Daskivich, Cedars-Sinai Medical Center

Study record dates

These dates track the progress of study record and summary results submissions to ClinicalTrials.gov. Study records and reported results are reviewed by the National Library of Medicine (NLM) to make sure they meet specific quality control standards before being posted on the public website.

Study Major Dates

Study Start (Actual)

November 15, 2023

Primary Completion (Estimated)

July 15, 2026

Study Completion (Estimated)

July 15, 2026

Study Registration Dates

First Submitted

May 24, 2023

First Submitted That Met QC Criteria

June 27, 2023

First Posted (Actual)

June 28, 2023

Study Record Updates

Last Update Posted (Actual)

August 1, 2025

Last Update Submitted That Met QC Criteria

July 29, 2025

Last Verified

July 1, 2025

More Information

Terms related to this study

Plan for Individual participant data (IPD)

Plan to Share Individual Participant Data (IPD)?

NO

Drug and device information, study documents

Studies a U.S. FDA-regulated drug product

No

Studies a U.S. FDA-regulated device product

No

This information was retrieved directly from the website clinicaltrials.gov without any changes. If you have any requests to change, remove or update your study details, please contact register@clinicaltrials.gov. As soon as a change is implemented on clinicaltrials.gov, this will be updated automatically on our website as well.

Clinical Trials on Prostate Cancer

Clinical Trials on NLP-based Feedback

Subscribe