Large Language Models for Stuttering Assessment and Therapy
Alignment of Large Language Model Responses on Stuttering Definition, Assessment, and Therapy With Clinical Practice Guidelines: A Multi-Model Comparison
This observational study aims to compare the quality of responses generated by four large language models (ChatGPT, Claude, Google Gemini, and Grok-4.20) to questions about stuttering. The study focuses on three main areas: general information about stuttering, clinical assessment, and therapy. A total of nine questions were developed based on evidence-based clinical practice guidance, including the American Speech-Language-Hearing Association (ASHA) Practice Portal. Each question is presented to each language model in separate sessions, and the generated responses are recorded for evaluation.
Five speech-language therapists with clinical experience in stuttering independently evaluate the model-generated responses. Each response is rated for relevance, accuracy, clarity, completeness, and consistency using a 5-point Likert scale. The responses are also compared with guideline-based reference information. The study does not involve any clinical intervention or treatment of patients. The aim is to determine how closely large language model responses align with current clinical practice guidance and to identify their potential strengths and limitations when used as informational or clinical support tools in the field of stuttering.
연구 개요
상태
상태
정황
정황
개입 / 치료
개입 / 치료
연구 유형
연구 유형
등록 (실제)
등록
연락처 및 위치
연구 장소
-
-
Istanbul
-
Istanbul, Istanbul, 터키 (Türkiye), 34310
- Istanbul Gelisim University
-
-
참여기준
자격 기준
자격 기준
공부할 수 있는 나이
건강한 자원 봉사자를 받아들입니다
연구 대상 성별
샘플링 방법
연구 인구
The study population consisted of adult speech-language therapists in Türkiye who were actively working in the field of stuttering and fluency disorders. Five speech-language therapists with clinical experience in stuttering were purposively selected to independently evaluate responses generated by four large language models to standardized questions concerning stuttering information, assessment, and therapy.
설명
Inclusion Criteria:
- Having an undergraduate or postgraduate degree in speech and language therapy.
- Actively practicing clinically in the field of stuttering/fluency disorders.
- Voluntarily agreeing to participate in the study.
- Completing the evaluation form in full.
Exclusion Criteria:
- Not having active clinical experience in the field of stuttering.
- Incomplete completion of the evaluation form.
- Withdrawal of voluntary participation during the evaluation process.
공부 계획
연구는 어떻게 설계됩니까?
디자인 세부사항
- 관찰 모델: OTHER
- 시간 관점: CROSS_SECTIONAL
그룹/코호트 수
코호트 및 개입
그룹/코호트그룹/코호트 |
개입 / 치료개입 / 치료 |
|---|---|
|
Expert Speech-Language Therapists
Five speech-language therapists with clinical experience in stuttering independently evaluated responses generated by four large language models (ChatGPT, Claude, Google Gemini, and Grok-4.20). The responses addressed nine questions covering general information about stuttering, clinical assessment, and therapy. Each response was rated for relevance, accuracy, clarity, completeness, and consistency using a 5-point Likert scale. |
ChatGPT responses to nine standardized questions on stuttering information, assessment, and therapy were generated in separate sessions and recorded for independent expert evaluation. Questions were repeated under comparable conditions to allow assessment of response consistency. Claude responses to nine standardized questions on stuttering information, assessment, and therapy were generated in separate sessions and recorded for independent expert evaluation. Questions were repeated under comparable conditions to allow assessment of response consistency. Google Gemini responses to nine standardized questions on stuttering information, assessment, and therapy were generated in separate sessions and recorded for independent expert evaluation. Questions were repeated under comparable conditions to allow assessment of response consistency. Grok-4.20 responses to nine standardized questions on stuttering information, assessment, and therapy were generated in separate sessions and recorded for independent expert evaluation. Questions were repeated under comparable conditions to allow assessment of response consistency. |
연구는 무엇을 측정합니까?
주요 결과 측정
주요 결과 측정
결과 측정 |
측정값 설명 |
기간 |
|---|---|---|
|
Expert-Rated Quality of Large Language Model Responses
기간: During the single cross-sectional expert evaluation conducted over approximately 1 month
|
Responses generated by four large language models (ChatGPT, Claude, Google Gemini, and Grok-4.20) to nine standardized questions about stuttering were independently evaluated by five speech-language therapists with clinical experience in stuttering. Each response was rated using a 5-point Likert scale (1 = strongly disagree to 5 = strongly agree) across five criteria: relevance, accuracy, clarity, completeness, and consistency. Responses were evaluated against guideline-based reference information derived from evidence-based clinical practice guidance. Higher scores indicate better response quality and closer alignment with clinical practice guidance. Mean scores were calculated for each large language model and each evaluation criterion. |
During the single cross-sectional expert evaluation conducted over approximately 1 month
|
공동 작업자 및 조사자
연구 기록 날짜
연구 주요 날짜
연구 시작 (실제)
연구 시작
기본 완료 (실제)
기본 완료
연구 완료 (실제)
연구 완료
연구 등록 날짜
최초 제출
최초 제출
QC 기준을 충족하는 최초 제출
QC 기준을 충족하는 최초 제출
처음 게시됨 (실제)
처음 게시됨
연구 기록 업데이트
마지막 업데이트 게시됨 (실제)
마지막 업데이트 게시됨
QC 기준을 충족하는 마지막 업데이트 제출
QC 기준을 충족하는 마지막 업데이트 제출
마지막으로 확인됨
마지막으로 확인됨
추가 정보
이 연구와 관련된 용어
기타 연구 ID 번호
기타 연구 ID 번호
- LLM-STUTTER-2026
약물 및 장치 정보, 연구 문서
미국 FDA 규제 의약품 연구
미국 FDA 규제 기기 제품 연구
이 정보는 변경 없이 clinicaltrials.gov 웹사이트에서 직접 가져온 것입니다. 귀하의 연구 세부 정보를 변경, 제거 또는 업데이트하도록 요청하는 경우 register@clinicaltrials.gov. 문의하십시오. 변경 사항이 clinicaltrials.gov에 구현되는 즉시 저희 웹사이트에도 자동으로 업데이트됩니다. .