Evaluating the Effect of Questionnaire Context on the Reporting of Somatic Items Among People With Systemic Sclerosis

Evaluating the Effect of Questionnaire Context on the Reporting of Somatic Items in the 8-item Patient Health Questionnaire Among People With Systemic Sclerosis: A Scleroderma Patient-centered Intervention Network (SPIN) Study

There is concern that self-reported depression questionnaires that contain items assessing somatic symptoms may result in biased scores in people with a chronic disease due to symptoms that overlap with their physical disease. However, it has been shown in previous studies that biases associated with somatic items do not affect total depression scores. The reason for this is still unclear but could be associated with the context in which these items are presented.

The goal of this experiment is to learn whether the way people with systemic sclerosis answer somatic items on a depression questionnaire is influenced by the fact that they are aware they are being assessed for depressive symptoms.

The main question it aims to answer is: Do people with systemic sclerosis score somatic items differently when they are administered outside the context of a depression questionnaire? Participants will be randomly assigned to complete the 8-item Patient Health Questionnaire as part of their routine cohort assessments either with the items in their standard order or with somatic items presented first and separately from psychological items.

Study Overview

• Status: Completed
• Conditions: Scleroderma; Systemic Sclerosis (SSc); Scleroderma (Limited and Diffuse)
• Intervention / Treatment: Other: Reordered PHQ-8

Detailed Description

• BACKGROUND Most self-report depression symptom questionnaires include both psychological and somatic symptom items. The 9-item Patient Health Questionnaire (PHQ-9) and its 8-item version (PHQ-8) are commonly used depression assessment measures and include items that reflect the psychological and somatic symptoms of depression listed in the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5). However, there is concern that scores obtained using such questionnaires may be inflated in people with chronic illness due to the overlap of somatic symptoms related to depression and those stemming from their physical illness. In contrast to what might be expected, existing research suggests that having a medical illness or the severity of a respondent's medical illness are not associated with higher scores on somatic symptom items of the PHQ-9. Studies conducted in different patient populations, including people with systemic sclerosis (SSc), found either no significant differential item functioning (DIF) in somatic items of depression questionnaires or minimal DIF that did not significantly affect total questionnaire scores. It is possible that people with medical conditions who experience symptoms that may overlap with depression symptoms, including fatigue, changes in appetite, and sleep problems, do not report them on the PHQ-9 or PHQ-8 more than people without medical conditions due to a question ordering or context effect. The investigators will use the multinational Scleroderma Patient-centered Intervention Network (SPIN) Cohort to conduct a randomized experiment to examine whether awareness that depression symptoms are being assessed affects how people with a chronic illness report somatic symptoms of depression.
• OBJECTIVES The primary objective will be to evaluate differences in mean sum scores of PHQ-8 somatic items (sum of item 3 = sleep disturbances, item 4 = fatigue, and item 5 = changes in appetite) in people with SSc when the items are administered outside the context of a depression questionnaire compared to when they are administered in the context of a depression questionnaire. The secondary objective will be to evaluate differences in mean scores for each individual somatic symptom item.
• RECRUITMENT The SPIN Cohort is a large multinational cohort that collects longitudinal data on patient-reported outcomes from people living with SSc. It currently includes >1500 active participants recruited from 53 SPIN sites in Canada, the United States, Mexico, Australia, and France, Spain, and the United Kingdom. SPIN cohort participants are recruited during regular medical visits at SPIN recruitment sites, and written informed consent is obtained. Once enrolled in the Cohort, participants are sent an automated welcome email with instructions on how to activate their SPIN account and complete SPIN Cohort measures online. Cohort participants complete online assessments upon enrolment and at 3-month intervals. All SPIN Cohort participants who log in to the SPIN Cohort platform to complete a routine 3-month assessment will be included in this experiment.
• RANDOMIZATION The SPIN Cohort platform will be programmed to automatically randomize each participant via simple randomization in a 1:1 ratio to either the "Reordered items" arm or the "Original item order" arm.
• OUTCOMES The primary outcome variable will be the sum score of the 3 PHQ-8 somatic symptom item scores (item 3 = sleep disturbances, item 4 = fatigue, and item 5 = changes in appetite). The secondary outcome variables will be the individual item scores for items 3, 4, and 5.
• METHODS This is a two-arm parallel randomized controlled experiment. When SPIN Cohort participants log in to complete their routine assessment, they will be randomly assigned to complete either the standard PHQ-8 or a reordered version in which the 3 somatic symptom items (item 3 = sleep disturbances, item 4 = fatigue, and item 5 = changes in appetite) will be presented first, without any indication that they are part of a depression questionnaire, and the psychological symptom items will be presented later in the assessment protocol. Both primary and secondary analyses will be done as complete case analyses using between-groups t-tests.

• Study Type: Interventional
• Enrollment (Actual): 851
• Phase: Not Applicable

Contacts and Locations

Study Locations

• Canada
  • Quebec
    • Montreal, Quebec, Canada, H3T 1E2
      • Jewish General Hospital
    • Montreal, Quebec, Canada, H3T 1E2
      • Lady Davis Institute for Medical Research

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: Adult; Older Adult
• Accepts Healthy Volunteers: No

Description

Inclusion Criteria:

• SPIN Cohort patients must have a systemic sclerosis (SSc) diagnosis based on 2013 American College of Rheumatology/European League Against Rheumatism criteria confirmed by a SPIN physician, be ≥18 years old, be able to give informed consent, and be fluent in English, French or Spanish.
• Participants must have access to a computer or tablet with internet access.

Exclusion Criteria:

• None.

Study Plan

How is the study designed?

Design Details

• Primary Purpose: Other
• Allocation: Randomized
• Interventional Model: Parallel Assignment
• Masking: Triple

Number of Arms

2

Arms and Interventions

Participant Group / Arm	Intervention / Treatment
Experimental: Reordered items; Participants will receive a routine assessment protocol in which the 3 PHQ-8 somatic items will be presented separately from and prior to the 5 psychological items, without any indication they are part of a depression symptom questionnaire. PHQ-8 psychological items will be presented after the somatic items and with at least 1 measure separating them in the routine assessment protocol. With the exception of these 2 rules, all measures included in the routine assessment will appear in a random order for each SPIN Cohort participant.	Other: Reordered PHQ-8; Participants will be administered the PHQ-8 somatic items separately from the psychological items, outside the context of a depression questionnaire.
No Intervention: Original item order; Participants will complete the standard version of the PHQ-8 which includes both somatic and psychological items, presented in a random order among other measures of the routine assessment protocol. The title of the PHQ-8 will not be included and participants will only see the 8 items presented on a single page in their standard order.

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Difference in mean sum PHQ-8 somatic item scores when administered outside and within a depression questionnaire context	Scores obtained on the 8-item Patient Health Questionnaire (PHQ-8) range from 0 to 24, with higher scores indicating worse outcome. Individual items are scored on a 4-point scale ranging from 0 (not at all) to 3 (nearly every day). PHQ-8 somatic items will include items 3 (sleep problems), 4 (fatigue), and 5 (changes in appetite). The investigators will compare the mean sum score of somatic item scores between the "Reordered items" arm and the "Original item order" arm using a between-groups t-test.	At enrollment

Secondary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Difference in individual PHQ-8 somatic item mean scores when administered outside and within a depression questionnaire context	Scores obtained on the 8-item Patient Health Questionnaire (PHQ-8) range from 0 to 24, with higher scores indicating worse outcome. Individual items are scored on a 4-point scale ranging from 0 (not at all) to 3 (nearly every day). PHQ-8 somatic items will include items 3 (sleep problems), 4 (fatigue), and 5 (changes in appetite). The investigators will compare mean scores of each individual item between the "Reordered items" arm and the "Original item order" arm using 3 between-groups t-tests.	At enrollment

Collaborators and Investigators

• Sponsor: Lady Davis Institute

Study record dates

Study Major Dates

• Study Start (Actual): January 17, 2025
• Primary Completion (Actual): April 17, 2025
• Study Completion (Actual): April 17, 2025

Study Registration Dates

• First Submitted: January 7, 2025
• First Submitted That Met QC Criteria: January 11, 2025
• First Posted (Actual): January 14, 2025

Study Record Updates

• Last Update Posted (Estimated): September 9, 2025
• Last Update Submitted That Met QC Criteria: September 2, 2025
• Last Verified: January 1, 2025

More Information

Terms related to this study

• Keywords: Depression; Systemic Sclerosis; PROM; Scleroderma; Patient-reported outcome measure; Item order
• Additional Relevant MeSH Terms: Connective Tissue Diseases; Behavioral Symptoms; Skin Diseases; Behavior; Skin and Connective Tissue Diseases; Depression; Scleroderma, Systemic; Scleroderma, Diffuse
• Other Study ID Numbers: 2025-PHQ

Drug and device information, study documents

• Studies a U.S. FDA-regulated drug product: No
• Studies a U.S. FDA-regulated device product: No
• product manufactured in and exported from the U.S.: No