Test-retest reliability in a computer-based medical history

Abstract

The authors developed a computer-based medical history for patients to take in their homes via the internet. The history consists of 232 'primary' questions asked of all patients, together with more than 6000 questions, explanations, and suggestions that are available for presentation as determined by a patient's responses. The purpose of this research was to measure the test-retest reliability of the 215 primary questions that have preformatted, mutually exclusive responses of 'Yes,' 'No,' 'Uncertain (Don't know, Maybe),' 'Don't understand,' and 'I'd rather not answer.' From randomly selected patients of doctors affiliated with Beth Israel Deaconess Medical Center in Boston, 48 patients took the history twice with intervals between sessions ranging from 1 to 35 days (mean 7 days; median 5 days). High levels of test-retest reliability were found for most of the questions, but as a result of this study the authors revised five questions. They recommend that structured medical history questions that will be asked of many patients be measured for test-retest reliability before they are put into widespread clinical practice.

Conflict of interest statement

Competing interests: WS is on the Scientific Advisory Board of the Eliza Corporation with stock options in the company. TD is a director of the Eliza Corporation and holds stock options in the company. SEL is a principal in Veritas Health Solutions LLC, a principal in Cognitive Behavioral Technologies LLC, an owner of Veritas Health Associates LLC, and consults for LifeOptions Group and Mensante Corp.