Validation of an Artificial Intelligence Enabled Diagnostic Support Software (ArtiQ.Spiro) in Primary Care Spirometry Datasets - a Retrospective Analysis

A retrospective study to evaluate the diagnostic performance of an Artificial Intelligence enabled software (ArtiQ.Spiro) in UK primary care spirometry datasets.

Study Overview

• Status: Active, not recruiting
• Conditions: Respiratory Disease

Detailed Description

This is a retrospective analysis of existing clinical datasets with consecutive spirometry collected in a primary care setting in the UK. Individual patient data will be included if the individual meets the study protocol eligibility criteria.

Clinical datasets will be de-identified (name, date of birth, address, postcode, occupation GP, ethnicity, medications data removed). Individuals will be identified by a study ID number. The de-identified datasets will contain the minimum information needed for spirometry and ArtiQ.Spiro - namely age, smoking history, height, weight, primary respiratory symptom - and the deidentified data exported from the primary care spirometry software.

ArtiQ.Spiro Evaluation (Index Tests for Diagnosis and Quality):

A deidentified dataset will be provided to a machine learning analyst who will apply the machine learning algorithm of ArtiQ.Spiro. For each individual, the algorithm will produce a preferred diagnosis (highest probability diagnostic category) (Index Test for Diagnosis) and an assessment of spirometry quality (Acceptable, Usable, Not Acceptable/Usable) (Index Test for Quality). No clinical information outside of the spirometry dataset nor reference standard data will be made available to the analyst.

Reference Standard for Diagnosis:

The clinical dataset, together with available primary care records and secondary care records, will be used by the senior members of the direct clinical care team (Consultants in Respiratory Medicine with an interest in integrated respiratory care) to provide a reference standard for diagnosis. For each individual, two consultants will provide a diagnosis independently and blinded to the index test (ArtiQ.Spiro) output. If there is agreement, this diagnosis will be taken as the reference standard for diagnosis for the individual. If there is no agreement, a third consultant outside the direct clinical care team will be provided with the same information (but deidentified) to act as final arbitrator.

Reference Standard for Quality:

A deidentified dataset will be provided to a specialist respiratory physiologist. He/she will grade the quality of each spirometric session according to the official American Thoracic Society / European Respiratory Society 2019 Technical Statement for Standardization of Spirometry. For each patient, the quality of the spirometry session will be graded according to one of three categories: Acceptable, Usable, Not Acceptable/Usable. This will act as the reference standard for quality. The respiratory physiologists will be blinded to the output from the Index Test (ArtiQ.Spiro). The respiratory physiologists will also record time taken to evaluate the dataset.

Data Analysis:

Data analysis will be performed by the research team who will be independent to the direct clinical care team and the respiratory physiologists who will be providing the reference standards for diagnosis and quality respectively.

• Study Type: Observational
• Enrollment (Anticipated): 1000

Contacts and Locations

Study Locations

• United Kingdom
  • Middlesex, United Kingdom, UB9 6JH
    • Harefield Hospital

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: 16 years and older (Adult, Older Adult)
• Accepts Healthy Volunteers: No
• Genders Eligible for Study: All

• Sampling Method: Non-Probability Sample

Study Population

The datasets, which will be analysed retrospectively, will comprise spirometry data previously collected as part of clinical spirometry pathways in primary care.

Description

Inclusion Criteria:

• Adult aged 18 years or over
• At least one of the following respiratory symptoms: cough, wheeze, shortness of breath, reduced exercise tolerance
• Spirometry performed for clinical purposes in a non-hospital lung function setting (such as a community clinic, a GP practice, or at home)
• Spirometry was supervised by a doctor or non-medical allied health professional

Exclusion Criteria:

• Aged 17 or under
• No respiratory symptoms
• Spirometry performed for pre-operative assessment
• Spirometry performed exclusively as part of a research study
• Spirometry performed at home without supervision.

Study Plan

How is the study designed?

Design Details

• Observational Models: Other
• Time Perspectives: Retrospective

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Evaluate diagnostic performance of an Artificial Intelligence enabled software (ArtiQ.Spiro) in UK primary care spirometry datasets.	Evaluate diagnostic performance of an Artificial Intelligence enabled software (ArtiQ.Spiro) in UK care spirometry datasets.	24 months

Secondary Outcome Measures

Outcome Measure	Time Frame
To evaluate the performance of an Artificial Intelligence enabled software (ArtiQ.Spiro) in the quality grading of Forced Expiratory Volume in One second (FEV1) and Forced Vital Capacity (FVC) from UK primary care spirometry datasets.	24 months

Collaborators and Investigators

• Sponsor: Royal Brompton & Harefield NHS Foundation Trust
• Collaborators: King's College London; King's College Hospital NHS Trust; Imperial College London; Queen Mary University of London; Papworth Hospital NHS Foundation Trust; University of Leicester; The Hillingdon Hospitals NHS Foundation Trust; Southern Health NHS Foundation Trust
• Investigators: Principal Investigator: William Man, FRCP, Royal Brompton & Harefield Hospitals

Study record dates

Study Major Dates

• Study Start (Actual): July 1, 2022
• Primary Completion (Anticipated): May 1, 2024
• Study Completion (Anticipated): May 1, 2024

Study Registration Dates

• First Submitted: December 5, 2022
• First Submitted That Met QC Criteria: December 5, 2022
• First Posted (Estimate): December 13, 2022

Study Record Updates

• Last Update Posted (Estimate): December 13, 2022
• Last Update Submitted That Met QC Criteria: December 5, 2022
• Last Verified: December 1, 2022

More Information

Terms related to this study

• Additional Relevant MeSH Terms: Respiration Disorders; Respiratory Tract Diseases
• Other Study ID Numbers: 314058

Drug and device information, study documents

• Studies a U.S. FDA-regulated drug product: No
• Studies a U.S. FDA-regulated device product: No