Development of a short form and scoring algorithm from the validated actionable bladder symptom screening tool

David Bates, Jack Burks, Denise Globe, Manuel Signori, Stacie Hudgens, Pierre Denys, Scott Macdiarmid, Victor Nitti, Ib Odderson, Amy Perrin Ross, Michael Chancellor, David Bates, Jack Burks, Denise Globe, Manuel Signori, Stacie Hudgens, Pierre Denys, Scott Macdiarmid, Victor Nitti, Ib Odderson, Amy Perrin Ross, Michael Chancellor

Abstract

Background: The majority of multiple sclerosis (MS) patients develop some form of lower urinary tract dysfunction, usually as a result of neurogenic detrusor overactivity (NDO). Patients identify urinary incontinence as one of the worst aspects of this disease. Despite the high prevalence of NDO, urological evaluation and treatment are significantly under-accessed in this population. The objectives of this study were: 1) to adapt the previously validated Actionable Bladder Symptom Screening Tool (ABSST) to a short form for ease and brevity of application in a clinical setting that is clinically meaningful; and 2) to develop a scoring algorithm that would be interpretable in terms of referring/considering precise diagnosis and treatment.

Methods: A US-based, non-randomized, multi-center, stand-alone observational study was conducted to assess the psychometric properties of the ABSST among patients who have MS with and without NDO. Mixed psychometric methods (e.g., classical statistics (Psychometric theory (3rd ed.). New York: McGraw-Hill; 1994) and item response methods (Applying the Rasch Model: Fundamental Measurement in the Human Sciences. New Jersey: Lawrence Earlbaum Associates; 2001)) were used to evaluate the predictive and clinical validity of the shortened form. The latter included clinicians flagging clinically meaningful items and associated response options which would indicate the need for further evaluation or treatment.

Results: A total of 151 patients, all with MS and with and without NDO, were recruited by 28 clinicians in various US geographical locations. Approximately 41% of patients reported a history of or currently having urinary incontinence and/or urinary urgency. The prediction model across the entire range of classification thresholds was evaluated, plotting the true positive identification rate against the false positive rate (1-Specificity) for various cut scores. In this study, the cut-point or total score of greater than or equal to 6 had a sensitivity of approximately 85%, and specificity of approximately 93% (i.e., 85% patients would warrant being referred to a urologist and 93% of the patients whose symptoms would not warrant urologist referral).

Conclusions: Overall the short form ABSST demonstrated sensitivity and specificity as it maintained the integrity of the longer form tool. Concurrent validity for each subscale as well as predictive and concurrent validity of the total shortened instrument was demonstrated. This instrument provides a new method for assessing bladder problems among MS patients, and may facilitate earlier and more precise diagnosis, treatment, and/or referral to a specialist.

Figures

Figure 1
Figure 1
ROC Curve of the ABSST Total Score at Cut-Points Predicting Referral to a Urologist.

References

    1. Compston A, Coles A. Multiple sclerosis. Lancet. 2002;359:1221–1231. doi: 10.1016/S0140-6736(02)08220-X.
    1. Noseworthy JH, Lucchinetti C, Rodriguez M, Weinshenker BG. Multiple sclerosis. N Engl J Med. 2000;343:938–952. doi: 10.1056/NEJM200009283431307.
    1. Shivane AG, Chakrabarty A. Multiple sclerosis and demyelination. Curr Diagn Pathol. 2007;13:193–202. doi: 10.1016/j.cdip.2007.04.003.
    1. National MS Ssociety. About-multiple-sclerosis/What-we-know-about-ms/What-is-ms. 2012. .
    1. Courtney AM, Treadaway K, Remington G, Frohman E. Multiple sclerosis. Med Clin North Am. 2009;93:451–452x. doi: 10.1016/j.mcna.2008.09.014.
    1. Brady CM, Dasgupta R, Dalton C, Wiseman OJ, Berkley KJ, Fowler CJ. An open-label pilot study of cannabis-based extracts for bladder dysfunction in advanced multiple sclerosis. Mult Scler. 2004;10:425–433. doi: 10.1191/1352458504ms1063oa.
    1. De Seze M, Ruffion A, Denys P, Joseph PA, Perrouin-Verbe B. The neurogenic bladder in multiple sclerosis: review of the literature and proposal of management guidelines. Mult Scler. 2007;13:915–928. doi: 10.1177/1352458506075651.
    1. Fowler CJ, Panicker JN, Drake M, Harris C, Harrison SC, Kirby M. et al.A UK consensus on the management of the bladder in multiple sclerosis. Postgrad Med J. 2009;85:552–559. doi: 10.1136/jnnp.2008.159178.
    1. Dasgupta R, Fowler CJ. Bladder, bowel and sexual dysfunction in multiple sclerosis: management strategies. Drugs. 2003;63:153–166. doi: 10.2165/00003495-200363020-00003.
    1. Mahajan ST, Patel PB, Marrie RA. Under treatment of overactive bladder symptoms in patients with multiple sclerosis: an ancillary analysis of the NARCOMS patient registry. J Urol. 2010;183:1432–1437. doi: 10.1016/j.juro.2009.12.029.
    1. Ghezzi A, Carone R, Del Popolo G, Amato MP, Bertolotto A. Recommendations for the management of urinary disorders in multiple sclerosis: a consensus of the Italian multiple sclerosis study group. Neurol Sci. 2011;32:1223–1231. doi: 10.1007/s10072-011-0794-y.
    1. Dorman PJ, Slattery J, Farrell B, Dennis MS, Sandercock PA. A randomised comparison of the EuroQol and short form-36 after stroke. United Kingdom collaborators in the International stroke trial. BMJ. 1997;315:461. doi: 10.1136/bmj.315.7106.461.
    1. Hassan SJ, Weymuller EA Jr. Assessment of quality of life in head and neck cancer patients. Head Neck. 1993;15:485–496. doi: 10.1002/hed.2880150603.
    1. Iglesias C, Torgerson D. Does length of questionnaire matter? a randomised trial of response rates to a mailed questionnaire. J Health Serv Res Policy. 2000;5:219–221.
    1. Rolstad S, Adler J, Ryden A. Response burden and questionnaire length: is shorter better? a review and meta-analysis. Value Health. 2011;14:1101–1108. doi: 10.1016/j.jval.2011.06.003.
    1. Burks J, Chancellor M, Bates D, Denys P, DeRidder D, MacDiarmid S, Development and validation of the actionable multiple sclerosis bladder health screening tool. Int’L of MS Care. 2013.
    1. Nunnally J, Bernstein I. Psychometric theory. 3. New York: McGraw-Hill; 1994.
    1. Bond T, Fox C. Applying the Rasch Model: Fundamental Measurement in the Human Sciences. New Jersey: Lawrence Earlbaum Associates; 2001.
    1. Streiner D, Norman G. Health Measurement Scales. 4. Oxford, England: Oxford University Press; 2008.
    1. Masters GN. A rasch model for partial credit scoring. Psychometrika. 1982;47:149–174. doi: 10.1007/BF02296272.
    1. Campbell DT, Fiske DW. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychol Bull. 1959;56:81–105.
    1. Linacre JM. A User’s Guide to WINSTEPS. Chicago: Mesa Press; 2006.
    1. Kuder GF, Richardson MW. The theory of the estimation of test reliability. Psychometrika. 1937;2:151–160. doi: 10.1007/BF02288391.
    1. Tape TG. Interpreting Diagnostic Tests. Omaha, Nebraska: University of Nebraska Medical Center; 2012.
    1. Patrick DL, Burke LB, Gwaltney CJ, Leidy NK, Martin ML, Molsen E. et al.Content validity-establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) Instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 1-eliciting concepts for a new PRO instrument. Value Health. 2011;14:967–977. doi: 10.1016/j.jval.2011.06.014.
    1. Patrick DL, Burke LB, Gwaltney CJ, Leidy NK, Martin ML, Molsen E. et al.Content validity-establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) Instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 1-eliciting concepts for a new PRO instrument. Value Health. 2011;14:978–988. doi: 10.1016/j.jval.2011.06.013.
    1. Litwin, Mark S. How to measure survey reliability and validity. Vol. 7. Thousand Oaks: SAGE Publications, Incorporated; 1995.
    1. Diamond GA, Forrester JS. Analysis of probability as an aid in the clinical diagnosis of coronary-artery disease. N Engl J Med. 1979;300:1350–1358. doi: 10.1056/NEJM197906143002402.
    1. Goldschlager N. Use of the treadmill test in the diagnosis of coronary artery disease in patients with chest pain. Ann Intern Med. 1982;97:383–388. doi: 10.7326/0003-4819-97-3-383.
    1. Ransohoff DF, Feinstein AR. Problems of spectrum and bias in evaluating the efficacy of diagnosis tests. N Engl J Med. 1978;299:926–930. doi: 10.1056/NEJM197810262991705.
    1. Bode RK. Partial credit model and pivot anchoring. J Appl Meas. 2001;2:78–95.
    1. Coyne KS, Margolis MK, Zyczynski T, Elinoff V, Roberts R. Validation of an Overactive Bladder Screener in a Primary Care Patient Population in the United States. Poster presented at the 34th Joint Meeting of the International Continence Society and the International UroGynecological Association; 2004.
    1. Nortvedt MW, Riise T, Frugård J, Mohn J, Bakke A, Skår AB. Prevalence of bladder, bowel and sexual problems among multiple sclerosis patients two to five years after diagnosis. Mult Scler. 2007;13:106–112. doi: 10.1177/1352458506071210.
    1. Coyne KS, Margolis MK, Bavendam T, Roberts R, Elinoff V. Validation of a 3-item OAB awareness tool. Int J Clin Pract. 2011;65:219–224. doi: 10.1111/j.1742-1241.2010.02561.x.

Source: PubMed

Sponsors and Collaborators

Medical Conditions

Drug Interventions

3
Subscribe