Exploring consensus on how to measure smoking cessation. A Delphi study

Kei Long Cheung, Dennis de Ruijter, Mickaël Hiligsmann, Iman Elfeddali, Ciska Hoving, Silvia M A A Evers, Hein de Vries, Kei Long Cheung, Dennis de Ruijter, Mickaël Hiligsmann, Iman Elfeddali, Ciska Hoving, Silvia M A A Evers, Hein de Vries

Abstract

Background: Different criteria regarding outcome measures in smoking research are used, which can lead to confusion about study results. Consensus in outcome criteria may enhance the comparability of future studies. This study aims (1) to provide an overview of tobacco researchers' considered preferences regarding outcome criteria in randomized controlled smoking cessation trials, and (2) to identify the extent to which researchers can reach consensus on the importance of these outcome criteria.

Methods: A three-round online Delphi study was conducted among smoking cessation experts. In the first round, the most important smoking cessation outcome measures were collected by means of open-ended questions, which were categorized around self-reported and biochemical validation measures. Experts (n = 17) were asked to name the outcome measures (as well as their assessment method and ideal follow-up period) that they thought were important when assessing smoking-related outcomes. In the second (n = 48) and third rounds (n = 37), a list of outcome measures-identified in the first round-was presented to experts. Asking them to rate the importance of each measure on a seven-point scale.

Results: Experts reached consensus on several items. For self-reports, experts agreed that prolonged abstinence (6 or/and 12 months), point prevalence abstinence (7 days), continuous abstinence (6 months), and the number of cigarettes smoked (7 days) are important outcome measures. Experts reached consensus that biochemical validation methods should not always be used. The preferred biochemical validation methods were carbon monoxide (expired air) and cotinine (saliva). Preferred follow-ups included 6 and/or 12 months, with or without intermediate measurements.

Conclusions: Findings suggest only partial compliance with the Russell standard and that more outcome measures may be important (including seven-day point-prevalence abstinence, number of cigarettes smoked, and cotinine when using biochemical validation). This study showed where there is and is not consensus, reflecting the need to develop a more comprehensive standard. For these purposes we provided suggestions for the Russell 2.0 standard.

Keywords: Abstinence; Biochemical validation; Consensus; Delphi; Measure; Outcome criteria; Self-report; Smoking cessation; Tobacco control.

Conflict of interest statement

Competing interest

The authors declare that they have no competing interests.

Ethics approval and consent to participate

No ethical approval needed for this study.

Consent for publication

Not applicable.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

    1. National Institutes of Health. The Economics of Tobacco and Tobacco Control. 2016. Accessed (27–01-2017): .
    1. WHO "WHO Framework Convention on Tobacco Control. 2016. Accessed (16–07-2016):
    1. European Commission. “Public Health: Tobacco Policy” 2012. Accessed (16–07-2016):
    1. DiClemente CC, Prochaska JO. Self-change and therapy change of smoking behavior: a comparison of processes of change in cessation and maintenance. Addict Behav. 1982;7(2):133–142. doi: 10.1016/0306-4603(82)90038-7.
    1. Smit ES, de Vries H, Hoving C. Effectiveness of a web-based multiple tailored smoking cessation program: a randomized controlled trial among Dutch adult smokers. J Med Internet Res. 2012;14(3):e82. doi: 10.2196/jmir.1812.
    1. Lemmens V, Oenema A, Knut IK, Brug J. Effectiveness of smoking cessation interventions among adults: a systematic review of reviews. Eur J Cancer Prev. 2008;17(6):535–544. doi: 10.1097/CEJ.0b013e3282f75e48.
    1. Velicer WF, Prochaska JO, Rossi JS, Snow MG. Assessing outcome in smoking cessation studies. Psychol Bull. 1992;111(1):23. doi: 10.1037/0033-2909.111.1.23.
    1. Velicer WF, Prochaska JO. A comparison of four self-report smoking cessation outcome measures. Addict Behav. 2004;29(1):51–60. doi: 10.1016/S0306-4603(03)00084-4.
    1. Society for Research on Nicotine and Tobacco Subcommittee on Biochemical Verification Biochemical verification of tobacco use and cessation. Nicotine Tob Res. 2002;4(2):149–159. doi: 10.1080/14622200210123581.
    1. Hurt RD, Sachs DP, Glover ED, Offord KP, Johnston JA, Dale LC, Khayrallah MA, Schroeder DR, Glover PN, Sullivan CR. A comparison of sustained-release bupropion and placebo for smoking cessation. N Engl J Med. 1997;337(17):1195–1202. doi: 10.1056/NEJM199710233371703.
    1. West R, Hajek P, Stead L, Stapleton J. Outcome criteria in smoking cessation trials: proposal for a common standard. Addiction. 2005;100(3):299–303. doi: 10.1111/j.1360-0443.2004.00995.x.
    1. Viswesvaran C, Schmidt FL. A meta-analytic comparison of the effectiveness of smoking cessation methods. J Appl Psychol. 1992;77(4):554. doi: 10.1037/0021-9010.77.4.554.
    1. ACP ACoP: methods for stopping cigarette smoking. Ann Intern Med. 1986;105(2):281–291. doi: 10.7326/0003-4819-105-2-281.
    1. Civljak M, Stead LF, Hartmann-Boyce J, Sheikh A, Car J. Internet-based interventions for smoking cessation. The Cochrane Library. 2013;10;(7):CD007078. doi:10.1002/14651858.CD007078.pub4.
    1. Hughes JR, Carpenter MJ, Naud S. Do point prevalence and prolonged abstinence measures produce similar results in smoking cessation studies? A systematic review. Nicotine Tob Res. 2010; 10.1093/ntr/ntq078.
    1. Hughes JR, Keely JP, Niaura RS, Ossip-Klein DJ, Richmond RL, Swan GE. Measures of abstinence in clinical trials: issues and recommendations. Nicotine Tob Res. 2003;5(1):13–25. doi: 10.1080/1462220031000070552.
    1. Richmond RL. A comparison of measures used to assess effectiveness of the transdermal nicotine patch at 1 year. Addict Behav. 1997;22(6):753–757. doi: 10.1016/S0306-4603(97)00041-5.
    1. Stead LF, Perera R, Bullen C, Mant D, Hartmann-Boyce J, Cahill K, Lancaster T. Nicotine replacement therapy for smoking cessation. Cochrane Database Syst Rev. 2012;11:11.
    1. Ruger JP, Weinstein MC, Hammond SK, Kearney MH, Emmons KM. Cost-effectiveness of motivational interviewing for smoking cessation and relapse prevention among low-income pregnant women: a randomized controlled trial. Value Health. 2008;11(2):191–198. doi: 10.1111/j.1524-4733.2007.00240.x.
    1. Cyphert FR, Gant WL. The Delphi technique: a case study. Phi Delta Kappan. 1971;52(5):272–273.
    1. Custer RL, Scarcella JA, Stewart BR. The modified Delphi technique-A rotational modification. J Career Tech Educ. 1999;15(2).
    1. Dalkey N, Helmer O. An experimental application of the Delphi method to the use of experts. Manag Sci. 1963;9(3):458–467. doi: 10.1287/mnsc.9.3.458.
    1. Dalkey NC, Brown BB, Cochran S. The Delphi method: an experimental study of group opinion. Santa Monica: Rand Corporation; 1969.
    1. Linstone HA, Turoff M. The Delphi method: techniques and applications. MA: Addison-Wesley Reading; 1975.
    1. Young SJ, Jamieson LM. Delivery methodology of the Delphi: a comparison of two approaches. J Park Recreat Adm. 2001;19(1):42–58.
    1. Hsu C-C, Sandford BA. The Delphi technique: making sense of consensus. Pract Assess Res Eval. 2007;12(10):1–8.
    1. Ludwig BG. Internationalizing Extension: An exploration of the characteristics evident in a state university Extension system that achieves internationalization. Columbus: The Ohio State University; 1994.
    1. Delbecq AL, Van de Ven AH, Gustafson DH. Group techniques for program planning: a guide to nominal group and Delphi processes. Glenview: Scott Foresman; 1975.
    1. Ludwig B. Predicting the future: have you considered using the Delphi methodology. J Ext. 1997;35(5):1–4.
    1. Jones J, Hunter D. Consensus methods for medical and health services research. BMJ. 1995;311(7001):376. doi: 10.1136/bmj.311.7001.376.
    1. Gorber SC, Schofield-Hurwitz S, Hardt J, Levasseur G, Tremblay M. The accuracy of self-reported smoking: a systematic review of the relationship between self-reported and cotinine-assessed smoking status. Nicotine Tob Res. 2009;11(1):12–24. doi: 10.1093/ntr/ntn010.
    1. Cohen S, Lichtenstein E, Prochaska JO, Rossi JS, Gritz ER, Carr CR, Orleans CT, Schoenbach VJ, Biener L, Abrams D. Debunking myths about self-quitting: evidence from 10 prospective studies of persons who attempt to quit smoking by themselves. Am Psychol. 1989;44(11):1355. doi: 10.1037/0003-066X.44.11.1355.
    1. Stanczyk N, de Vries H, Candel M, Muris J, Bolman C. Effectiveness of video-versus text-based computer-tailored smoking cessation interventions among smokers after one year. Prev Med. 2016;82:42–50. doi: 10.1016/j.ypmed.2015.11.002.
    1. Cheung KL, Wijnen BF, Hollin IL, Janssen EM, Bridges JF, Evers SM, Hiligsmann M. Using best–worst scaling to investigate preferences in health care. PharmacoEconomics. 2016:1–15.
    1. Clark MD, Determann D, Petrou S, Moro D, de Bekker-Grob EW. Discrete choice experiments in health economics: a review of the literature. PharmacoEconomics. 2014;32(9):883–902. doi: 10.1007/s40273-014-0170-x.
    1. Swanborn PG. Methoden van sociaal-wetenschappelijk onderzoek [Social science research methods] 4. Boom: Meppel; 1987.
    1. Blankers M, Smit ES, van der Pol P, de Vries H, Hoving C, van Laar M. The missing= smoking assumption: a fallacy in internet-based smoking cessation trials? Nicotine Tob Res. 2016;18(1):25–33.

Source: PubMed

3
Se inscrever