Effectiveness of a Conversational Chatbot (Dejal@bot) for the Adult Population to Quit Smoking: Pragmatic, Multicenter, Controlled, Randomized Clinical Trial in Primary Care

Eduardo Olano-Espinosa, Jose Francisco Avila-Tomas, Cesar Minue-Lorenzo, Blanca Matilla-Pardo, María Encarnación Serrano Serrano, F Javier Martinez-Suberviola, Mario Gil-Conesa, Isabel Del Cura-González, Dejal@ Group, L Molina Alameda, C Andrade Rosa, M Espejo Romero, J L Hernandez Garcia, E Perez Perez, J Zambrano Alvarez, F J Sanchez Jimenez, M Garcia Silva, I Martin Gomez, N Puyo Rodriguez, I Sanchez Vazquez, M T Garcia Alegre, C Moral Moraleda, O Perez Gandia, S Hernandez Rodriguez, J Aparicio Velasco, E Cerezo Pascual, C Marin Osorio, E Prieto Villegas, J Rodriguez Donoso, A Rodriguez Huete, F J Romero Blanco, S J Castillo Portales, R Collados Navas, P Gutierrez Sordo, M Sanchez Quejido, C Abad Schilling, M Capitan Jurado, M A Regalado del Valle, H C Alache Zuñiga, B Jaenes Barrios, M Ortiz Sánchez, M L Santiago Hernando, S Arjona Pérez, R Díaz Martin, B Fandiño García, M C Gómez Ortiz, M T López-Martin Aragón, M A Miguel Abanto, M Noguerol Álvarez, S Parra Roman, S Rey Rodríguez, E Aguilar Hurtado, M Aguilera Rubio, A I Carbonero Martín, M Esteban García, C Esteban De la Peña, C García Contreras, M J Rojas Giraldo, Y B Sánchez Fernández, M Alonso Ovies, N García Arpa, O González-Carpio Paredes, M J Grandes Muñoz, M Jara Peñacoba, A Lopez Villalvilla, M J Parellada Ruiz de la Cuesta, M Rodríguez Bastida, S Vicente Pérez, B Martín Porras, A González Valls, A Joglar Alcubilla, J Santa Cruz Hernández, C Castilla Álvarez, M García Viada, M A García-Abad Fernández, V Molina Bárcena, I Sepúlveda Gómez, P Cuadrado González, C Linares Sánchez, B Solans Aisa, T Francisco Romanillos, A García Ortego, P Hernández García-Alcalá, F Huguet Vivas, M L Juarez Zapatero, C López García, M J Manzano Martín, J A Martínez Torres, M Miguel Garzón, M P Rodrigo Rodrigo, M A Ruano Domínguez, D Aguilera Lafuente, N Altares Arriola, R Aranzo Pacheco, M Escudero Araus, C Fuentes Manrique, S Guijarro Abanades, A M López Carabaño, G D Moneva Vicente, M Pérez Fernández, T Rubio Rubio, M F Venegas Gato, M Blas Escribano, M M Castro Fouz, B Castro Sánchez, L Domínguez Pérez, P A García Gómez, A Herrero Dios, M Lor Leandro, I Lozano Marín, S Pacho Pinto, R Pastor Sánchez, M D Moreno Chaparro, E Yagüe Fernández, A Mateo Madruga, P Pumar Sainz, C Aragon Marente, M A Gomez Medina, J A Granados Garrido, I Gutierrez Sanchez, M J Heras Alonso, M R Herrero Pacheco, B Martín Peces, S Misericordia Garcia, S Ochoa Vilor, C Vargas Machuca, M A González Bellido, B Goncalves Molina, F Morata Cruz, L Moreno Carreras, M V Alda de la Fuente, L Hebeisen Andrés, O Fernández-Montes López-Morato, C Marcos de Frutos, V Ruiz Pascual, A Cayuela Maté, R M Fernández García, A Góngora Marín, S Perez Cuadrado, A Redondo Horcajo, I Á Rosario Pacheco, R M Villena Romero, O Hakami Hakami, M M Álvarez Villalba, M J Bedoya Frutos, A Hormigos Agraz, M T López López, B Perez Vallejo, M P Tardaguila Lobato, A Ballarín González, Y Fernández Fernández, I Ferrer Zapata, E Gómez Suárez, F Morales Ortiz, C Peláez Laguno, J L Quintana Gómez, E Rioja Delgado, J I Aza Pascual, D Fuente Arriarán, R A García Pérez, A Gárriz Aguirre, S Gómez Díaz, N Gonzalez Sanchez, C Sanz Velasco, J Vázquez Gallego, C Fernandez Durán, N Peña Antón, J M Blanco Canseco, E Minguela Puras, Eduardo Olano-Espinosa, Jose Francisco Avila-Tomas, Cesar Minue-Lorenzo, Blanca Matilla-Pardo, María Encarnación Serrano Serrano, F Javier Martinez-Suberviola, Mario Gil-Conesa, Isabel Del Cura-González, Dejal@ Group, L Molina Alameda, C Andrade Rosa, M Espejo Romero, J L Hernandez Garcia, E Perez Perez, J Zambrano Alvarez, F J Sanchez Jimenez, M Garcia Silva, I Martin Gomez, N Puyo Rodriguez, I Sanchez Vazquez, M T Garcia Alegre, C Moral Moraleda, O Perez Gandia, S Hernandez Rodriguez, J Aparicio Velasco, E Cerezo Pascual, C Marin Osorio, E Prieto Villegas, J Rodriguez Donoso, A Rodriguez Huete, F J Romero Blanco, S J Castillo Portales, R Collados Navas, P Gutierrez Sordo, M Sanchez Quejido, C Abad Schilling, M Capitan Jurado, M A Regalado del Valle, H C Alache Zuñiga, B Jaenes Barrios, M Ortiz Sánchez, M L Santiago Hernando, S Arjona Pérez, R Díaz Martin, B Fandiño García, M C Gómez Ortiz, M T López-Martin Aragón, M A Miguel Abanto, M Noguerol Álvarez, S Parra Roman, S Rey Rodríguez, E Aguilar Hurtado, M Aguilera Rubio, A I Carbonero Martín, M Esteban García, C Esteban De la Peña, C García Contreras, M J Rojas Giraldo, Y B Sánchez Fernández, M Alonso Ovies, N García Arpa, O González-Carpio Paredes, M J Grandes Muñoz, M Jara Peñacoba, A Lopez Villalvilla, M J Parellada Ruiz de la Cuesta, M Rodríguez Bastida, S Vicente Pérez, B Martín Porras, A González Valls, A Joglar Alcubilla, J Santa Cruz Hernández, C Castilla Álvarez, M García Viada, M A García-Abad Fernández, V Molina Bárcena, I Sepúlveda Gómez, P Cuadrado González, C Linares Sánchez, B Solans Aisa, T Francisco Romanillos, A García Ortego, P Hernández García-Alcalá, F Huguet Vivas, M L Juarez Zapatero, C López García, M J Manzano Martín, J A Martínez Torres, M Miguel Garzón, M P Rodrigo Rodrigo, M A Ruano Domínguez, D Aguilera Lafuente, N Altares Arriola, R Aranzo Pacheco, M Escudero Araus, C Fuentes Manrique, S Guijarro Abanades, A M López Carabaño, G D Moneva Vicente, M Pérez Fernández, T Rubio Rubio, M F Venegas Gato, M Blas Escribano, M M Castro Fouz, B Castro Sánchez, L Domínguez Pérez, P A García Gómez, A Herrero Dios, M Lor Leandro, I Lozano Marín, S Pacho Pinto, R Pastor Sánchez, M D Moreno Chaparro, E Yagüe Fernández, A Mateo Madruga, P Pumar Sainz, C Aragon Marente, M A Gomez Medina, J A Granados Garrido, I Gutierrez Sanchez, M J Heras Alonso, M R Herrero Pacheco, B Martín Peces, S Misericordia Garcia, S Ochoa Vilor, C Vargas Machuca, M A González Bellido, B Goncalves Molina, F Morata Cruz, L Moreno Carreras, M V Alda de la Fuente, L Hebeisen Andrés, O Fernández-Montes López-Morato, C Marcos de Frutos, V Ruiz Pascual, A Cayuela Maté, R M Fernández García, A Góngora Marín, S Perez Cuadrado, A Redondo Horcajo, I Á Rosario Pacheco, R M Villena Romero, O Hakami Hakami, M M Álvarez Villalba, M J Bedoya Frutos, A Hormigos Agraz, M T López López, B Perez Vallejo, M P Tardaguila Lobato, A Ballarín González, Y Fernández Fernández, I Ferrer Zapata, E Gómez Suárez, F Morales Ortiz, C Peláez Laguno, J L Quintana Gómez, E Rioja Delgado, J I Aza Pascual, D Fuente Arriarán, R A García Pérez, A Gárriz Aguirre, S Gómez Díaz, N Gonzalez Sanchez, C Sanz Velasco, J Vázquez Gallego, C Fernandez Durán, N Peña Antón, J M Blanco Canseco, E Minguela Puras

Abstract

Background: Tobacco addiction is the leading cause of preventable morbidity and mortality worldwide, but only 1 in 20 cessation attempts is supervised by a health professional. The potential advantages of mobile health (mHealth) can circumvent this problem and facilitate tobacco cessation interventions for public health systems. Given its easy scalability to large populations and great potential, chatbots are a potentially useful complement to usual treatment.

Objective: This study aims to assess the effectiveness of an evidence-based intervention to quit smoking via a chatbot in smartphones compared with usual clinical practice in primary care.

Methods: This is a pragmatic, multicenter, controlled, and randomized clinical trial involving 34 primary health care centers within the Madrid Health Service (Spain). Smokers over the age of 18 years who attended on-site consultation and accepted help to quit tobacco were recruited by their doctor or nurse and randomly allocated to receive usual care (control group [CG]) or an evidence-based chatbot intervention (intervention group [IG]). The interventions in both arms were based on the 5A's (ie, Ask, Advise, Assess, Assist, and Arrange) in the US Clinical Practice Guideline, which combines behavioral and pharmacological treatments and is structured in several follow-up appointments. The primary outcome was continuous abstinence from smoking that was biochemically validated after 6 months by the collaborators. The outcome analysis was blinded to allocation of patients, although participants were unblinded to group assignment. An intention-to-treat analysis, using the baseline-observation-carried-forward approach for missing data, and logistic regression models with robust estimators were employed for assessing the primary outcomes.

Results: The trial was conducted between October 1, 2018, and March 31, 2019. The sample included 513 patients (242 in the IG and 271 in the CG), with an average age of 49.8 (SD 10.82) years and gender ratio of 59.3% (304/513) women and 40.7% (209/513) men. Of them, 232 patients (45.2%) completed the follow-up, 104/242 (42.9%) in the IG and 128/271 (47.2%) in the CG. In the intention-to-treat analysis, the biochemically validated abstinence rate at 6 months was higher in the IG (63/242, 26%) compared with that in the CG (51/271, 18.8%; odds ratio 1.52, 95% CI 1.00-2.31; P=.05). After adjusting for basal CO-oximetry and bupropion intake, no substantial changes were observed (odds ratio 1.52, 95% CI 0.99-2.33; P=.05; pseudo-R2=0.045). In the IG, 61.2% (148/242) of users accessed the chatbot, average chatbot-patient interaction time was 121 (95% CI 121.1-140.0) minutes, and average number of contacts was 45.56 (SD 36.32).

Conclusions: A treatment including a chatbot for helping with tobacco cessation was more effective than usual clinical practice in primary care. However, this outcome was at the limit of statistical significance, and therefore these promising results must be interpreted with caution.

Trial registration: Clinicaltrials.gov NCT03445507; https://tinyurl.com/mrnfcmtd.

International registered report identifier (irrid): RR2-10.1186/s12911-019-0972-z.

Keywords: artificial intelligence; chatbot; dialog systems; mHealth; primary care; smartphone use; smoking; tobacco; tobacco cessation.

Conflict of interest statement

Conflicts of Interest: JFA-T, EO-E, and CM-L designed the chatbot and own the intellectual property rights. The remaining research team members (authors, developers, and sponsors) were not involved in the development of the intervention.

©Eduardo Olano-Espinosa, Jose Francisco Avila-Tomas, Cesar Minue-Lorenzo, Blanca Matilla-Pardo, María Encarnación Serrano Serrano, F Javier Martinez-Suberviola, Mario Gil-Conesa, Isabel Del Cura-González, Dejal@ Group. Originally published in JMIR mHealth and uHealth (https://mhealth.jmir.org), 27.06.2022.

Figures

Figure 1
Figure 1
Study Flowchart.

References

    1. World Health Organization Tobacco: Key Facts. World Health Organization. 2019. Mar 9, [2022-05-28]. .
    1. Clinical Practice Guideline Treating Tobacco UseDependence 2008 Update Panel‚ Liaisons‚Staff A clinical practice guideline for treating tobacco use and dependence: 2008 update. A U.S. Public Health Service report. Am J Prev Med. 2008 Aug;35(2):158–76. doi: 10.1016/j.amepre.2008.04.009. S0749-3797(08)00332-2
    1. Aveyard P, West R. Managing smoking cessation. BMJ. 2007 Jul 07;335(7609):37–41. doi: 10.1136/bmj.39252.591806.47. 335/7609/37
    1. Olano-Espinosa E. Efectividad de la formación sobre abordaje del tabaquismo en los profesionales sanitarios de Atención Primaria de Salud: un ensayo clínico aleatorizado y controlado [dissertation] Departamento de Medicina Interna, Universidad Complutense de Madrid. 2011. [2021-06-06]. .
    1. Bartsch Anna-Lena, Härter Martin, Niedrich Jasmin, Brütt Anna Levke, Buchholz Angela. A Systematic Literature Review of Self-Reported Smoking Cessation Counseling by Primary Care Physicians. PLoS One. 2016;11(12):e0168482. doi: 10.1371/journal.pone.0168482. PONE-D-16-21402
    1. Hedman Linnea, Katsaounou Paraskevi A, Filippidis F, Ravara S, Lindberg A, Janson C, Gratziou C, Rohde G, Kyriakos C, Mons U, Fernández Esteve, Trofor A, Demjén Tibor, Przewoźniak K, Tountas Y, Fong G, Vardavas C, EUREST-PLUS consortium Receiving support to quit smoking and quit attempts among smokers with and without smoking related diseases: Findings from the EUREST-PLUS ITC Europe Surveys. Tob Induc Dis. 2018;16:A14. doi: 10.18332/tid/102787. A14
    1. Saito A, Nishina M, Murai K, Mizuno A, Ueshima F, Makiishi T, Ichinohe T. Health professional's perceptions of and potential barriers to smoking cessation care: a survey study at a dental school hospital in Japan. BMC Res Notes. 2010 Dec 07;3(1):329. doi: 10.1186/1756-0500-3-329. 1756-0500-3-329
    1. Taylor G, Dalili M, Semwal M, Civljak M, Sheikh A, Car J. Internet-based interventions for smoking cessation. Cochrane Database Syst Rev. 2017 Sep 04;9:CD007078. doi: 10.1002/14651858.CD007078.pub5.
    1. WHO Global Observatory for eHealth . WHO. Geneva, Switzerland: World Health Organization; 2011. [2022-05-31]. MHealth: new horizons for health through mobile technologies. .
    1. Global System for Mobile Communications Association (GSMA) The Mobile Economy Report. GSMA. [2021-05-29]. .
    1. Abroms LC, Lee Westmaas J, Bontemps-Jones J, Ramani R, Mellerson J. A content analysis of popular smartphone apps for smoking cessation. Am J Prev Med. 2013 Dec;45(6):732–6. doi: 10.1016/j.amepre.2013.07.008. S0749-3797(13)00479-0
    1. Verheijden MW, Jans MP, Hildebrandt VH, Hopman-Rock M. Rates and determinants of repeated participation in a web-based behavior change program for healthy body weight and healthy lifestyle. J Med Internet Res. 2007 Jan 22;9(1):e1. doi: 10.2196/jmir.9.1.e1. v9i1e1
    1. National Institute for Health and Care Excellence (NICE) NICE Guideline [NG183]: Behaviour Change: Digital and Mobile Health Interventions. National Institute for Health and Care Excellence (NICE) 2020. Oct, [2022-05-28]. .
    1. Whittaker R, McRobbie H, Bullen C, Rodgers A, Gu Y, Dobson R. Mobile phone text messaging and app-based interventions for smoking cessation. Cochrane Database Syst Rev. 2019 Oct 22;10:CD006611. doi: 10.1002/14651858.CD006611.pub5.
    1. Cobos-Campos R, de Lafuente Arantza Sáez, Apiñaniz Antxon, Parraza N, Llanos Iraida Pérez, Orive G. Effectiveness of mobile applications to quit smoking: Systematic review and meta-analysis. Tob Prev Cessat. 2020;6:62. doi: 10.18332/tpc/127770. 62
    1. Fred Hutchinson Cancer Research Center Full Scale Randomized Trial of an Innovative Conversational Agent for Smoking Cessation (QuitBot) . 2020. [2021-01-06]. .
    1. Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche Peter C, Devereaux PJ, Elbourne D, Egger M, Altman DG. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010 Mar 23;340(mar23 1):c869–c869. doi: 10.1136/bmj.c869.
    1. Turner L, Shamseer L, Altman D, Weeks L, Peters J, Kober T, Dias S, Schulz K, Plint A, Moher D. Consolidated standards of reporting trials (CONSORT) and the completeness of reporting of randomised controlled trials (RCTs) published in medical journals. Cochrane Database Syst Rev. 2012 Nov 14;11:MR000030. doi: 10.1002/14651858.MR000030.pub2.
    1. Avila-Tomas JF, Olano-Espinosa E, Minué-Lorenzo C, Martinez-Suberbiola FJ, Matilla-Pardo B, Serrano-Serrano ME, Escortell-Mayor E, Group Dej@lo Effectiveness of a chat-bot for the adult population to quit smoking: protocol of a pragmatic clinical trial in primary care (Dejal@) BMC Med Inform Decis Mak. 2019 Dec 03;19(1):249. doi: 10.1186/s12911-019-0972-z. 10.1186/s12911-019-0972-z
    1. West RHP, Hajek Peter, Stead Lindsay, Stapleton John. Outcome criteria in smoking cessation trials: proposal for a common standard. Addiction. 2005 Mar;100(3):299–303. doi: 10.1111/j.1360-0443.2004.00995.x.ADD995
    1. Stolk E, Ludwig K, Rand K, van Hout B, Ramos-Goñi Juan Manuel. Overview, Update, and Lessons Learned From the International EQ-5D-5L Valuation Work: Version 2 of the EQ-5D-5L Valuation Protocol. Value Health. 2019 Jan;22(1):23–30. doi: 10.1016/j.jval.2018.05.010. S1098-3015(18)36164-3
    1. Minué-Lorenzo César, Olano-Espinosa E, Del Cura-González Isabel, Vizcaíno-Sánchez Jose M, Camarelles-Guillem F, Granados-Garrido J, Ruiz-Pacheco M, Gámez-Cabero M Isabel, Martínez-Suberviola F Javier, Serrano-Serrano E. Subsidized pharmacological treatment for smoking cessation by the Spanish public health system: A randomized, pragmatic, clinical trial by clusters. Tob Induc Dis. 2019 Sep 5;17(September):64. doi: 10.18332/tid/111368. 64
    1. Perski O, Crane D, Beard E, Brown J. Does the addition of a supportive chatbot promote user engagement with a smoking cessation app? An experimental study. Digital Health. 2019 Sep 30;5:205520761988067. doi: 10.1177/2055207619880676.
    1. Bricker JB, Watson NL, Mull KE, Sullivan BM, Heffner JL. Efficacy of Smartphone Applications for Smoking Cessation: A Randomized Clinical Trial. JAMA Intern Med. 2020 Nov 01;180(11):1472–1480. doi: 10.1001/jamainternmed.2020.4055. 2770816
    1. Pallejà-Millán Meritxell, Rey-Reñones Cristina, Barrera Uriarte ML, Granado-Font E, Basora J, Flores-Mateo G, Duch J. Evaluation of the Tobbstop Mobile App for Smoking Cessation: Cluster Randomized Controlled Clinical Trial. JMIR Mhealth Uhealth. 2020 Jun 26;8(6):e15951. doi: 10.2196/15951. v8i6e15951
    1. BinDhim NF, McGeechan K, Trevena L. Assessing the effect of an interactive decision-aid smartphone smoking cessation application (app) on quit rates: a double-blind automated randomised control trial protocol. BMJ Open. 2014 Jul 18;4(7):e005371. doi: 10.1136/bmjopen-2014-005371. bmjopen-2014-005371
    1. Baskerville NB, Struik LL, Guindon GE, Norman CD, Whittaker R, Burns C, Hammond D, Dash D, Brown KS. Effect of a Mobile Phone Intervention on Quitting Smoking in a Young Adult Population of Smokers: Randomized Controlled Trial. JMIR Mhealth Uhealth. 2018 Oct 23;6(10):e10893. doi: 10.2196/10893. v6i10e10893

Source: PubMed

3
Tilaa