If you don't remember your password, you can reset it by entering your email address and clicking the Reset Password button. You will then receive an email that contains a secure link for resetting your password
If the address matches a valid account an email will be sent to __email__ with instructions for resetting your password
Division of General Internal Medicine, Department of Medicine, Massachusetts General Hospital, United States of AmericaTobacco Research and Treatment Center, Massachusetts General Hospital, United States of AmericaHarvard Medical School, United States of America
Division of General Internal Medicine, Department of Medicine, Massachusetts General Hospital, United States of AmericaTobacco Research and Treatment Center, Massachusetts General Hospital, United States of America
Tobacco Research and Treatment Center, Massachusetts General Hospital, United States of AmericaHarvard Medical School, United States of AmericaDepartment of Psychiatry, Massachusetts General Hospital, United States of AmericaHealth Policy Research Center, Massachusetts General Hospital, United States of America
Tobacco Research and Treatment Center, Massachusetts General Hospital, United States of AmericaHarvard Medical School, United States of AmericaHealth Policy Research Center, Massachusetts General Hospital, United States of AmericaHealth Promotion Research Center, Stephenson Cancer Center, University of Oklahoma Health Sciences Center, United States of America
Division of General Internal Medicine, Department of Medicine, Massachusetts General Hospital, United States of AmericaTobacco Research and Treatment Center, Massachusetts General Hospital, United States of AmericaHarvard Medical School, United States of America
Division of General Internal Medicine, Department of Medicine, Massachusetts General Hospital, United States of AmericaTobacco Research and Treatment Center, Massachusetts General Hospital, United States of AmericaHarvard Medical School, United States of AmericaHealth Policy Research Center, Massachusetts General Hospital, United States of America
A SMART combining SMS, NRT, and coaching was feasible among primary care patients.
•
Satisfaction with the adaptive interventions was especially high with brief coaching.
•
A trial of sequential treatment including SMS and NRT shows promise.
Abstract
Introduction
Sequential multiple assignment randomized trials (SMART) inform the design of adaptive treatment interventions. We tested the feasibility of a SMART to deliver a stepped-care intervention among primary care patients who smoked daily.
Methods
In a 12-week pilot SMART (NCT04020718), we tested the feasibility of recruiting and retaining (>80 %) participants to an adaptive intervention starting with cessation text messages (SMS). The study randomly assigned participants (R1) to assessment of quit status, the tailoring variable, after either 4 or 8 weeks of SMS. The study offered continued SMS alone to those reporting abstinence. Those reporting smoking were randomized (R2) to SMS + mailed NRT or SMS + NRT + brief telephone coaching.
Results
During Jan–March and July–Aug 2020, we enrolled 35 patients (>18 years) from a primary care network in Massachusetts. Two (6 %) of 31 participants reported seven-day point prevalence abstinence at their tailoring variable assessment. The 29 participants who continued to smoke at 4 or 8 weeks were randomized (R2) to SMS + NRT (n = 16) or SMS + NRT + coaching (n = 13). Thirty of 35 participants (86 %) completed 12-weeks; 13 % (2/15) of those in 4-week group and 27 % (4/15) of those in 8-week group had CO < 6 ppm at 12-weeks (p = 0.65). Among 29 participants in R2, one was lost to follow-up, 19 % (3/16) of the SMS + NRT group had CO < 6 ppm vs. 17 % (2/12) of SMS + NRT + coaching (p = 1.00). Treatment satisfaction was high (93 %, 28 of 30 who completed 12-weeks).
Conclusions
A SMART exploring a stepped-care adaptive intervention combining SMS, NRT, and coaching for primary care patients was feasible. Retention and satisfaction were high and quit rates were promising.
We have effective treatments to help the 37.8 million Americans who smoke cigarettes, including medications and behavioral treatment, that can double the chances of quitting (
). We need new models to increase the reach of cessation treatment services with minimal burden to busy primary care providers (PCPs).
One promising model is an adaptive treatment model. For many chronic conditions, clinical management is sequential, adding or changing medications or behavioral treatments based on patients' response or changing needs over time. Treatment strategies that are responsive to patients' needs are more likely to be effective than static treatment programs (
A SMARTTT approach to treating tobacco use disorder in persons with HIV (SMARTTT): Rationale and design for a hybrid type 1 effectiveness-implementation study.
QuitSMART Utah: An implementation study protocol for a cluster-randomized, multi-level Sequential Multiple Assignment Randomized Trial to increase Reach and Impact of tobacco cessation treatment in community health centers.
). SMS have potential as a convenient initial treatment to engage primary care patients in taking action to quit. Yet we need to understand how SMS can be effectively combined with other evidence-based treatments.
Adaptive treatment programs could conserve costlier resources, such as coaches or counselors, for only those patients who need or are ready for them. Designing these programs requires answers to questions about how and when to assess an individual's response to tobacco cessation treatment and what to do next for those who need more help. For example, little data exist to inform whether patients should be followed-up quickly to enable rapid treatment changes for insufficient response, or if individuals are more successful if given more time to carry out a quit attempt before being offered a change.
The objective of this study is to understand the feasibility of answering these questions about adaptive treatment models for smoking cessation using a pilot sequential multiple assignment randomized trial (SMART). The SMART is a tool for testing treatment programs that adapt based on user response (
). This article reports on the feasibility of a SMART designed to test the timing of offering nicotine replacement therapy (NRT) and/or coaching to primary care patients who agree to participate in a stepped-care intervention starting with a cessation SMS program. The SMART compared the offer of NRT or NRT + coaching after 4 versus 8 weeks of an SMS program.
2. Methods
2.1 Study design
We conducted a 12-week, open-label pilot SMART with embedded qualitative exit interviews. Feasibility of the trial methods and acceptability of treatment were measured through recruitment rates, retention (>80 %), treatment engagement, and user satisfaction (>90 %). The SMART was designed to test the feasibility of comparing different timings for offering NRT to patients who started an SMS program and the benefit of the additional offer of a live interaction via brief telephone coaching (Fig. 1). We randomized participants to two different timings (R1) and two different NRT treatment packages (R2). We designed the treatment interventions based on the four elements of an adaptive intervention: decision stages, treatment options, tailoring variables, and a decision rule (
). We designed an intervention with one decision stage, the 4- or 8-week timepoint at which participants who continue to smoke are offered additional treatment. The treatment options are continued SMS, continued SMS + NRT, or continued SMS + NRT and telephone coaching. Almirall et al. describe baseline tailoring variables and intermediate tailoring variables (
). We used an intermediate tailoring variable, measured during the study, defined as whether participants reported 7-day abstinence at their decision stage. The decision rule that links the tailoring variable to the treatment options is offering additional treatment with NRT or offering additional treatment with NRT and coaching for those who report continued smoking at their decision stage. The choice of starting with a low-intensity, evidence-based treatment is based on stepped-care models. These models have been used for treatment of alcohol use disorder, which faces similar patterns of underutilization of evidence-based treatments as tobacco (
). Stepped-care models prioritize engagement first, with low-cost, highly scalable, and low burden treatments such as digital health interventions, before escalating to more intensive treatment (
Figure abbreviations: MGH MRN = Massachusetts General Hospital Medical Record Number; R1 = first randomization; R2 = second randomization; LTFU = lost to follow-up; 7-day PPA = 7-day point prevalence abstinence; NRT = nicotine replacement therapy.
Pilot trial participants had access to the SMS program throughout the 12-week study. The pilot used embedded semi-structured telephone interviews to examine participants' experiences with study methods and treatments. The Mass General Brigham Institutional Review Board approved the study (2017P000960).
2.2 Recruitment
The study recruited participants through an institutional study recruitment website and proactive outreach to patients listed as current smokers in the Electronic Health Record (EHR) who had previously consented to be contacted directly for research studies. Our pilot study sample size was based on evaluating the feasibility and acceptability of the trial design and was not powered to measure treatment effects (
). Eligible participants met the following inclusion criteria: (1) ≥18 years, (2) current daily smoker in the EHR, confirmed by self-report, (3) preferred language of English in EHR, (4) primary care provider (PCP) within the primary care network, (5) visit in the last two years, (6) mobile number listed in EHR, (7) not currently pregnant, planning to become pregnant in the next three months or breastfeeding, (8) no past 30-day smoking cessation treatment use, (9) no contraindications to NRT, (10) no diagnosis of dementia, active psychosis or schizoaffective disorder based on chart review or self-report, and (11) willing to receive text messages.
2.3 Randomizations
Study staff told participants about the random assignment procedures during informed consent. Following verbal informed consent and baseline assessment, the study randomly assigned participants (R1) using a computer-generated sequence to early (4-week) assessment or late (8-week) assessment of response. At the 4- or 8-week assessment time, the study asked users about tobacco use (the tailoring variable). Those who reported abstinence from cigarettes for the past seven days were offered to continue with the SMS program. Those who were still smoking at the 4- or 8-week assessment were randomized a second time (R2). At R2, the study randomized participants to continued SMS + NRT or continued SMS + NRT + one live telephone coaching session. Participants were informed about the random assignment procedures during informed consent. The sequence was not visible to the research coordinator prior to assignment.
2.4 Interventions
2.4.1 SMS program
The initial treatment at R1 consisted of an SMS program. Study staff entered participants' phone numbers into a messaging platform following enrolment and study consent (Mobile Commons, Upland Software). SMS content is described in prior work (
). Briefly, the messages are targeted to primary care patients with information about treatment resources in their primary care network. All participants started with a welcome message that included predetermined keywords that participants could use to opt-in to one of two message campaigns the “Ready” campaign or the “Practice” campaign. Participants who opted into the “Ready” campaign were prompted to enter a quit date within the next 30 days. “Ready” messages were developed with content adapted from the National Cancer Institute's SmokefreeTXT program (
). In the IMB model, information relevant to medication adherence may facilitate or hinder adherence and may include, for example, how to take medications or adverse effects. Motivation to adhere to medications encompasses both personal and social motivations and may include beliefs about the effects of adherence and perceived social support. Behavioral skills include self-efficacy and the abilities needed to acquire and use medication, deal with adverse effects, and communicate with health care providers. Users without a quit date who opted for the “Practice” campaign were encouraged to practice quitting (
). Practice quitting is explained as an attempt to not smoke for hours or days without committing to permanently quit. Both campaigns sent weekly messages to assess smoking status. If smokers with a quit date had not quit, they could either transfer to the “Practice” campaign or reset their quit date. Smokers in the “Practice” campaign could either practice again or transfer to the “Ready” campaign. Participants could repeat either campaign as many times as they choose. Both campaigns included two-way interaction using keywords “CRAVE” “SLIP” and “MOOD”, a trivia game for distraction, and weekly smoking status assessments.
The study also adapted the messages for the pandemic. After implementation of a stay-at-home advisory in Massachusetts, we edited message content to remove messages that encouraged activities inconsistent with social distancing recommendations. In their place we included messages with self-care tips, messages of encouragement acknowledging the increased stress many participants could be facing, and messages to address boredom and stress during the pandemic.
Participants received between 0 and 5 SMS per day from a library of 144 total messages. The “Practice” campaign included 33 days of unique content. The “Ready” campaign had 72 days' of unique content. Individual's time in the program varied depending on number of times they repeated campaigns or transferred between “Ready” and “Practice”. All participants could opt-out of the SMS at any time during the 12-week study by texting the keyword “STOP”.
2.4.2 Adaptative treatment options
The study randomized all participants reporting continued smoking at the 4- or 8-week assessment a second time (R2) to an offer of SMS + NRT or SMS + NRT + coaching. NRT consisted of a 4-week supply of combination NRT. Participants could choose from patches and/or mint-flavored mini lozenges. Smokers who smoked ≥10 cigarettes per day at baseline were offered 21 mg patches and those who smoked <10 cigarettes per day were offered 14 mg patches. Participants who smoked within 30 min of awakening were offered the 4 mg lozenges and those who smoked >30 min of awakening were offered 2 mg lozenges. NRT was delivered by mail to participants' homes. Participants randomized to NRT + coaching were also offered one telephone coaching session. The single coaching session was intended to enhance the behavioral support provided through the SMS with a live-person interaction. The scripted coaching session was provided by a research coordinator who completed Tobacco Treatment Specialist Core Certificate training (
). We designed the coaching sessions to last up to 15 min and provided information on local resources and smoking cessation medications. Both R2 groups (NRT or NRT + coaching) continued the SMS program with the addition of daily interactive SMS messages querying their NRT use.
3. Data collection/assessments
The study collected measures by telephone or email survey, depending on participant preferences, at baseline, 4-, 8- and 12-weeks post-enrollment. Surveys were conducted by the study's research coordinator who was not blinded to treatment assignment.
The baseline survey was completed by telephone at enrollment. The study collected baseline data to understand the pilot study sample recruited for this fully remote stepped-care intervention and included predictors of cessation including sociodemographic measures, smoking characteristics, prior quit attempts, cessation treatment use, emotional symptoms, past month substance use and self-reported SMS use.
Follow-up surveys measured smoking status, treatment use, and satisfaction. Outcomes were pre-specified (NCT04020718). Participants reporting seven-day point prevalence abstinence (7-day PPA) at 12-weeks were asked to provide a carbon monoxide (CO) measurement using the iCO Smokerlyzer (
) device. They received a device in the mail, instruction to download the Smokerlyzer application, and to email their reading to the research coordinator.
All participants were invited to participate in a semi-structured telephone interview following the 12-week outcome survey. The study compensated participants for their time using gift cards as follows: $20 for completing the baseline, 4- and 8-week surveys, $40 for the 12-week outcome survey, $20 for the qualitative interview, and $80 for emailing the CO measure among those who reported 7-day PPA at 12-weeks.
3.1 Feasibility outcomes
Feasibility of the SMART design was assessed by the proportion of potentially eligible patients reached, proportion enrolled and randomized, and retention in the 12-week study.
3.2 Intervention fidelity
To assess the fidelity of the SMS intervention we measured: 1) participants' use of the HELP function as an indicator of technical challenges with the program, and 2) number of intended messages that failed to send.
3.3 Intervention engagement
Engagement with the SMS intervention was captured by the messaging platform. Measures of engagement included: number of messages sent to participant, active time defined as number of days from first incoming SMS from participant to last SMS from participant, number of incoming messages sent from the participant, number of embedded URL links clicked, and number of NRT query messages responded to. We measured engagement with NRT by any patch use or lozenge use reported in follow-up surveys and NRT use reported by SMS query. The study measured engagement with telephone coaching by participation in and duration of the coaching session per coach records.
3.4 Treatment acceptability
At 12-weeks, we measured treatment acceptability by four-point Likert scale rating satisfaction with study treatments. Participants also rated their agreement, on a five-point Likert scale ranging from “Completely agree” to “Completely disagree”, with statements that the study gave participants confidence to quit, made them feel quitting is worthwhile, made them feel as if someone cared if they quit, and that they knew the right steps to take to quit (
Although not powered to assess differences by study arm, we defined a primary clinical outcome of self-reported 7-day PPA at 12-weeks. We defined 7-day PPA as not smoking even a puff in the past 7 days. Other clinical outcomes included 7-day PPA at 4- and 8-weeks, number of last 30 days with no smoking, use of cessation treatments and changes between baseline and 12-weeks in cigarettes per day, motivation, confidence to quit and distress. We measured biochemically verified abstinence by expired CO <6 parts per million (ppm) among participants who reported 7-day PPA at 12-weeks (
The study conducted interviews after the 12-week outcome survey. The brief interviews were recorded and transcribed. The research team developed the interview guide with attention to the participants' experience with study treatments including the SMS, NRT and coaching. During the pandemic, we revised these to explore smoking and quitting behaviors (
Our pilot sample size was based on the probability of having patients in all six treatment subgroups to assess the feasibility of a larger-scale SMART. With 30 patients randomized one-to-one in R1 (Fig. 1), we expected three patients in the smallest subgroup (
). However, using a method by Almirall et al., the probability of reaching this minimum subgroup size by randomization was only 59 %, therefore we aimed to enroll 35 patients to reach a 70 % probability of having at least three patients per subgroup (
Adherence and engagement with SMS and acceptability were calculated and reported with 95 % confidence intervals. Smoking cessation outcomes were compared by early versus late assessment of response (R1) and NRT versus NRT + coaching (R2) using Fisher's exact tests and t-tests. We tested for interaction between the two treatment factors (early/late and NRT/NRT + coaching) on categorical and continuous smoking outcomes using Cochran-Mantel-Haenszel test and ANOVA, respectively. We performed all analyses using SAS software V.9.4 (SAS Institute, Cary, North Carolina, USA).
4.3 Qualitative analysis
The study analyzed qualitative interviews using NVivo 12 software (
). An initial coding scheme was developed using a priori constructs from the semi-structured guide plus emergent themes from the transcribed data. Investigators applied this coding scheme to a subset of interviews in an iterative process to develop a final coding scheme. The team used the constant comparative method to promote validity (
). Coding was at the sentence level with multiple codes permitted for each sentence. All transcripts were double coded and compared, reaching a high degree of intercoder reliability (kappa ≥ 0.8). Themes were developed through analysis of codes to identify emergent patterns using matrix coding by treatment group.
5. Results
5.1 Feasibility
During two phases of recruitment (Jan-March & July-Aug 2020) we enrolled and randomized 35 participants (Supplemental Fig. A). In terms of reach, 35 (34 %, 95 % CI [24.9, 44.0]) of 103 eligible patients agreed to participate and were randomized. This included 25 participants recruited in the first phase and 10 in the second. Recruitment was paused from March–July 2020 to modify our SMS intervention with social distancing recommendations and to update study procedures for research staff to work remotely.
Study retention at 12 weeks was 86 % (30 completed, two withdrew, three lost to follow-up [LTFU]; 95 % CI [69.7, 95.2]) (Fig. 1). Excluding n = 2 withdrew and n = 2 LTFU before the R1 assessment, 6 % (2/31) self-reported 7-day PPA by the time of the R1 assessment when receiving SMS alone. In R2, the 29 participants who reported continued smoking were randomized again [16 to NRT and 13 to NRT + coaching]. Table 1 shows sample characteristics for n = 33 participants (excluding n = 2 withdrawn).
Table 1Baseline characteristics by randomization, N = 33.
Primary care validation of a single-question alcohol screening test.
Journal of General Internal Medicine.2009; 24 (Epub 2009 Feb 27. Erratum in: J. Gen. Intern. Med. 2010 Apr;25(4):375. PMID: 19247718; PMCID: PMC2695521): 783-788https://doi.org/10.1007/s11606-009-0928-6
Thirteen percent (n = 4) of participants used the keyword HELP. Message failures occurred with four of 33 participants (2 messages failed/127 total messages, 92/239, 71/184, 2/85). The two participants with 92 and 71 failed messages (97.6 % of the total failed messages) reported their phone plans were disconnected for up to three weeks during the study.
5.3 Intervention engagement
We show measures of SMS engagement in Table 2a. Active days in the program, messages sent by the participant, and responses to NRT queries did not differ between groups. After entering an initial quit date in the program, one person in the 4-week assessment group reset their quit date and six in the 8-week assessment group reset their quite date during the study.
Table 2aEngagement with text message (SMS) intervention by early vs. late assessment (N = 33).
Engagement with NRT treatment following R2 is displayed in Table 2b. Any NRT use during the study was reported by 87.5 % (n = 14, 95 % CI [61.7, 98.5]) of participants randomized to NRT and 84.6 % (n = 11, 95 % CI [54.6, 98.1]) of participants randomized to NRT + coaching (p = 1.00). Telephone coaching, averaging 12.8 min (SD 3.8) in duration, was delivered to 92.3 % (n = 12, 95 % CI [64.0, 99.8]; n = 1 declined coaching) of participants in the NRT + coaching group. On average, coaching occurred 1.2 days after R2.
Table 2bEngagement with NRT and telephone coaching (N = 29).
Overall, 93.3 % (n = 28, 95 % CI [77.9, 99.2]) of the 30 participants who completed the 12-week survey reported being somewhat or very satisfied with their treatment (Table 3). Selecting “Somewhat” or “Completely agree” with the statements that the study gave them confidence to quit, made quitting feel worthwhile, made them feel that someone cared, and that they knew the right steps to take to quit did not differ by group.
At 12-weeks, 13 % (n = 2) of the 4-week group and 33 % (n = 5) in the 8-week assessment reported 7-day PPA (p = 0.39), and 13 % (n = 2) and 27 % (n = 4) had CO < 6 ppm, respectively (Table 3). Of those mailed NRT (R2), 19 % (n = 3) had CO < 6 ppm without coaching vs. 17 % (n = 2) with coaching (p = 1.00). Participants with CO < 6 ppm were active in the SMS program for longer (87.8 vs. 71.2 days) and sent more texts back to the program (56.5 messages vs. 30.7 messages).
5.6 Treatment component interaction
ANOVA models and Cochran-Mantel-Haenszel tests of smoking cessation and treatment use outcomes did not show a significant interaction between 4- versus 8-week assessment and NRT versus NRT + coaching except for the outcome of change in importance of quitting. Importance of quitting decreased, on average in both early (mean change −0.4, 95 % CI [−1.4, 0.6]) and late assessment groups (mean change −0.8, 95 % CI [−1.7, 0.1]). Within assessment groups, those randomized to NRT + coaching had a decrease in importance of quitting in the early assessment participants (−2.0, 95 % CI [−4.3, 0.3]) and a small increase in importance of quitting in Late assessment participants (0.1, 95 % CI [−0.2, 0.5]) (p < 0.001).
5.7 Qualitative treatment experience
Most participants viewed the SMS favorably. Many participants reported that the messages made them feel supported and kept them on track. In terms of the adaptive treatment program, participants described how the SMS reinforced other treatment components.“Both the information in the texts and from the coaching session that I got where the smoking coach, you, had said to me, ‘People who do one or the other in addition to just willpower succeed at a higher rate.’ So, both the text messages reinforced that positive benefit, and your coaching session” [Late assessment/NRT + Coaching].
Participants also noted that the SMS plus other treatments together made them feel especially supported.“the whole program helped me to stop smoking. The text messages might have helped a little. The lozenges and the nicotine patches took the cravings away, so I don't think it was directly the text messages. Receiving those reminded me of the program that I was in all the time and then knowing that I was going to be talking to you, so overall, the program definitely helped me” [Early assessment/NRT].
Others mentioned how live calls with study staff led them to associate the messages with a live person which made the messages more meaningful.“Even though I know they're not, but I always thought, in the back of my mind, it was you texting, or there was someone else texting, so. So, I thought that was important because knowing that it goes to that fact that, hey, somebody cares that you're doing something, and you're worthwhile” [Late assessment, NRT].
Some participants viewed the SMS less favorably and wanted more interaction, such as having someone to connect with in the moment when they were struggling.“I didn't have the option to—not that you have to reply, but you can only reply with certain words and get a response back. So maybe more interactive like a actual—I don't know if it's a computer or how it works or if it's a actual person that you can text back at midnight like, ‘I'm just getting the urge.’ …So if you have someone that you can be like, ‘Okay, I'm not thinking right,’ just like AA” [Early assessment/NRT].
6. Discussion
A SMART examining adaptive cessation treatment timing and treatment components was feasible in a sample of primary care patients who smoke daily. Treatment retention and fidelity of all interventions including SMS, NRT, and coaching, were high and smoking cessation outcomes were promising. Very few studies have tested adaptive smoking cessation treatment programs. Two other published SMART trials studied systems-level or multi-level interventions, while our study examined the feasibility of an individual-level adaptive treatment design (
QuitSMART Utah: An implementation study protocol for a cluster-randomized, multi-level Sequential Multiple Assignment Randomized Trial to increase Reach and Impact of tobacco cessation treatment in community health centers.
). Our program uptake, at 34 % among those eligible, was comparable to other proactive smoking cessation treatment models. For example, a 2014 study of VA patients who smoked found 469 (30 %) of 1556 patients proactively outreached, accepted connection with treatment (
). SMS intervention fidelity was high apart from two participants who lost phone service during the study. Retention in the 12-week study, at 86 %, was particularly promising considering the pandemic context where stress and inability to access social supports may have made quitting especially challenging (
Our preliminary cessation measures showed 7-day PPA was highest among individuals who were offered mailed NRT after 8 weeks of SMS. In terms of the timing of assessment, it may be that the longer period of time with the SMS program supported users to develop more skills to apply to their quit attempt by the time the NRT was offered. Although combined treatment with behavioral support and pharmacotherapy is best practice, we know little about whether individuals should be encouraged to start behavioral therapy or pharmacotherapy sequentially or concurrently. This pilot study demonstrates the feasibility and promise of a study design testing the effectiveness of offering digital behavioral therapy for a brief period prior to pharmacotherapy.
In terms of comparing NRT with NRT + coaching, it may be that more intensive telephone coaching, which was beyond the resources of this pilot study, is needed to improve cessation outcomes for those who need more help (
). Although the addition of brief coaching did not yield improved cessation outcomes, it is notable that 100 % of those in the NRT + coaching groups reported satisfaction with treatment, that the study made quitting feel worthwhile, and that they knew the steps to take to quit.
Most participants agreed that the study gave them confidence to quit, made quitting feel worthwhile, made them feel someone cared, and made them feel they knew the right steps to take. These responses suggest that with a program that starts with SMS may promote self-efficacy, motivation, and improve participants' behavioral skills to quit. Our qualitative results suggest the addition of the live interaction may complement the SMS in enhancing perceptions of social support. A primary care peer navigator or case manager could serve in this role, but further research is needed to measure the added effects of a program with live interaction versus a fully automated intervention. Cost is also an important consideration in designing adaptive interventions where more expensive interventions could be reserved for only those who need them. A recent cost-effectiveness study of NRT sampling, a potential alternative initial treatment to SMS in a stepped-care intervention, measured NRT sampling costs at $75 per person (
Our study had several limitations. The study relied on self-report alone to assess smoking status at baseline, 4- and 8-weeks. The study may have misclassified smoking status at R1 or R2. The research coordinator was unblinded and this could also introduce bias. The majority of participants were white and highly educated, which limits the generalizability of this single-site study. This pilot study period was insufficient to assess long-term smoking abstinence. However, 12-week cessation rates were encouraging, particularly given the low confidence in quitting in our sample and the study timeframe overlapping with the early COVID-19 pandemic. The pandemic context may also have produced different treatment experiences for some patients, particularly older patients, as we report separately (
). With our small sample size in this proof of concept pilot we were not powered to measure differences in cessation outcomes by study arm. However, participants completed study activities in five of the six outcome groups, demonstrating the feasibility of the sequential randomization methods and excellent retention rates (>80 %).
7. Conclusion
A SMART examining an adaptive treatment regimen combining SMS, NRT, and coaching for primary care patients who had high importance of quitting but only moderate confidence during the COVID-19 pandemic was feasible. The treatment program overall produced promising effects on cessation. Retention and satisfaction with the adaptive treatment model were high and quit rates were promising at 12 weeks. Our qualitative results suggested live interactions during the study may have conferred social support, but we saw no differences in the NRT + coaching arm versus NRT only. Our pilot results support the feasibility of this adaptive tobacco cessation treatment model and highlight the need to understand how to best tailor combination treatments to meet the changing needs of primary care patients, and to compare efficient, convenient automated interventions with interventions involving live interactions, in primary care settings.
The following are the supplementary data related to this article.
This work is funded by the Massachusetts General Hospital Department of Medicine Transformative Scholars Award and the National Institute on Drug Abuse K23 DA038717.
CRediT authorship contribution statement
G.R. Kruse: Conceptualization, Methodology, Writing – original draft, Supervision, Formal analysis, Funding acquisition. A. Joyce: Data curation, Writing – review & editing, Investigation, Formal analysis. L. Yu: Data curation, Formal analysis, Investigation. E.R. Park: Conceptualization, Methodology, Writing – review & editing, Supervision. J. Neil: Conceptualization, Methodology, Writing – review & editing. Y. Chang: Data curation, Investigation, Formal analysis, Methodology, Writing – review & editing. N.A. Rigotti: Conceptualization, Writing – review & editing, Methodology, Supervision.
Declaration of competing interest
GK has a family financial interest in a mobile health company, Dimagi, Inc.
References
Almirall D.
Compton S.N.
Gunlicks-Stoessel M.
Duan N.
Murphy S.A.
Designing a pilot sequential multiple assignment randomized trial for developing an adaptive treatment strategy.
A SMARTTT approach to treating tobacco use disorder in persons with HIV (SMARTTT): Rationale and design for a hybrid type 1 effectiveness-implementation study.
QuitSMART Utah: An implementation study protocol for a cluster-randomized, multi-level Sequential Multiple Assignment Randomized Trial to increase Reach and Impact of tobacco cessation treatment in community health centers.
Primary care validation of a single-question alcohol screening test.
Journal of General Internal Medicine.2009; 24 (Epub 2009 Feb 27. Erratum in: J. Gen. Intern. Med. 2010 Apr;25(4):375. PMID: 19247718; PMCID: PMC2695521): 783-788https://doi.org/10.1007/s11606-009-0928-6