Advertisement
Rapid Communication| Volume 46, ISSUE 1, P15-21, January 2014

Translating SBIRT to public school settings: An initial test of feasibility

Published:September 12, 2013DOI:https://doi.org/10.1016/j.jsat.2013.08.001

      Abstract

      Public schools are not traditional locations where screening, brief motivational counseling intervention and referral to treatment (SBIRT) are provided. This translational research study aimed to test the feasibility of conducting SBIRT in two urban New York schools and to examine its economic sustainability. In Spring 2012, 248 students were screened during non-academic classes: 42% of them (n = 105) reported substance use (versus 28% reported in school-wide, paper anonymous survey). All but one of the positively screened students voluntarily accepted one or more brief intervention sessions and two students were referred to treatment. This school-based SBIRT model did not interfere with academic activities, was feasible to implement, and was attractive to students, teachers and administration. The data offer clear indication that further effectiveness testing is warranted and potentially valuable, however the sustainability of this model was not supported due to our lack of obtaining insurance information, authorization and reimbursement.

      Keywords

      1. Introduction

      Adolescence is a critical time to identify and effectively treat alcohol and other drug (AOD) use/misuse. Early AOD use in adolescence is a risk factor for adult alcohol and drug abuse/dependence (
      • DeWit D.J.
      • Adlaf E.M.
      • Offord D.R.
      • Ogborne A.C.
      Age at first alcohol use: A risk factor for the development of alcohol disorders.
      ,
      • Grant B.F.
      • Dawson D.A.
      Age at onset of alcohol use and its association with DSM-IV alcohol abuse and dependence: Results from the National Longitudinal Alcohol Epidemiologic Survey.
      ,
      • Hingson R.W.
      • Zha W.
      Age of drinking onset, alcohol use disorders, frequent heavy drinking, and unintentionally injuring oneself and others after drinking.
      ). Neuroimaging studies have reported that the developing adolescent brain is highly vulnerable to the effects of AOD particularly in the areas of cognition, motivation and impulse control (
      • Squeglia L.
      • Jacobus J.
      • Tapert S.F.
      The influence of substance use on adolescent brain development.
      ,
      • Tapert S.F.
      • Caldwell L.
      • Burke C.
      Alcohol and the adolescent brain: Human studies.
      ). Perhaps because of this, adolescents who begin drinking before age 15 are four times more likely to develop alcohol dependence than those who begin drinking at or after age 21 (
      • Grant B.F.
      • Dawson D.A.
      Age at onset of alcohol use and its association with DSM-IV alcohol abuse and dependence: Results from the National Longitudinal Alcohol Epidemiologic Survey.
      ).
      Apart from developing alcohol dependence, adolescent AOD use is associated with serious social and health consequences (e.g., automobile accidents, unintentional injuries, cognitive problems, poor academic performance, delinquency, HIV/STDs, and suicide) (
      • Ammon L.
      • Sterling S.
      • Mertens J.
      • Weisner C.
      Adolescents in private chemical dependency programs: Who are most at risk for HIV?.
      ,
      • Brown S.A.
      Measuring youth outcomes from alcohol and drug treatment.
      ,
      • Hanson K.L.
      • Medina K.L.
      • Padula C.B.
      • Tapert S.F.
      • Brown S.A.
      Impact of adolescent alcohol and drug use on neuropsychological functioning in young adulthood: 10-year outcomes.
      ,
      • Hingson R.W.
      • Zha W.
      Age of drinking onset, alcohol use disorders, frequent heavy drinking, and unintentionally injuring oneself and others after drinking.
      ,
      • National Highway Traffic Safety Administration [NHTSA]
      ,
      • Substance Abuse and Mental Health Services Administration [SAMSHA]
      Report to Congress on the Prevention and Treatment of Co-Occurring Substance Use Disorders and Mental Disorders (U.S. Department of Health and Human Services, Trans.).
      ). For all these reasons, early identification and effective treatment are essential for preventing long-term negative health and social outcomes among adolescents.

      2. Screening for risky adolescent substance use

      Screening, brief intervention and referral to treatment (SBIRT) is an evidenced-based procedure that prevents, but also identifies and reduces problematic AOD use (
      • Vaca F.E.
      • Winn D.
      The basics of alcohol screening, brief intervention and referral to treatment in the emergency department.
      ). Over three decades of SBIRT evaluations, conducted mainly with adults in medical settings, have demonstrated the effectiveness of and cost savings from SBIRT across many behavioral domains (
      • Academic E. D. Sbirt Research Collaborative
      The impact of screening, brief intervention and referral for treatment in emergency department patients' alcohol use: A 3-, 6- and 12-month follow-up.
      ,
      • Agerwala S.M.
      • McCance-Katz E.F.
      Integrating Screening, Brief Intervention, and Referral to Treatment (SBIRT) into clinical practice settings: A brief review.
      ,
      • Barnard S.
      Implementing an SBIRT (Screening, Brief Intervention, and Referral to Treatment) program in the emergency department: Challenges and rewards.
      ,
      • Cherpitel C.J.
      • Bernstein E.
      • Bernstein J.
      • Moskalewicz J.
      • Swiatkiewicz G.
      Screening, brief intervention and referral to treatment (SBIRT) in a Polish emergency room: Challenges in cultural translation of SBIRT.
      ,
      • Desy P.M.
      • Howard P.K.
      • Perhats C.
      • Li S.
      Alcohol screening, brief intervention, and referral to treatment conducted by emergency nurses: An impact evaluation.
      ,
      • Donovan J.E.
      Really underage drinkers: The epidemiology of children's alcohol use in the United States.
      ,
      • Estee S.
      • Wickizer T.
      • He L.
      • Shah M.F.
      • Mancuso D.
      Evaluation of the Washington State Screening, Brief Intervention, and Referral to Treatment Project Cost Outcomes for Medicaid Patients Screened in Hospital Emergency Departments.
      ,
      • Madras B.K.
      • Compton W.M.
      • Avula D.
      • Stegbauer T.
      • Stein J.B.
      • Clark H.W.
      Screening, brief interventions, referral to treatment (SBIRT) for illicit drug and alcohol use at multiple healthcare sites: Comparison at intake and 6 months later.
      ,
      • Vaca F.E.
      • Winn D.
      The basics of alcohol screening, brief intervention and referral to treatment in the emergency department.
      ,
      • Vaca F.E.
      • Winn D.
      • Anderson C.L.
      • Kim D.
      • Arcila M.
      Six-month follow-up of computerized alcohol screening, brief intervention, and referral to treatment in the emergency department.
      ). Among college-aged young adults and adolescents, brief interventions (BI) have demonstrated effectiveness in reducing risk of AOD dependence, alcohol consumption, and harmful behaviors (
      • Baer J.S.
      • Kivlahan D.R.
      • Blume A.W.
      • McKnight P.
      • Marlatt G.A.
      Brief intervention for heavy-drinking college students: 4-Year follow-up and natural history.
      ,
      • Borsari B.
      • Carey K.B.
      Effects of a brief motivational intervention with college student drinkers.
      ). However, systematic reviews and meta-analyses with only adolescent populations have yielded inconclusive evidence regarding its effectiveness to reduce risky alcohol use (
      • Dunn C.
      • Deroo L.
      • Rivara F.P.
      The use of brief interventions adapted from motivational interviewing across behavioral domains: A systematic review.
      ,
      • Gates S.
      • McCambridge J.
      • Smith L.A.
      • Foxcroft D.
      Interventions for prevention of drug use by young people delivered in non-school settings.
      ,
      • Yuma-Guerrero P.J.
      • Lawson K.A.
      • Velasquez M.M.
      • von Sternberg K.
      • Maxson T.
      • Garcia N.
      Screening, brief intervention, and referral for alcohol use in adolescents: A systematic review.
      ).
      Recognizing these benefits, most states have approved Medicaid codes for reimbursement of SBIRT with adolescents, and it is part of the continuum of substance abuse care—deemed “essential services”—required of all health plans as part the Patient Protection and Affordable Care Act (2010) legislation starting in 2014. Adolescent SBIRT is recommended annually by the Society for Adolescent Medicine, the Maternal Child Health Bureau, and the American Academy of Pediatrics (
      • Levy S.
      • Knight J.R.
      Screening, brief intervention, and referral to treatment for adolescents.
      ,
      • Levy S.
      • Williams J.F.
      • Knight J.R.
      Screening, brief intervention, and referral to treatment for adolescents: Companion clinical case.
      ).

      3. Computerized screening

      Computerized SBIRT is well suited for a variety of environments because it is brief and flexible in that it can be a standalone service or combined with other treatment approaches; it is interactive; and it can easily be provided in various languages. Computerized SBIRT incorporates motivational interviewing techniques and non-confrontational, patient-centered approaches to discuss sensitive behaviors and is especially appropriate for the adolescent developmental stage (
      • Gates S.
      • McCambridge J.
      • Smith L.A.
      • Foxcroft D.
      Interventions for prevention of drug use by young people delivered in non-school settings.
      ,
      • Tevyaw T.O.L.
      • Monti P.M.
      Motivational enhancement and other brief interventions for adolescent substance abuse: Foundations, applications and evaluations.
      ,
      • Vaca F.
      • Winn D.
      • Anderson C.
      • Kim D.
      • Arcila M.
      Feasibility of emergency department bilingual computerized alcohol screening, brief intervention, and referral to treatment.
      ). These computerized behavioral interventions are reported to require little time to administer, be acceptable to patients, identify at-risk and dependent drinkers, and able to provide effective personalized feedback and brief intervention (
      • Ranney M.L.
      • Choo E.K.
      • Wang Y.
      • Baum A.
      • Clark M.A.
      • Mello M.J.
      Emergency department patients' preferences for technology-based behavioral interventions.
      ; F.
      • Vaca F.
      • Winn D.
      • Anderson C.
      • Kim D.
      • Arcila M.
      Feasibility of emergency department bilingual computerized alcohol screening, brief intervention, and referral to treatment.
      ). A systematic review of 24 studies of online BI found that this mode of treatment could reduce amounts of alcohol consumed by adults and reduce binge drinking among students (
      • Khadjesari Z.
      • Murray E.
      • Hewitt C.
      • Hartley S.
      • Godfrey C.
      Can stand‐alone computer‐based interventions reduce alcohol consumption? A systematic review.
      ).

      4. SBIRT in school settings

      There is reason to think that the individualized SBIRT intervention could have greater benefits in preventing and also reducing emerging student substance use and related problems in a school setting (
      • Burrow-Sanchez J.
      • Call M.E.
      • Adolphson S.L.
      • Hawken L.S.
      School psychologists' perceived competence and training needs for student substance abuse*.
      ,
      • Burrow-Sanchez J.J.
      • Lopez A.L.
      • Slagle C.P.
      Perceived competence in addressing student substance abuse: A national survey of middle school counselors.
      ,
      • Burrow-Sanchez J.J.
      • Lundberg K.J.
      Readiness to change in adults waiting for publicly funded substance abuse treatment.
      ,
      • Madras B.K.
      • Compton W.M.
      • Avula D.
      • Stegbauer T.
      • Stein J.B.
      • Clark H.W.
      Screening, brief interventions, referral to treatment (SBIRT) for illicit drug and alcohol use at multiple healthcare sites: Comparison at intake and 6 months later.
      ,
      • Wagner E.F.
      • Dinklage S.C.
      • Cudworth C.
      • Vyse J.
      A preliminary evaluation of the effectiveness of a standardized Student Assistance Program.
      ). However, public schools are not traditional locations where SBIRT interventions are provided.
      • Mitchell S.G.
      • Gryczynski J.
      • O'Grady K.E.
      • Schwartz R.P.
      SBIRT for adolescent drug and alcohol use: Current status and future directions.
      review of adolescent SBIRT studies found only 3 of 14 studies were conducted in school settings. Nonetheless, school based interventions are more accessible than general community medical settings for adolescents (
      • Clayton S.
      • Chin T.
      • Blackburn S.
      • Echeverria C.
      Different setting, different care: Integrating prevention and clinical care in school-based health centers.
      ,
      • Wagner E.F.
      • Tubman J.G.
      • Gil A.G.
      Implementing school‐based substance abuse interventions: Methodological dilemmas and recommended solutions.
      ,
      • Weinstein J.
      School-based health centers and the primary care physician: An opportunity for collaborative care.
      ) and school health clinics are over 21 times more likely to elicit visits for behavioral health issues than are general community health clinics, particularly for minority and other “hard to reach” adolescents (
      • Juszczak L.
      • Melinkovich P.
      • Kaplan D.
      Use of health and mental health services by adolescents across multiple delivery sites.
      .
      While there have been few studies of the effectiveness of SBIRT in middle or high schools (

      Abuse, S., & Administration, M. H. S. (2009). Results from the 2008 national survey on drug use and health: national findings. Office of Applied Studies (NSDUH Series H-36, HHS Publication No. SMA 09–4434).

      ,
      • Dunn C.
      • Deroo L.
      • Rivara F.P.
      The use of brief interventions adapted from motivational interviewing across behavioral domains: A systematic review.
      ), those studies have yielded promising findings. For example, in a delayed feedback control trial with 97 adolescents participating in a school-based motivational enhancement therapy intervention to reduce marijuana use,
      • Walker D.D.
      • Roffman R.A.
      • Stephens R.S.
      • Berghuis J.
      • Kim W.
      Motivational enhancement therapy for adolescent marijuana users: A preliminary randomized controlled trial.
      found significant marijuana use reductions at 3-month follow-up for the 9th and 10th grade students who were in the preparation/action stage of change category. Similarly, a study of 79, 14–17 year old adolescents referred by school officials for alcohol or marijuana problems, compared assessment only, brief intervention only, or brief intervention plus parental involvement. The brief intervention-plus-parents group had significantly better alcohol use, binge drinking and drug use outcomes than the assessment only group, and fewer days of drinking than the brief intervention-only group (
      • Winters K.C.
      • Leitten W.
      Brief intervention for drug-abusing adolescents in a school setting.
      ). A multi-site, repeated measures study compared outcomes of 629 New Mexico high school students, who received a range of SBIRT and other support services (

      Abuse, S., & Administration, M. H. S. (2009). Results from the 2008 national survey on drug use and health: national findings. Office of Applied Studies (NSDUH Series H-36, HHS Publication No. SMA 09–4434).

      ). BI was provided to 85.1% of adolescents, while 14.9% received additional brief treatment or referral to treatment (BT/RT). Participants receiving any intervention reported significant reductions in frequency of drinking to intoxication and drug use, but not alcohol use, from baseline to 6-month follow-up. The magnitude of these reductions did not differ based on service variables.
      Despite the potential benefit of conducting SBIRT interventions in public schools, there are practical challenges. School settings are quite different from clinical settings and it is not reasonable to think that SBIRT could simply be “plugged into” an educational setting without appropriate adaptation (

      Abuse, S., & Administration, M. H. S. (2009). Results from the 2008 national survey on drug use and health: national findings. Office of Applied Studies (NSDUH Series H-36, HHS Publication No. SMA 09–4434).

      ,
      • Damschroder L.J.
      • Hagedorn H.J.
      A guiding framework and approach for implementation research in substance use disorders treatment.
      ,
      • Kilbourne A.M.
      • Neumann M.S.
      • Pincus H.A.
      • Bauer M.S.
      • Stall R.
      Implementing evidence-based interventions in health care: Application of the replicating effective programs framework.
      ,
      • Lundgren L.
      • Amodeo M.
      • Cohen A.
      • Chassler D.
      • Horowitz A.
      Modifications of evidence-based practices in community-based addiction treatment organizations: A qualitative research study.
      ,
      • Manuel J.K.
      • Hagedorn H.J.
      • Finney J.W.
      Implementing evidence-based psychosocial treatment in specialty substance use disorder care.
      ,
      • Sorensen J.L.
      • Kosten T.
      Developing the tools of implementation science in substance use disorders treatment: Applications of the consolidated framework for implementation research.
      ). One obvious problem is the need for additional training for school counselors (
      • McCambridge J.
      • Slym R.L.
      • Strang J.
      Randomized controlled trial of motivational interviewing compared with drug information and advice for early intervention among young cannabis users.
      ,
      • Winters K.C.
      • Leitten W.
      Brief intervention for drug-abusing adolescents in a school setting.
      ). For an SBIRT intervention to be effective, practical, and sustainable in a school setting, it should: (1) engender student trust and honest risk reporting; (2) use counselors specially trained in modern risk reduction and motivational interviewing techniques (
      • Miller W.R.
      • Yahne C.E.
      • Tonigan J.S.
      Motivational interviewing in drug abuse services: A randomized trial.
      ); (3) not interfere with the education of students or the operations of the school; (4) be seen as having value to teachers, school administrators, parents, and students; and (5) have a clear financial plan to sustain the program.
      With this as background, we now describe an 18-month effort to adapt and integrate an SBIRT protocol into two urban schools in New York. It should be clear that this translational research project did not seek to test the effectiveness of a school-based SBIRT program using a controlled trial; we felt that would be premature. Instead, this paper describes the development of a school-based SBIRT program and examines if such a program is feasible and sustainable. We saw this as a necessary first step toward a proper prospective evaluation of a well-functioning school-based SBIRT intervention.

      5. Materials and methods

      5.1 Study design

      This project grew out of a request from the school district's superintendent to Phoenix House (www.PhoenixHouse.org)—a well-known provider of substance abuse services—for assistance in addressing the escalating substance use problem in their middle and high schools. Phoenix House (PH) was eager to develop potent prevention and early intervention services; and had well-trained counselors capable of providing those services. To help with the SBIRT adaptation and to perform a formative evaluation of that adaptation, they contacted researchers at the Treatment Research Institute (TRI, www.tresearch.org). PH obtained an operating certificate from the New York State Office of Alcohol and Substance Abuse Services (OASAS) to develop an in-school health clinic devoted to preventing and intervening early with student substance use problems. All costs to construct and equip a licensed clinic in each of the two schools (~$50,000) were borne by Phoenix House. Data collection for the feasibility phase began in February 2012 and ended in June 2012.
      Because this project was a preliminary investigation of the feasibility and sustainability of using SBIRT in a school setting, all students received the same intervention (i.e., there was no control group). School administration and teachers agreed to allow SBIRT sessions during non-academic classes. Counselors notified teachers the day before a scheduled screen. At that time, the counselor met the student at the classroom and walked him/her to the clinic, discussing the general protocol, and the confidentiality provisions. At the clinic, students were supplied earphones, logged into the computer and given time to finish the screening questions—typically 15—20 minutes. Following the computer screening, each student was offered an opportunity to discuss their answers privately with a counselor during a 10–30 minute counseling session. Following the sessions, the counselors escorted the students back to their classrooms. The SBIRT program was provided in English and Spanish and both clinics were equipped with a Spanish-speaking counselor.

      5.2 Participants

      All 6th- to 12th-grade students in the middle and high schools who were enrolled in school during the 16-week feasibility testing period (n = 998) were eligible to participate if their parent had not declined. Thus, the study involved the full range of students attending these two schools. Students and parents were notified of the program via flyers, announcements, promotions, and advertisements that were mailed home.

      5.3 Web-based screening

      The screening instrument recommended within the New York OASAS was the six-item CRAFFT (
      • Knight J.R.
      • Sherritt L.
      • Shrier L.A.
      • Harris S.K.
      • Chang G.
      Validity of the CRAFFT substance abuse screening test among adolescent clinic patients.
      ,
      • Knight J.R.
      • Shrier L.A.
      • Bravender T.D.
      • Farrell M.
      • Vander Bilt J.
      • Shaffer H.J.
      A new brief screen for adolescent substance abuse.
      ), a widely-used and well-validated screening tool for use with adolescents recommended by the American Academy of Pediatrics' Committee on Substance Abuse. Analytic Works (www.gamingsmarter.com) created a computer-administered screener and tailored program. The program allowed for tailoring on age, gender, ethnicity and language preference (e.g., Spanish) with the option to have the materials read aloud. The resulting program consisted of:
      • an interactive Web-based screening tool that included the CRAFFT and additional measures of risky and protective behaviors, mental health, school achievement, and attitudes toward substance use;
      • individualized substance use feedback for the student;
      • tailored animated short videos (1–2 minutes) on blood alcohol poisoning, the effects of alcohol and marijuana, and peer pressure; and
      • an animated blood alcohol calculator that was customized using age, gender, and weight specific formulas.
      The presentation of the content used a “video game style” to be more engaging and interactive. The animated short videos encouraged skill building, self-monitoring, and self-efficacy. Following the computer screening process, a counselor feedback report was forwarded to the Phoenix House counselor using Analytic Works Web-based clinic practice management system. This counselor feedback report contained the student ID number, CRAFFT score, risk level, discussion prompts (e.g., ‘I see you play football’), and suggested one of three possible types of brief, motivational interviewing (MI) sessions (described below) based on the student's risk level (Fig. 1).
      Figure thumbnail gr1
      Fig. 1Motivational Interviewing Algorithm—based on the CRAFFT score.
      Counselors signed into a secure Website to view daily workflow, pull counselor feedback reports, and create and complete treatment notes. The practice management system also electronically completed billing forms and allowed the counselor to email or save the electronic treatment notes and bills to their existing internal or external biller.

      5.4 Brief intervention utilizing a structured counseling protocol

      The brief intervention (BI) had two distinctive features: motivational interviewing and a computer-assisted counseling protocol. Motivational interviewing is a client-centered style of counseling that helps clients explore and resolve ambivalence about changing (
      • Miller W.R.
      Motivational interviewing: Research, practice, and puzzles.
      ). While using client-centered techniques to build trust and reduce resistance, the counselor focuses on increasing readiness for change, self-efficacy, and perceived discrepancy between actual behavior and ideal behavior (
      • Rollnick S.
      • Miller W.R.
      What is motivational interviewing?.
      ). Specifically, the counselors asked open-ended questions, listened reflectively, offered encouragement, summarized the student's views, elicited self-motivational statements, recognized and addressed resistance, recognized readiness for change, and identified discrepancies while following treatment recommendations based on the counseling protocol.
      Detailed counseling protocols defined goals for each session and standardized counseling techniques while permitting flexibility and individuality. The computer-assisted counseling protocol was developed in conjunction with the Phoenix House Clinical Director and used the CRAFFT score, risk indicators, protective factors, and probabilities of substance abuse and dependence to recommend to the counselor one of three treatment sessions (Fig. 1). SBIRT programs that focus on early intervention have generally adopted a broad definition of screening and brief intervention (
      • Babor T.F.
      • McRee B.G.
      • Kassebaum P.A.
      • Grimaldi P.L.
      • Ahmed K.
      • Bray J.
      Screening, Brief Intervention, and Referral to Treatment (SBIRT) toward a public health approach to the management of substance abuse.
      ). Screening for prevention and early intervention encompasses the full spectrum ranging from risk of negative consequences related to substance use to substance use disorders. Prevention and early intervention BIs are normally short and provide information and advice, increase motivation to avoid substance use, and teach behavior change skills that will reduce substance use as well as the chances of negative consequences.
      • No or low risk MI sessions—A student's report of no, or low-level past use led to an encouraging preventive/early “discussion with counselor” session during which the counselor provided the student with additional factual information designed to strengthen already positive behaviors.
      • Moderate risk MI sessions—Recent substance use and/or concerns about potential use led to a standard motivational interviewing BI session designed to promote self-awareness of the disparity between the student's aspirations and their use of substances; and to promote student ideas about how they would reduce use and risks. Additional voluntary MI sessions were offered when a student remained ambivalent or unsure. Subsequent sessions repeated the motivational message but also assessed progress. If no change or increased use/risk were detected, the counseling session developed into a ‘significant risk’ session.
      • Significant risk MI sessions—Higher levels of use, injection drug use or significant risks (e.g. driving while intoxicated, thoughts of suicide) led to a BI session where the student was brought to understand the severity of the situation and the need to contact the parent. A supportive phone contact with the parents was then arranged with the goal of thorough assessment and probable referral to treatment.

      5.5 Feasibility and sustainability assessment

      Because the study was a feasibility study and not designed to detect changes over time, formal statistical analyses are not presented. Using non-identifiable patient data we were able to conduct a formative evaluation that focused upon four fundamental questions:
      • 1)
        Overall fit of the intervention—Were we able to implement the intervention without inconvenience, loss of confidentiality, or other unforeseen problems?
      • 2)
        Screening acceptability and detection rates—What proportion of students revealed substance use problems?
      • 3)
        Counseling acceptability—Did students who screened positive return for additional counseling sessions?
      • 4)
        Sustainability—Were there organizational, procedural, or financial barriers to sustaining the intervention?

      6. Results

      6.1 Overall fit of the intervention

      During the 16-week feasibility testing period, there were approximately 13 weeks we were allowed to conduct SBIRT due to school-wide testing, in-service trainings and school closings and the end of the school term. During those weeks, four to five students per day from grades 6–12 were recruited randomly; all during non-academic class periods (e.g., gym, study hall). A total of 248 students were recruited (see Table 1); 138 from the middle school and 110 from the high school with approximately equal numbers of boys and girls. A disproportionately high number of Hispanic students were included. Due in large part to the regular supervision of counselors, emphasizing the importance of privacy and confidentiality of student information, there were no confidentiality breaches throughout the feasibility phase.
      Table 1Participation in screening by race, gender and school.
      VariableEnrolled in schoolScreened sample
      n (%)n(% of enrolled)
      Total998248(24.8%)
      School
       Middle468 (47)113(24.1%)
       High530 (53)135(25.4%)
      Race/ethnicity
      Demographic data were not collected for seven students receiving paper screens.
       African American710 (71)149(21.0%)
       Hispanic288 (29)92(31.9%)
      Gender
      Demographic data were not collected for seven students receiving paper screens.
       Female507 (51)126(24.9%)
       Male491 (49)112(22.8%)
      a Demographic data were not collected for seven students receiving paper screens.

      6.2 Screening acceptability and substance use detection

      Table 2 reports demographics by CRAFFT score for the sample of students who received a computerized screen. One hundred five of the 248 students screened (42%) reported use of alcohol or some other drug in the previous year on the computerized screener. By way of comparison, a standard, anonymous paper and pencil report of substance use, required by New York State, had been completed by the school in the prior year, in which only 28% of students self-reported alcohol or drug use.
      Table 2Demographics and CRAFFT score.
      Demographic data were not collected for seven students receiving paper screens.
      CRAFFT scoreMalesFemalesAfrican AmericansHispanicsHigh schoolMiddle school
      n = 112n = 126n = 149n = 92n = 135n = 106
      063%63%62%64%46%85%
      110%10%10%8%14%3%
      210%10%11%9%16%3%
      36%8%9%4%9%5%
      46%6%5%9%10%2%
      54%4%3%7%6%3%
      6000000
      a Demographic data were not collected for seven students receiving paper screens.
      Based on student self-reports during screening, approximately 58% (143) of all screened students scored in the no or low risk group, 25% (62) scored in the moderate risk level, and 18% (43) indicated levels of use deemed significant (see Fig. 2). Alcohol use was the most widely reported substance used with 92 students (37%) reporting drinking an alcoholic beverage in the prior 12 months (75 high school, 17 middle school). Ninety-seven students (39%) reported they had ridden in a car driven by someone who had been drinking alcohol or using drugs. “Binge” drinking (i.e., four or more drinks in a row within the last 30 days) was reported by 27 high school students (20%) and 8 middle school students (6%).
      Figure thumbnail gr2
      Fig. 2Screening, brief interventions and referral to treatments.
      Sixty-two students (25%) reported marijuana use and 18 students (7%) reported using a drug other than alcohol or marijuana in the previous 12 months. In comparison, the national average for 8th, 10th, and 12th grade students reporting marijuana use is 25% (
      • Johnston L.D.
      • O’Malley P.M.
      • Bachman J.G.
      • Schulenberg J.E.
      Monitoring the future national results on adolescent drug use: Overview of key findings, 2011.
      ). Among the 105 students who reported alcohol or drug use, 45% reported using those substances to relax, feel better about themselves or to fit in. Four students (40%) reported using a substance while they were alone and nearly 32% of substance using students reported forgetting things they did while using alcohol or drugs. Twenty-five percent of substance using students reported a family member or friend telling them they should cut down on their alcohol or drug use and 19% reported getting into trouble while using alcohol or drugs.

      6.3 Counseling acceptability

      All students were offered the opportunity to talk to a counselor following their computer screening regardless of risk. Of the negative screens (n = 136), 100% of the students spoke with the counselor for a preventive/early session. Of the positive screens (n = 105), only one student refused a BI. Among students reporting some risk (n = 62), 33 (53%) received one BI and 28 (45%) received two BIs. Of the students reporting significant risk (n = 43), 16 (37%) received two BIs and 27 (63%) received three BIs with two being referred to treatment (Fig. 2).

      6.4 Sustainability

      Although the SBIRT procedure had been a New York Department of Health-approved prevention practice, we found many barriers to reimbursement for these approved services through the State Medicaid system. The Department of Health regulations specifically permitted SBIRT without parental/guardian permission (as is true of virtually all prevention services). However, billing for that service through Medicaid required submission of student insurance information which was held by the parents or guardians. For this reason, prior to the start of this project, all parents and guardians were notified by mail about the project—that it would be conducted by trained Phoenix House counselors, that their child's information would not be shared with the school, that neither the parents/guardians nor the child would be charged for these services (not even a co-pay), and that parents/guardians could keep their child from participating by returning a signed opt-out form.
      Perhaps because of the numerous presentations to school board, teachers, parent organizations and parents in general at school open houses or because of the “opt-out” parental consenting, there were only five parents who refused participation by their child. However, among the students who were screened, only 40% of parents and guardians returned insurance information to permit reimbursement for the services provided regardless of whether the insurance was government (CHP, Medicaid) or private (Table 3).
      Table 3Obtaining insurance information.
      VariableMiddle school n = 122High school n = 135Total n = 247
      One student refused services.
      N(%)n(%)n(%)
      Billable363063479940
       In-network10825193514
       Medicaid262138286426
      Not billable7662725314860
       Out-of-network9764156
       Not insured223252
       Insurance information not provided6553634712852
      a One student refused services.

      7. Discussion

      Because adolescence is an important time to address alcohol and drug use and because substance use problems are often a particular impediment to student education and healthy development, schools could be among the best locations to deliver evidence-based substance use prevention and early intervention. Consistent with decades of research showing the value and benefits of SBIRT in medical settings, our experience demonstrates that integrating this evidence-based procedure into school settings is both feasible and desirable—but not easy. This feasibility study by Phoenix House and the Treatment Research Institute has shown that many factors determine whether the procedure will be adopted, implemented, and sustained. Extending research on the feasibility, acceptability, and efficacy of computerized screening and provider brief intervention (
      • Harris S.K.
      • Csémy L.
      • Sherritt L.
      • Starostova O.
      • Van Hook S.
      • Johnson J.
      • et al.
      Computer-facilitated substance use screening and brief advice for teens in primary care: An international trial.
      ), this computerized SBIRT program appears promising for identifying substance use and risky behaviors among adolescents in school settings.
      After two semesters of site preparation, training, community discussion, and a 16-week pilot test, it is possible to say that the computer screening followed by the brief motivational interviewing sessions, were acceptable to all members of the community (e.g., school administration, school board, teachers, teachers union, parents, and students). We believe the acceptance and general “fit” of the procedure was due to our decisions to: (a) provide SBIRT by non-school personnel; (b) use a computerized SBIRT program; (c) ensure private and confidential procedures; and (d) provide services during non-academic periods.
      We undertook this study in part because of favorable research findings from earlier SBIRT studies in schools (
      • Clayton S.
      • Chin T.
      • Blackburn S.
      • Echeverria C.
      Different setting, different care: Integrating prevention and clinical care in school-based health centers.
      ,
      • Wagner E.F.
      • Tubman J.G.
      • Gil A.G.
      Implementing school‐based substance abuse interventions: Methodological dilemmas and recommended solutions.
      ,
      • Weinstein J.
      School-based health centers and the primary care physician: An opportunity for collaborative care.
      ,
      • Winters K.C.
      • Fahnhorst T.
      • Botzet A.
      • Lee S.
      • Lalone B.
      Brief intervention for drug-abusing adolescents in a school setting: Outcomes and mediating factors.
      ,
      • Winters K.C.
      • Leitten W.
      Brief intervention for drug-abusing adolescents in a school setting.
      ). Also, there were favorable clinical and financial regulations in place within the test schools which offered the potential for sustaining the school-based SBIRT procedure through approved health insurance reimbursement and a relationship with a substance abuse treatment center. Indeed the approved and published Medicaid reimbursement rates for SBIRT in New York are adequate to support and sustain a part-time supervisor and two counselors to provide these services for an enrollment of over about 600 students. However, parental willingness to provide insurance information is key to financial stability and over half of the parents were unwilling to provide the information that would permit reimbursement for SBIRT services. At this writing, negotiations are under way to better understand and streamline reimbursement procedures for SBIRT by both government and commercial insurers.
      SBIRT is one important element of the prevention efforts described within the Patient Protection and Affordable Care Act (2010). Approved prevention practices are intended and expected to be widely implemented to both improve public health and to reduce burden of disease and cost. However, findings to date suggest that there are organizational and procedural barriers that may produce barriers to the intended broad implementation of SBIRT. For this study, we worked with a well-established substance abuse treatment provider that was independent of the school. We believe this was a paramount feature of our program and cannot speak to the barriers of implement a school based SBIRT program with school counselors or nurses.
      In the state of New York, certified school counselors are eligible to perform SBIRT and submit for Medicaid reimbursements. National surveys of middle and high school counselors conducted by
      • Burrow-Sanchez J.J.
      • Lopez A.L.
      • Slagle C.P.
      Perceived competence in addressing student substance abuse: A national survey of middle school counselors.
      ,
      • Brown S.A.
      Measuring youth outcomes from alcohol and drug treatment.
      have reported school counselors indicating they have very low levels of training in providing comprehensive screening and assessment of substance use and effectively working with students with substance abuse problems. In addition, school counselors indicated they do not have time or training to provide interventions for students with substance abuse problems (
      • Burrow‐Sanchez J.J.
      • Lopez A.L.
      Identifying substance abuse issues in high schools: A national survey of high school counselors.
      ).
      Parental provision of insurance information is a barrier for both government and commercial insurance reimbursement. In addition, commercial insurers may require an “explanation of benefits” and perhaps details of the screening results which could become part of a student's health record, possibly reducing student trust and acceptance. This problem remains to be solved and will be important for efforts to bring evidence-based clinical practices to broader scale.

      7.1 Limitations

      It is important to stipulate important limitations of this feasibility trial. First, although we used the NY State approved and research-validated CRAFFT instrument, we do not yet know the sensitivity and specificity of its use within the computer screening program. We have no reason to believe test parameters will differ in the computer format but this will require further testing. In addition, and for many reasons, this project did not attempt to validate the results of the self-reported screening results through urine testing or other biological confirmation. With regard to honest reporting it is encouraging that 42% of the students recruited in this test reported some substance use in the last year. In future trials it will be important to test whether substance use and other risky behaviors are accurately reported among the students; as well as whether and for how long prevention and early intervention effects are sustained in this setting.
      The most important limitation of this translational research effort is that we have not yet tested school-based SBIRT for its major intended role in reducing substance use and substance use-related impediments to education, health and social development. This type of prospective study now seems not only possible to design, but also worthy of consideration given the likelihood that the present SBIRT intervention may be feasibly and economically implemented. Despite the noted limitations of this early study and the remaining work yet needed, we believe school-based SBIRT will be an effective and practical method to delay onset and reduce the severity of early-onset substance use among middle and high school students.

      References

      1. Abuse, S., & Administration, M. H. S. (2009). Results from the 2008 national survey on drug use and health: national findings. Office of Applied Studies (NSDUH Series H-36, HHS Publication No. SMA 09–4434).

        • Academic E. D. Sbirt Research Collaborative
        The impact of screening, brief intervention and referral for treatment in emergency department patients' alcohol use: A 3-, 6- and 12-month follow-up.
        Alcohol and Alcoholism. 2010; 45: 514-519https://doi.org/10.1093/alcalc/agq058
        • Agerwala S.M.
        • McCance-Katz E.F.
        Integrating Screening, Brief Intervention, and Referral to Treatment (SBIRT) into clinical practice settings: A brief review.
        Journal of Psychoactive Drugs. 2012; 44: 307-317
        • Ammon L.
        • Sterling S.
        • Mertens J.
        • Weisner C.
        Adolescents in private chemical dependency programs: Who are most at risk for HIV?.
        Journal of Substance Abuse Treatment. 2005; 29: 39-45https://doi.org/10.1016/j.jsat.2005.03.003
        • Babor T.F.
        • McRee B.G.
        • Kassebaum P.A.
        • Grimaldi P.L.
        • Ahmed K.
        • Bray J.
        Screening, Brief Intervention, and Referral to Treatment (SBIRT) toward a public health approach to the management of substance abuse.
        Substance Abuse. 2007; 28: 7-30
        • Baer J.S.
        • Kivlahan D.R.
        • Blume A.W.
        • McKnight P.
        • Marlatt G.A.
        Brief intervention for heavy-drinking college students: 4-Year follow-up and natural history.
        Journal Information. 2001; 91
        • Barnard S.
        Implementing an SBIRT (Screening, Brief Intervention, and Referral to Treatment) program in the emergency department: Challenges and rewards.
        Journal of Emergency Nursing. 2009; 35: 561-563https://doi.org/10.1016/j.jen.2009.07.009
        • Borsari B.
        • Carey K.B.
        Effects of a brief motivational intervention with college student drinkers.
        Journal of Consulting and Clinical Psychology. 2000; 68: 728
        • Brown S.A.
        Measuring youth outcomes from alcohol and drug treatment.
        Addiction. 2004; 99: 38-46https://doi.org/10.1111/j.1360-0443.2004.00853.x
        • Burrow-Sanchez J.
        • Call M.E.
        • Adolphson S.L.
        • Hawken L.S.
        School psychologists' perceived competence and training needs for student substance abuse*.
        The Journal of School Health. 2009; 79: 269-276
        • Burrow-Sanchez J.J.
        • Lopez A.L.
        • Slagle C.P.
        Perceived competence in addressing student substance abuse: A national survey of middle school counselors.
        The Journal of School Health. 2008; 78: 280-286
        • Burrow-Sanchez J.J.
        • Lundberg K.J.
        Readiness to change in adults waiting for publicly funded substance abuse treatment.
        Addictive Behaviors. 2007; 32: 199-204https://doi.org/10.1016/j.addbeh.2006.03.039
        • Burrow‐Sanchez J.J.
        • Lopez A.L.
        Identifying substance abuse issues in high schools: A national survey of high school counselors.
        Journal of Counseling and Development. 2009; 87: 72-79
        • Cherpitel C.J.
        • Bernstein E.
        • Bernstein J.
        • Moskalewicz J.
        • Swiatkiewicz G.
        Screening, brief intervention and referral to treatment (SBIRT) in a Polish emergency room: Challenges in cultural translation of SBIRT.
        Journal of Addictions Nursing. 2009; 20: 127-131https://doi.org/10.1080/10884600903047618
        • Clayton S.
        • Chin T.
        • Blackburn S.
        • Echeverria C.
        Different setting, different care: Integrating prevention and clinical care in school-based health centers.
        American Journal of Public Health. 2010; 100: 1592
        • Damschroder L.J.
        • Hagedorn H.J.
        A guiding framework and approach for implementation research in substance use disorders treatment.
        Psychology of Addictive Behaviors. 2011; 25: 194-205https://doi.org/10.1037/a0022284
        • Desy P.M.
        • Howard P.K.
        • Perhats C.
        • Li S.
        Alcohol screening, brief intervention, and referral to treatment conducted by emergency nurses: An impact evaluation.
        Journal of Emergency Nursing. 2010; 36: 538-545https://doi.org/10.1016/j.jen.2009.09.011
        • DeWit D.J.
        • Adlaf E.M.
        • Offord D.R.
        • Ogborne A.C.
        Age at first alcohol use: A risk factor for the development of alcohol disorders.
        The American Journal of Psychiatry. 2000; 157: 745-750
        • Donovan J.E.
        Really underage drinkers: The epidemiology of children's alcohol use in the United States.
        Prevention Science. 2007; 8: 192-205
        • Dunn C.
        • Deroo L.
        • Rivara F.P.
        The use of brief interventions adapted from motivational interviewing across behavioral domains: A systematic review.
        Addiction. 2001; 96: 1725-1742
        • Estee S.
        • Wickizer T.
        • He L.
        • Shah M.F.
        • Mancuso D.
        Evaluation of the Washington State Screening, Brief Intervention, and Referral to Treatment Project Cost Outcomes for Medicaid Patients Screened in Hospital Emergency Departments.
        Medical Care. 2010; 48: 18-24
        • Gates S.
        • McCambridge J.
        • Smith L.A.
        • Foxcroft D.
        Interventions for prevention of drug use by young people delivered in non-school settings.
        Cochrane Database of Systematic Reviews. 2006; 1
        • Grant B.F.
        • Dawson D.A.
        Age at onset of alcohol use and its association with DSM-IV alcohol abuse and dependence: Results from the National Longitudinal Alcohol Epidemiologic Survey.
        Journal of Substance Abuse. 1997; 9: 103-110
        • Hanson K.L.
        • Medina K.L.
        • Padula C.B.
        • Tapert S.F.
        • Brown S.A.
        Impact of adolescent alcohol and drug use on neuropsychological functioning in young adulthood: 10-year outcomes.
        Journal of Child and Adolescent Substance Abuse. 2011; 20: 135-154https://doi.org/10.1080/1067828x.2011.555272
        • Harris S.K.
        • Csémy L.
        • Sherritt L.
        • Starostova O.
        • Van Hook S.
        • Johnson J.
        • et al.
        Computer-facilitated substance use screening and brief advice for teens in primary care: An international trial.
        Pediatrics. 2012; 129: 1072-1082
        • Hingson R.W.
        • Zha W.
        Age of drinking onset, alcohol use disorders, frequent heavy drinking, and unintentionally injuring oneself and others after drinking.
        Pediatrics. 2009; 123: 1477-1484https://doi.org/10.1542/peds.2008-2176
        • Johnston L.D.
        • O’Malley P.M.
        • Bachman J.G.
        • Schulenberg J.E.
        Monitoring the future national results on adolescent drug use: Overview of key findings, 2011.
        Institute for Social Research, The University of Michigan, Ann Arbor2012
        • Juszczak L.
        • Melinkovich P.
        • Kaplan D.
        Use of health and mental health services by adolescents across multiple delivery sites.
        The Journal of Adolescent Health. 2003; 32: 108-118
        • Khadjesari Z.
        • Murray E.
        • Hewitt C.
        • Hartley S.
        • Godfrey C.
        Can stand‐alone computer‐based interventions reduce alcohol consumption? A systematic review.
        Addiction. 2011; 106: 267-282
        • Kilbourne A.M.
        • Neumann M.S.
        • Pincus H.A.
        • Bauer M.S.
        • Stall R.
        Implementing evidence-based interventions in health care: Application of the replicating effective programs framework.
        Implementation Science. 2007; 2: 42https://doi.org/10.1186/1748-5908-2-42
        • Knight J.R.
        • Sherritt L.
        • Shrier L.A.
        • Harris S.K.
        • Chang G.
        Validity of the CRAFFT substance abuse screening test among adolescent clinic patients.
        Archives of Pediatrics & Adolescent Medicine. 2002; 156: 607-614
        • Knight J.R.
        • Shrier L.A.
        • Bravender T.D.
        • Farrell M.
        • Vander Bilt J.
        • Shaffer H.J.
        A new brief screen for adolescent substance abuse.
        Archives of Pediatrics & Adolescent Medicine. 1999; 153: 591-596
        • Levy S.
        • Knight J.R.
        Screening, brief intervention, and referral to treatment for adolescents.
        Journal of Addiction Medicine. 2008; 2: 215-221https://doi.org/10.1097/ADM.0b013e31818a8c7a
        • Levy S.
        • Williams J.F.
        • Knight J.R.
        Screening, brief intervention, and referral to treatment for adolescents: Companion clinical case.
        Journal of Addiction Medicine. 2008; 2: 222-226https://doi.org/10.1097/ADM.0b013e31818ba093
        • Lundgren L.
        • Amodeo M.
        • Cohen A.
        • Chassler D.
        • Horowitz A.
        Modifications of evidence-based practices in community-based addiction treatment organizations: A qualitative research study.
        Addictive Behaviors. 2011; 36: 630-635https://doi.org/10.1016/j.addbeh.2011.01.003
        • Madras B.K.
        • Compton W.M.
        • Avula D.
        • Stegbauer T.
        • Stein J.B.
        • Clark H.W.
        Screening, brief interventions, referral to treatment (SBIRT) for illicit drug and alcohol use at multiple healthcare sites: Comparison at intake and 6 months later.
        Drug and Alcohol Dependence. 2009; 99: 280-295https://doi.org/10.1016/j.drugalcdep.2008.08.003
        • Manuel J.K.
        • Hagedorn H.J.
        • Finney J.W.
        Implementing evidence-based psychosocial treatment in specialty substance use disorder care.
        Psychology of Addictive Behaviors. 2011; 25: 225-237https://doi.org/10.1037/a0022398
        • McCambridge J.
        • Slym R.L.
        • Strang J.
        Randomized controlled trial of motivational interviewing compared with drug information and advice for early intervention among young cannabis users.
        Addiction. 2008; 103: 1809-1818
        • Miller W.R.
        Motivational interviewing: Research, practice, and puzzles.
        Addictive Behaviors. 1996; 21: 835-842
        • Miller W.R.
        • Yahne C.E.
        • Tonigan J.S.
        Motivational interviewing in drug abuse services: A randomized trial.
        Journal of Consulting and Clinical Psychology. 2003; 71: 754-763
        • Mitchell S.G.
        • Gryczynski J.
        • O'Grady K.E.
        • Schwartz R.P.
        SBIRT for adolescent drug and alcohol use: Current status and future directions.
        Journal of substance abuse treatment. 2013; 44: 463-472
        • National Highway Traffic Safety Administration [NHTSA]
        Traffic safety facts 2010: Young drivers. (DOT HS 811 622). 2012 (Washington, DC)
        • Ranney M.L.
        • Choo E.K.
        • Wang Y.
        • Baum A.
        • Clark M.A.
        • Mello M.J.
        Emergency department patients' preferences for technology-based behavioral interventions.
        Annals of emergency medicine. 2012; 60: 218-227
        • Rollnick S.
        • Miller W.R.
        What is motivational interviewing?.
        Behavioural and Cognitive Psychotherapy. 1995; 23: 325-334
        • Sorensen J.L.
        • Kosten T.
        Developing the tools of implementation science in substance use disorders treatment: Applications of the consolidated framework for implementation research.
        Psychology of Addictive Behaviors. 2011; 25: 262-268https://doi.org/10.1037/a0022765
        • Squeglia L.
        • Jacobus J.
        • Tapert S.F.
        The influence of substance use on adolescent brain development.
        Clinical EEG and Neuroscience. 2009; 40: 31-38
        • Substance Abuse and Mental Health Services Administration [SAMSHA]
        Report to Congress on the Prevention and Treatment of Co-Occurring Substance Use Disorders and Mental Disorders (U.S. Department of Health and Human Services, Trans.).
        SAMSHA, Rockville, MD2002
        • Tapert S.F.
        • Caldwell L.
        • Burke C.
        Alcohol and the adolescent brain: Human studies.
        Alcohol Research & Health. 2004; 28: 205-212
        • Tevyaw T.O.L.
        • Monti P.M.
        Motivational enhancement and other brief interventions for adolescent substance abuse: Foundations, applications and evaluations.
        Addiction. 2004; 99: 63-75
        • Vaca F.
        • Winn D.
        • Anderson C.
        • Kim D.
        • Arcila M.
        Feasibility of emergency department bilingual computerized alcohol screening, brief intervention, and referral to treatment.
        Substance Abuse. 2010; 31: 264-269
        • Vaca F.E.
        • Winn D.
        The basics of alcohol screening, brief intervention and referral to treatment in the emergency department.
        West Journal of Emergency Medicine. 2007; 8: 88-92
        • Vaca F.E.
        • Winn D.
        • Anderson C.L.
        • Kim D.
        • Arcila M.
        Six-month follow-up of computerized alcohol screening, brief intervention, and referral to treatment in the emergency department.
        Substance Abuse. 2011; 32: 144-152https://doi.org/10.1080/08897077.2011.562743
        • Wagner E.F.
        • Dinklage S.C.
        • Cudworth C.
        • Vyse J.
        A preliminary evaluation of the effectiveness of a standardized Student Assistance Program.
        Substance Use & Misuse. 1999; 34: 1571-1584
        • Wagner E.F.
        • Tubman J.G.
        • Gil A.G.
        Implementing school‐based substance abuse interventions: Methodological dilemmas and recommended solutions.
        Addiction. 2004; 99: 106-119
        • Walker D.D.
        • Roffman R.A.
        • Stephens R.S.
        • Berghuis J.
        • Kim W.
        Motivational enhancement therapy for adolescent marijuana users: A preliminary randomized controlled trial.
        Journal of Consulting and Clinical Psychology. 2006; 74: 628
        • Weinstein J.
        School-based health centers and the primary care physician: An opportunity for collaborative care.
        Primary Care. 2006; 33: 305
        • Winters K.C.
        • Fahnhorst T.
        • Botzet A.
        • Lee S.
        • Lalone B.
        Brief intervention for drug-abusing adolescents in a school setting: Outcomes and mediating factors.
        Journal of Substance Abuse Treatment. 2012; 42: 279-288
        • Winters K.C.
        • Leitten W.
        Brief intervention for drug-abusing adolescents in a school setting.
        Psychology of Addictive Behaviors. 2007; 21: 249
        • Yuma-Guerrero P.J.
        • Lawson K.A.
        • Velasquez M.M.
        • von Sternberg K.
        • Maxson T.
        • Garcia N.
        Screening, brief intervention, and referral for alcohol use in adolescents: A systematic review.
        Pediatrics. 2012; 130: 115-122