The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×
RESEARCH ARTICLESFull Access

Increases in Suicide Deaths Among Adolescents and Young Adults Following US Food and Drug Administration Antidepressant Boxed Warnings and Declines in Depression Care

Abstract

Objective

Studies show decreased depression diagnosis, psychotherapy, and medications and increased suicide attempts following US Food and Drug Administration antidepressant warnings regarding suicidality risk among youth. Effects on care spilled over to older adults. This study investigated whether suicide deaths increased following the warnings and declines in depression care.

Methods

We conducted an interrupted time series study of validated death data (1990–2017) to estimate changes in trends of US suicide deaths per 100,000 adolescents (ages 10–19) and young adults (ages 20–24) after the warnings, controlling for baseline trends.

Results

Before the warnings (1990–2002), suicide deaths decreased markedly. After the warnings (2005–2017) and abrupt declines in treatment, this downward trend reversed. There was an immediate increase of 0.49 suicides per 100,000 adolescents, 95% confidence interval [CI]: 0.12, 0.86) and a trend increase of 0.03 suicides per 100,000 adolescents per year (95% CI: 0.026, 0.031). Similarly, there was an immediate increase of 2.07 suicides per 100,000 young adults (95% CI: 1.04, 3.10) and a trend increase of 0.05 suicides per 100,000 young adults per year (95% CI: 0.04, 0.06). Assuming baseline trends continued, there may have been 5958 excess suicides nationally by 2010 among yearly cohorts of 43 million adolescents and 21 million young adults.

Conclusions

We observed increases in suicide deaths among youth following the warnings and declines in depression care. Alternative explanations were explored, including substance use, economic recessions, smart phone use, and unintentional injury deaths. Additional factors may have contributed to continued increases in youth suicide during the last decade. Combined with previous research on declining treatment, these results call for re‐evaluation of the antidepressant warnings.

HIGHLIGHTS

  • Previous research showed that depression care declined following the US FDA antidepressant warnings regarding suicidality for adolescents and young adults.

  • In this interrupted time series analysis using 28 years of nationwide death certificates, we found youth suicide deaths increased after the FDA antidepressant warnings and reductions in depression care.

  • We recommend that the FDA err on the side of caution and consider replacing the boxed warning with less severe warnings that still communicate information on possible drug risks without endangering essential, first‐line treatments of depression in youth.

Depression is the leading cause of suicide in youth, and suicides among adolescents have risen by more than 50% between 2003 and 2017 (1, 2, 3). More than 60% of adolescents do not have a single mental health encounter with either lay counselors or mental health clinicians in the year when they experience a major depressive episode (4, 5). Thus, they do not receive first‐line evidence‐based treatments such as psychotherapies (6, 7, 8), including cognitive, behavioral, and interpersonal (9) or, when indicated, antidepressant medications (10, 11). Appropriate treatment can improve health outcomes in youth (12, 13).

Based on a controversial analysis of industry drug trials (14) the Food and Drug Administration (FDA) issued a public health advisory in late 2003 that children and adolescents taking antidepressants were at increased risk of suicidal ideation and behavior (15). The intent of the warnings was not to reduce care seeking, effective diagnosis, psychotherapy, and drug treatment, but rather to alert clinicians to monitor for suicidal ideation when starting treatment. Then, the FDA released a more serious “boxed warning” of this risk to be included in all antidepressant drug labeling effective in 2005. Finally, it extended the boxed warning to include young adults in 2007. This boxed warning continues to the present.

Unfortunately, the media published hundreds of alarming news stories that exaggerated the message from risk of suicidal ideation to risk of completed suicide (16). This was reinforced by years of warnings of suicidality in television drug advertising and boxed warnings that have been associated not only with a chilling effect on drug treatment for depression, but also psychotherapy. Media exaggerations may have further stigmatized adolescents and young adults not to seek treatment for mood disorders and possibly changed prescribers' perceptions of the net benefits of antidepressants (16, 17, 18).

Randomized trials are not feasible to examine the effects of drug safety warnings that are disseminated nationwide; therefore, the best research uses observational, quasi‐experimental designs. Several rigorous interrupted time‐series studies (19) documented the unintended effects associated with the warnings. There were sudden, large declines in identification of depression among adolescents, young adults, and adults up to age 89 among 55 million enrollees in US health plans (Figure 1A) (20). The FDA warnings were not intended to reduce drug and nondrug treatment, but to increase monitoring for suicidal thoughts and behavior at the start of drug therapy (21). However, psychotherapy among depressed patients of all ages continued a pre‐existing downward slope and a sudden, slight decline in level immediately after the warnings (Figure 1B), suggesting a missed opportunity to discuss suicidal behavior (15). In addition, controlling for a stable baseline trend, the FDA warnings were associated with a sudden, unintended threefold increase (from 20% to 60%) in the proportion of depressed youth without antidepressant treatment (Figure 1C) (20). Several studies (22, 23, 24) found 30%–50% declines in use of antidepressants among teens (Figure 2A) and young adults (22), including spillover effects to older adults not targeted by the warnings. Based on a national sample of health systems (22) these declines in antidepressant use did not recover to earlier levels even 7 years after the first 2003 advisory (Figure 2) (22). Finally, a controlled, longitudinal study suggested a small increase after the warnings in psychotropic drug poisonings, a proxy for suicide attempts, in 11 US health plans (Figure 2B) (22).

image

FIGURE 1. (A) Declines in rates of diagnosis of depression (actual and predicted) after FDA antidepressant warnings among 55 million enrollees in managed care plans, from the Pharmetrics Patient Centric Database. (B) Decline in psychotherapy visits after the warnings among all age groups combined (among 55 million managed care enrollees). (C) Increases in pediatric and adolescent patients having depression without an antidepressant prescription fill within 30 days after diagnosis. These data appeared in JAMA Psych. 2009 Jun; 66(6):633–9 and Am J Psychiatry. 2007 Jun; 164(6):884–91. They are used here with permission from lead author Anne M. Libby of the University of Colorado at Denver and the journal's publishers

image

FIGURE 2. Rates of (A) antidepressant use and (B) psychotropic drug poisonings (a proxy for suicide attempts) per quarter before and after the warnings among adolescents enrolled in 11 health plans in nationwide mental health research network. Reproduced with permission from lead author Christine Lu of Harvard Medical School and Harvard Pilgrim Health Care Institute and The BMJ. BMJ. 2014 Jun 18; 348:g3596

The above identified unintended outcomes following the FDA warnings on depression care among young people represent possible mechanisms for changes in suicide deaths after the warnings. Sudden and significant changes in levels and slopes of these intermediate outcomes after the warnings, across large nationally representative populations, highlight the need for studies of their effects on rates of suicide. However, existing studies of suicide deaths lacked adequate sample size and sufficient longitudinal data (22, 25). For example, at least three studies with only 1–2 years of post‐warnings data provided preliminary evidence of increases in suicide deaths after the warnings in the United States and Canada (26, 27, 28). Here we report the first long‐term study to investigate whether suicide deaths in the United States increased among adolescents and young adults following the antidepressant warnings, and the accompanying declines in depression diagnosis and treatment already demonstrated in large quasi‐experimental studies.

Methods

We obtained population‐adjusted suicide death data between 1990 and 2017 from the WONDER Database, maintained by the Centers for Disease Control (CDC) and Prevention (2). This database contains mortality counts based on death certificates for the US residents and population counts for all the US counties. These data are validated and are used in numerous CDC reports of trends in mortality in the United States (29). We downloaded data on suicide deaths per 100,000 people in all states, based on cause of death by age group and year. CDC‐defined age groups in the database included adolescents (ages 10–19) and young adults (ages 20–24) (2).

We used an interrupted times series design (19), which can provide powerful evidence of policy effects when randomization is not possible (30), because it measures the effects of interruptions in trends soon after policies and controls for secular trends in study outcomes. It does not resemble weak ecological analyses without pre‐policy baselines that are merely correlations of trends. The main assumption of this method is that extrapolating the pre‐policy level and trend correctly reflects the (counterfactual) outcome that would have occurred had the policy not happened. Time series of population suicide rates were divided into three segments: the 13‐year pre‐warning period (1990–2002), a transition period (2003 and 2004), and a 13‐year post‐FDA warning period (2005–2017) as the boxed warning officially started in 2005 for adolescents and then was extended to young adults in 2007. The first segment included rates of suicide death before the FDA warnings which define the counterfactual level and trend for measuring change in suicide death rates. The FDA released several initial advisories during late 2003 and 2004 so we displayed these data points but excluded this period from the statistical model. This approach evaluated the effects of the warnings at “full strength.” The post‐warning segment comprised rates of suicide death after the warnings. This method is consistent with our previous study (22) of changes in antidepressant use and suicidality after the FDA warnings.

We used segmented regression models (19) to estimate changes in the US suicide rates from the pre‐warning period to the follow‐up period for each age cohort. In all models, we controlled for baseline (counterfactual) trends. The models included terms to estimate changes in level and trend in suicide deaths after the warnings. Segmented regression models generally have a linear specification, but polynomial and nonlinear regression can be used where data exhibit nonlinear patterns. We included a quadratic term for the post‐warnings trend in our models because of observed nonlinearity. For parsimony, and consistent with prior research, we excluded nonsignificant (p≥0.05) time series terms in a stepwise fashion; exclusion of the nonsignificant terms did not change the coefficients on the remaining terms (19). We controlled for all significant autocorrelation terms in the models because observations over time are correlated (31). We graphed the observed and predicted suicide death rates from 1990 to 2017 based on the segmented models.

In addition, we estimated the size of cumulative effects on suicide deaths in the first 6 years immediately following the warnings (first 3 years since the 2007 warning expansion to young adults) by comparing the overall changes in outcome associated with the warnings with counterfactual estimates based on the pre‐warning trends (22). Our cumulative effect estimates are conservative, using only 2005–2010 data, because confidence intervals are narrower (with smaller margins of error) sooner rather than later after the policy of interest. For the same reasons, inferences about possible effects of the warnings on immediate changes in suicide rates are stronger than any estimates years after the policy when other co‐interventions (confounders) could influence these outcomes. We conducted statistical analyses using SAS (version 9.3, SAS Institute, Cary, NC).

In a comparison analysis, we examined longitudinal trends in all injury deaths and unintentional (“accidental”) injury deaths because they should not be affected by the FDA warnings about antidepressants and suicidality risk. We obtained all injury deaths and unintentional (“accidental”) injury deaths for adolescents in the United States from 1990 to 2016 from WISQARS Fatal Injury Reports by the CDC (32). The data are based on death certificates for the US residents. These data are validated and are used in numerous CDC reports of trends in mortality in the United States (32).

We did not use older‐age groups, who were not the target population of the warnings, as formal controls for several reasons. First, both adults and elderly up to age 69 (22) and age 79 (15) also experienced reduced diagnoses and depression care after the FDA warnings (Figure 1) (15, 20, 22–24, 27). Second, they had several‐fold higher baseline suicide rates and different trends; this noncomparability in outcomes would bias effect estimates in difference‐in‐differences analyses (33, 34). Third, there might be differential confounding by age. For example, the 2007–2009 recession, several years after the FDA boxed warning, was associated with higher risks of subsequent suicides among working adults and retirees, but generally not youth (35, 36). Finally, abuse of opioids might have also increased suicides among adults, but not adolescents and those aged 20–24 (37).

Results

Adolescents

During the 13 years before the warnings, there was a significant downward trend in suicide deaths from 6.4 suicide deaths per 100,000 adolescents in 1990 to 4.2 in 2002 (−0.18 deaths per 100,000 adolescents per year; 95% confidence interval [95% CI]: −0.21, −0.15; p<0.001). After the 2005 FDA warnings and declines in depression care, this downward trend reversed; from 4.4 suicide deaths per 100,000 adolescents in 2005 to 7.2 in 2017 (Figure 3). The increased level of suicide deaths deviated immediately from the baseline trend soon after the initial warnings. There was an immediate increase of 0.49 suicide deaths per 100,000 adolescents (95% CI: 0.12, 0.86) and a trend increase of 0.03 suicide deaths per 100,000 adolescents per year (95% CI: 0.026, 0.031). Comparing with counterfactual estimates based on pre‐warning trends, they suggest that the warnings may have caused 2365 excess suicide deaths in the United States from 2005 to 2010. The average annual population of adolescents aged 10–19 was 43 million.

image

FIGURE 3. Time series of adolescenta suicide in the United States before and after FDA antidepressant warnings

aAdolescents were defined as 10–19 years of age (WHO definition). Data obtained from the CDC WONDER Database Detailed, https://wonder.cdc.gov/ucd‐icd10.html and Compressed Mortality File, https://wonder.cdc.gov/mortSQL.html

Young Adults

During the 13 years before the warnings, there was a significant downward trend in suicide deaths from 15.1 deaths per 100,000 young adults in 1990 to 12.3 in 2002 (−0.36 deaths per 100,000 young adults per year; 95% CI: −0.34, −0.28; p<0.001). After the 2005 FDA warnings and declines in depression care, this downward trend reversed; from 12.4 suicide deaths per 100,000 young adults in 2005 to 17.0 in 2017 (Figure 4). There was an immediate increase of 2.07 suicide deaths per 100,000 young adults (95% CI: 1.04, 3.10), followed by a trend increase of 0.05 suicide deaths per 100,000 young adults per year (95% CI: 0.04, 0.06). Comparing with counterfactual estimates, these reflect 3593 excess suicide deaths from 2005 through 2010; the average yearly cohort of young adults was 21 million.

image

FIGURE 4. Times series of young adultsa suicide rates in the United States before and after FDA antidepressant warnings

aYoung Adult currently 20–24 years of age. Data obtained from the CDC WONDER Database Detailed, https://wonder.cdc.gov/ucd‐icd10.html and Compressed Mortality File, https://wonder.cdc.gov/mortSQL.html

image

FIGURE 5. Injury death rates for children and adolescents aged 10–19 years, by intent: 1990–2017. Data obtained from the WISQARS Fatal Injury Reports, National, Regional and State, 1990–2017, https://webappa.cdc.gov/sasweb/ncipc/mortrate.html

There was a downward trend in the comparison outcomes, all injury deaths and unintentional injury deaths among adolescents in the United States before the warnings; this decline continued relatively unchanged after the warnings (Figure 5).

Discussion

In this nationwide study using 28 years of all US death certificates, controlling for a 13‐year stable downward trend in the pre‐warning period, we found that youth suicide deaths increased significantly after the FDA antidepressant warnings and reductions in depression care. Based on the annual size of these populations (averaged 43 million adolescents and 21 million young adults) in the United States, these may reflect 2365 excess suicide deaths among adolescents and 3593 among young adults from 2005 through 2010 (the first 6 years after the warnings). Other unintentional injury deaths did not increase after the warnings. While the factors influencing intentional and unintentional injuries may differ, these data add to the evidence of an association between the antidepressant warnings and increased suicide deaths.

A mechanism for this association is clear: The FDA antidepressant “warning,” accompanied by exaggerated media coverage, stigmatized depression care for young people, and fostered reluctance by providers to initiate antidepressant treatment. Thus, the warnings reduced diagnosis of major depression, and drug and nondrug mental health treatment.

Strong data support this association. Previous interrupted times series studies meeting the stringent design criteria of The Cochrane Collaboration (38) described adverse effects of the warnings on care‐seeking, diagnosis, psychotherapy, medication use, and suicidality among both adolescents and young adults. These included: large reductions in trends of diagnosis of depression among youth, with spillover effects to adults (15, 20, 22, 23, 24); a continued reduction in psychotherapy among depressed individuals of all ages (despite the warnings' major intent to increase surveillance of young people's suicidal thinking and behavior) (20); a 25% to 50% sudden decline in use of antidepressant medications among millions of adolescents and young adults both with and without depression diagnoses in low‐income Medicaid populations (24) and in 11 US health plans (22).

The warnings also reduced depression diagnosis and care among adults and the elderly (15, 20, 22, 23, 24, 27). However, we did not attempt to statistically compare changes in suicides after the warnings among youth versus older adults (see Methods). Nevertheless, it is noteworthy that the increase in the trend of suicides among youth after the warnings exceeded those of younger middle‐aged adults (aged 35–44; Figure A1). Thus, these graphical comparison group data support the results of our single group interrupted time series analysis, suggesting that the warnings contributed to increased suicide deaths among youth.

A single quasi‐experimental study cannot establish causality. However, the boxed warnings and associated reductions in depression care were further associated with a significant increase in suicide deaths among adolescents and young adults. This analysis indicates a pattern of unintended consequences that are significant enough to warrant action. There are currently no surveillance structures in place to identify unintended safety concerns associated with FDA drug warnings; however, the FDA is now working with Sentinel to develop a tool using these same interrupted time series methods to allow such monitoring (39).

Critics of the hypotheses of increased risk of the antidepressant warnings have claimed that renewed increases in antidepressant use are the culprit, not the warnings' effects on all mental health care. However, studies have shown that 60%–70% of adolescents and young adults with major depression do not receive any mental health treatment from any clinician (5) and that these high untreated rates were relatively unchanged from 2005 to 2014. While inappropriate use is certainly a concern, the major problem appears to be underuse, not overuse, of all mental health treatments leaving the increased risk from major depression unanswered.

There are several limitations of this quasi‐experimental study. The most important include any possible co‐interventions occurring around the time of the warnings that affect suicide rates. Some have hypothesized that the emergence of smart phones in the mid‐2000s may have exposed this group to new stressors: cyber‐bullying, status anxiety, and alienation, thus increasing suicide deaths in this group. However, this is unlikely to have explained the downward and upward trends before and after the warnings. The most definitive meta‐analysis of this relationship has now concluded that, although social media can have negative effects on self‐esteem and other outcomes, there are no or minuscule effects of smart phone use on suicide deaths in children and adolescents (40, 41).

Another important co‐intervention is the last recession that occurred between 2007 and 2009 (42). Data suggest that suicide deaths may have increased among adults, especially those who lost jobs (35), and elderly people who experienced financial insecurity. This intervention occurred several years after the start of the antidepressant warning period. Few longitudinal studies have examined the effects of recessions on suicide among youth. While it is possible that some very vulnerable adolescents might be at increased risk of depression from experiencing large economic losses, recent data do not find an excess rate of suicide deaths in young people but do observe such an effect among adults (36). Therefore, while this recession might have explained some individual deaths, it is unlikely to have caused adolescent and young adult population‐level shifts in suicide mortality that we observed in this study. The recession also does not explain the almost immediate reversal in the long decreasing trend in youth suicides from baseline occurring soon after the initial advisories and boxed warning (Figures 3 and 4).

The opioid epidemic has also been identified as a possible risk factor for increased suicide deaths among adolescents (3). However, this alternative explanation for our findings is unlikely. Rates of overdose deaths were rising steeply before the warnings when suicide deaths were declining sharply in our data. Conversely, and importantly, all deaths from drug abuse in adolescents declined by about 26% from 2007 (the time of the last boxed warning for antidepressants) to 2013 when suicide rates were increasing (37). Adolescents are much less likely than older adults to abuse opioids (37) which likely confound comparisons of the effects of the warnings on suicide risks across these age groups.

Furthermore, the ongoing, sharp increase in suicide rates after 2012, 5 to 7 years after the start of the warnings, are more difficult to attribute to only one policy. Additional economic, social, and medical factors may be contributing to the continued rise in youth suicide (43).

Conclusion

In summary, this was the first study of the antidepressant warnings using 28 years of data from the US death certificates. We observed large increases in suicide deaths among adolescents and young adults following the widely publicized FDA antidepressant warnings, reductions in care‐seeking, diagnosis, and medication use, and increased suicide attempts coincident with the warnings. Other unintentional injury deaths, a comparison outcome, did not increase after the warnings. Furthermore, a significant majority of youth experiencing major depression do not receive any mental health care. These data support a formal re‐evaluation of the risks and benefits of the boxed antidepressant warnings, FDA's strongest type of communications about a drug or drug class. In this case, we recommend that the FDA err on the side of caution and consider replacing the boxed warning with less severe warnings that still communicate information on possible drug risks without endangering essential, first‐line treatments of depression in youth. Federal and local mental health agencies should undertake a nationwide public and media education campaign to increase the very low recognition and treatment of depression in adolescents and young adults.

image

FIGURE A1. Time series of suicide in the United States before and after FDA antidepressant warnings among adolescents (aged 10–19), young adults (aged 20–24), and a comparison group of young middle‐aged adults (aged 35–44) standardized to 2002 (pre‐warning year). Data obtained from the CDC WONDER Database Detailed, https://wonder.cdc.gov/ucd‐icd10.html and Compressed Mortality File, https://wonder.cdc.gov/mortSQL.html

Harvard Medical School Department of Population Medicine and Harvard Pilgrim Health Care Institute, Boston, Massachusetts (C. Y. Lu, J. Wallace, C. Lupton, S. B. Soumerai); Department of Health Services Research, Kaiser Permanente Washington Health Research Institute and University of Washington, Seattle, Washington (R. B. Penfold); Department of Emergency Medicine, School of Medicine, University of Colorado, Anschutz Medical Campus, Denver, Colorado (A. M. Libby)
Send correspondence to Soumerai ()

Christine Y. Lu, Robert B. Penfold, and Stephen B. Soumerai are partly supported by a cooperative agreement (U19MH092201; principal investigator, Gregory Simon) with the US National Institute of Mental Health; SBS was the study principal investigator. Anne M. Libby, Jamie Wallace, and Caitlin Lupton did not receive funding for this study. Anne M. Libby declares current active career development training project funding from the Doris Duke Foundation, the NIH BIRCWH K12 program, and the NCATS CTSA program. The content is solely the responsibility of the authors and does not necessarily represent the official views of the US National Institutes of Health. The sponsor had no role in the design and conduct of the study; analysis, and interpretation of the data; the preparation of the manuscript; and the decision to submit the manuscript for publication. Christine Y. Lu serves as a pharmacoepidemiologist for the Sentinel System, a congressionally mandated national medical product safety surveillance system funded by the US Food and Drug Administration (contract HHSF223201400030I; PI: R. Platt).

All other authors declare no conflicts of interest.

A Letter on this Article is available here: 10.1176/appi.prcp.20200038. The Response to the Letter is available here: 10.1176/appi.prcp.20200039.

References

1 Curtin SC, Warner M, Hedegaard H: Increase in Suicide in the United States, 1999–2014. Hyattsville, MD, U.S. Department of Health & Human Services, Centers for Disease Control and Prevention, National Center for Health Statistics, 2016. https://www.cdc.gov/nchs/data/databriefs/db241.pdfGoogle Scholar

2 CDC WONDER : Centers for Disease Control and Prevention. Atlanta, GA: Center for Disease Control and Prevention; 2020. https://wonder.cdc.gov/. Accessed Feb 6, 2019Google Scholar

3 Miron O, Yu K‐H, Wilf‐Miron R, et al: Suicide rates among adolescents and young adults in the United States, 2000‐2017. J Am Med Assoc 2019; 321:2362–2364Google Scholar

4 National Survey on Drug Use and Health (NSDUH) . Rockville, MD: Substance Abuse and Mental Health Service Administration. https://www.datafiles.samhsa.gov/study‐series/national‐survey‐drug‐use‐and‐health‐nsduh‐nid13517. Accessed Jun 24, 2019Google Scholar

5 Mojtabai R, Olfson M, Han B: National trends in the prevalence and treatment of depression in adolescents and young adults. Pediatrics 2016; 138:e20161878Google Scholar

6 Beck AT, Rush AJ, Shaw BF, et al: Cognitive Behavioral Therapy of Depression. New York, NY, The Guilford Press, 1979Google Scholar

7 Clarke G, Debar LL, Pearson JA, et al: Cognitive behavioral therapy in primary care for youth declining antidepressants: a randomized trial. Pediatrics 2016; 137:e20151851Google Scholar

8 Klein J: Review: cognitive behavioural therapy for adolescents with depression. Evid Based Ment Health 2008; 11:76Google Scholar

9 Hetrick SE, Cox GR, Witt KG, et al: Cognitive behavioural therapy (CBT), third‐wave CBT and interpersonal therapy (IPT) based interventions for preventing depression in children and adolescent. Cochrane Database Syst Rev 2016; 8:CD0033880Google Scholar

10 Emslie GJ, Mayes T, Porta G, et al: Treatment of resistant depression in adolescents (TORDIA): week 24 outcomes. Am J Psychiatry 2010; 167:782–791Google Scholar

11 March J, Silva S, Petrycki S, et al: Fluoxetine, cognitive‐behavioral therapy, and their combination for adolescents with depression: treatment for adolescents with depression study (TADS) randomized controlled trial. J Am Med Assoc 2004; 292:807–820Google Scholar

12 Bridge JA, Iyengar S, Salary CB, et al: Clinical response and risk for reported suicidal ideation and suicide attempts in pediatric antidepressant treatment: a meta‐analysis of randomized controlled trials. J Am Med Assoc. 2007; 297:1683–1696Google Scholar

13 Moreland CS, Bonin L: Patient Education: Depression Treatment Options for Children and Adolescents (Beyond the Basics)—UpToDate, 2019. https://www.uptodate.com/contents/depression‐treatment‐options‐for‐children‐and‐adolescents‐beyond‐the‐basics. Accessed Sep 17, 2019Google Scholar

14 Baldessarini RJ, Pompili M, Tondo L: Suicidal risk in antidepressant drug trials. Arch Gen Psychiatry 2006; 63:246–248Google Scholar

15 Libby AM, Brent DA, Morrato EH, et al: Decline in treatment of pediatric depression after FDA advisory on risk of suicidality with SSRIs. Am J Psychiatry 2007; 164:884–891Google Scholar

16 Vedantam S: FDA Confirms Antidepressants Raise Children's Suicide Risk. Washington, DC, The Washington Post, 2004. https://www.washingtonpost.com/archive/politics/2004/09/14/fda‐confirms‐antidepressants‐raise‐childrens‐suicide‐risk/f20a075a‐9a15‐471a‐a81d‐8ad23b337505/. Accessed Jun 24, 2019Google Scholar

17 Harris G: F.D.A. Links Drugs to Being Suicidal. New York, NY, The New York Times, 2004. https://www.nytimes.com/2004/09/14/health/fda‐links‐drugs‐to‐being‐suicidal.html. Accessed Jun 24, 2019Google Scholar

18 Soumeri SB, Koppel R: FDA use of “black box” for antidepressants ignores the harms of this warning. STAT 2018. https://www.statnews.com/2018/08/29/fda‐antidepressants‐black‐box‐warnings‐harms/. Accessed Jun 13, 2019.Google Scholar

19 Wagner AK, Soumerai SB, Zhang F, et al: Segmented regression analysis of interrupted time series studies in medication use research. J Clin Pharm Ther 2002; 27:299–309Google Scholar

20 Libby AM, Orton HD, Valuck RJ: Persisting decline in depression treatment after FDA warnings. Arch Gen Psychiatry 2009; 66:633–639Google Scholar

21 U.S. Food & Drug Administration . Suicidality in children and adolescents being treated with antidepressant medications. Silver Spring, MD, The Food and Drug Administration, 2018. http://www.fda.gov/drugs/postmarket‐drug‐safety‐information‐patients‐and‐providers/suicidality‐children‐and‐adolescents‐being‐treated‐antidepressant‐medications. Accessed Dec 18, 2019Google Scholar

22 Lu CY, Zhang F, Lakoma MD, et al: Changes in antidepressant use by young people and suicidal behavior after FDA warnings and media coverage: quasi‐experimental study. BMJ 2014; 348:g3596Google Scholar

23 Busch SH, Frank RG, Leslie D, et al: Antidepressants and suicide risk: how did specific information in FDA safety warnings affect treatment patterns? Psychiatr Serv 2010; 61:11–16Google Scholar

24 Kurian BT, Ray WA, Arbogast PG, et al: Effect of regulatory warnings on antidepressant prescribing for children and adolescents. Arch Pediatr Adolesc Med 2007; 161:690–696Google Scholar

25 Ruch DA, Sheftall AH, Schlagbaum P: Trends in suicide among youth aged 10 to 19 Years in the United States, 1975 to 2016. JAMA Netw Open 2019; 2:e193886Google Scholar

26 Katz LY, Kozyrskyj AL, Prior HJ, et al: Effect of regulatory warnings on antidepressant prescription rates, use of health services and outcomes among children, adolescents and young adults. CMAJ 2008; 178:1005–1011Google Scholar

27 Gibbons RD, Brown CH, Hur K, et al: Early evidence on the effects of regulators’ suicidality warnings on SSRI prescriptions and suicide in children and adolescents. Am J Psychiatry 2007; 164:1356–1363Google Scholar

28 Bridge JA, Greenhouse JB, Weldon AH, et al: Suicide trends among youths aged 10 to 19 Years in the United States, 1996‐2005. J Am Med Assoc 2008; 300:1025–1026Google Scholar

29 Murphy SL, Xu J, Kochanek KD, et al: Mortality in the United States, 2017. Hyattsville, MD, U.S. Department of Health and Human Services, Centers for Disease Control and Prevention and National Center for Health Statistics, 2018. https://www.cdc.gov/nchs/data/databriefs/db328‐h.pdfGoogle Scholar

30 Briesacher BA, Soumerai SB, Zhang F, et al: A critical review of methods to evaluate the impact of FDA regulatory actions. Pharmacoepidemiol Drug Saf 2013; 22:986–994Google Scholar

31 Box GEP, Jenkins GM: Time Series Analysis: Forecasting and Control. San Francisco, CA, Holden‐Day, 1976Google Scholar

32 Centers for Disease Control and Prevention . WISQARS Fatal Injury Reports, National, Regional and State. Atlanta, GA, U.S. Department of Health and Human Services, 1981‐2018. https://webappa.cdc.gov/sasweb/ncipc/mortrate.html. Accessed Aug 26, 2019Google Scholar

33 Shadish W, Cook T, Campbell D: Experimental and Quasi‐Experimental Designs for Generalized Causal Inference. Belmont, CA, Wadsworth Cengage Learning, 2002Google Scholar

34 Kahn‐Lang A, Lang K: The promise and pitfalls of differences‐in‐differences: reflections on 16 and pregnant and other applications. J Bus Econ Stat 2020; 38:613–620Google Scholar

35 Chang S‐S, Stuckler D, Yip P, et al: Impact of 2008 global economic crisis on suicide: time trend study in 54 countries. BMJ 2013; 347:f5239Google Scholar

36 Phillips JA, Nugent CN: Suicide and the Great Recession of 2007‐2009: the role of economic factors in the 50 U.S. states. Soc Sci Med 2014; 116:22–31Google Scholar

37 Curtin SC, Tejada‐Vera B, Warner M: Drug Overdose Deaths Among Adolescents Aged 15–19 in the United States: 1999–2015. Hyattsville, MD, U.S. Department of Health & Human Services, Centers for Disease Control and Prevention, National Center for Health Statistics, 2017. https://www.cdc.gov/nchs/data/databriefs/db282.pdfGoogle Scholar

38 Cochrane Effective Practice and Organisation of Care (EPOC) . What Study Designs Can be Considered for Inclusion in an EPOC Review and What Should They be Called?Oxford, Cochrane Effect Practice and Organisation of Care (EPOC), 2017. https://epoc.cochrane.org/sites/epoc.cochrane.org/files/public/uploads/Resources‐for‐authors2017/what_study_designs_should_be_included_in_an_epoc_review.pdf. Accessed Jun 25, 2019Google Scholar

39 Lu CY, Damon J, DeLuccia S, et al: ARIA Tool Enhancement: Enabling Interrupted Time Series Analyses | Sentinel Initiative. Boston, MA, Department of Population Medicine, Harvard Pilgrim Health Care Institute and Harvard Medical School, 2018. https://www.sentinelinitiative.org/sentinel/methods/aria‐tool‐enhancement‐enabling‐interrupted‐time‐series‐analyses. Accessed Aug 26, 2019Google Scholar

40 Orben A, Przybylski AK: The association between adolescent well‐being and digital technology use. Nat Hum Behav 2019; 3:173–182Google Scholar

41 Screen time: how much is too much? Nature 2019; 565:265Google Scholar

42 Radin CA: US Business Cycle Expansions and Contractions. Cambridge, MA, The National Bureau of Economic Research, 2010. https://www.nber.org/cycles.html. Accessed Jun 25, 2019Google Scholar

43 Friedman RA: Teenagers, Medication and Suicide. New York, NY, The New York Times, 2015. https://www.nytimes.com/2015/08/03/opinion/teenagers‐medication‐and‐suicide.html. Accessed Jun 24, 2019Google Scholar