Project Harmony: A Meta-Analysis With Individual Patient Data on Behavioral and Pharmacologic Trials for Comorbid Posttraumatic Stress and Alcohol or Other Drug Use Disorders
Denise A Hien
Antonio A Morgan-López
Lissette M Saavedra
Lesia M Ruglass
Ai Ye
SimpleOriginal

Summary

A meta-analysis of 36 trials found that combining trauma-focused therapy with alcohol-targeted pharmacotherapy yielded the greatest reductions in PTSD and alcohol use severity. Drug use outcomes showed less consistent benefit.

2023

Project Harmony: A Meta-Analysis With Individual Patient Data on Behavioral and Pharmacologic Trials for Comorbid Posttraumatic Stress and Alcohol or Other Drug Use Disorders

Keywords Posttraumatic stress disorder (PTSD); substance use disorder; trauma-focused therapy; alcohol use disorder; behavioral treatment; meta-analysis; comparative effectiveness; integrated treatment

Abstract

Objective: Treatment efficacy for co-occurring posttraumatic stress disorder (PTSD) and substance use disorders is well established, yet direct evidence for comparative effectiveness across treatments is lacking. The present study compared the effectiveness of several behavioral and pharmacological therapies for adults with co-occurring PTSD and alcohol or other drug use disorders. Methods: A systematic search of PsycINFO, MEDLINE, and ClinicalTrials.gov was conducted through December 2020 for trials targeting PTSD, alcohol or other drug use disorders, or both disorders (36 studies, N=4,046). Primary outcomes were severity scores for PTSD, alcohol use, and drug use, estimated via moderated nonlinear factor analysis. Propensity score weight–adjusted multilevel models were used. Model-predicted effect sizes were estimated for each treatment, and comparative effect sizes for each active arm against treatment as usual, at end of treatment and at 12-month follow-up. Results: Compared with treatment as usual, combining trauma-focused therapy and pharmacotherapy for substance use disorders showed the largest comparative effect sizes for PTSD severity (d=−0.92, 95% CI=−1.57, −0.30) and alcohol use severity (d=−1.10, 95% CI=−1.54, −0.68) at end of treatment. Other treatments with large comparative effect sizes included pharmacotherapies for alcohol or other drug use disorders, trauma-focused integrated therapies, and trauma-focused nonintegrated therapies. Reductions in outcomes for PTSD symptoms and alcohol use were observed for nearly all treatments. Conclusions: The findings provide support for treating comorbid PTSD and substance use disorders using a variety of approaches, with alcohol-targeted pharmacotherapies and trauma-focused behavioral therapies as a combination of treatments that lead to early and sustained improvements in PTSD and alcohol use severity. Further treatment development is indicated for combining behavioral and pharmacological treatments for synergized impact and understanding the mechanisms of action and conditions under which each treatment type is optimized.

Comorbid posttraumatic stress disorder (PTSD) and substance use disorder is globally prevalent and costly. PTSD affects between 1.3% and 8.8% of the global population, depending on locale (1). Rates of substance use disorder are similarly high, with approximately 269 million people using drugs per year worldwide—a number that has increased by ~30% over 10 years—and some 35 million people suffering from a drug use disorder (2). Nearly three decades of published research has documented the devastating impact of comorbid PTSD and substance use disorder: longer hospital stays, lower treatment adherence, poorer treatment outcomes than either disorder alone, worse functioning, and higher suicide risk (3), all of which are linked to increased mortality (46).

The efficacy of various pharmacotherapies and behavioral treatments in addressing the complex comorbidity of PTSD and substance use disorder has increasingly been established, but these treatments vary in their approaches. The behavioral treatments in particular vary in the extent to which they focus on a single disorder (e.g., relapse prevention for substance use disorder [7] and prolonged exposure for PTSD [8]) or integrate PTSD and substance use treatment foci (e.g., Concurrent Treatment of PTSD and Substance Use Disorders Using Prolonged Exposure [COPE] [9]). Within PTSD-focused and integrated PTSD and substance use treatments, interventions vary with respect to whether they focus on trauma-related memories and content (trauma-focused treatments; e.g., COPE) or do not (non-trauma-focused treatment; e.g., Seeking Safety therapy). While behavioral treatments have been shown to be effective for comorbid PTSD and substance use disorders, pharmacotherapies have typically targeted either alcohol use or PTSD, although there are some medications (such as sertraline) that may target both. Indeed, evidence from basic science research points to several neurobiological abnormalities that are common to both sets of disorders, including disruptions in dopamine, norepinephrine, and serotonin systems (10, 11).

The fact that most of these treatment approaches have rarely been compared with each other (see reference 12 for an exception) has made it difficult to determine best practices in treating comorbid PTSD and alcohol or other drug use disorders. Furthermore, data syntheses, such as systematic reviews and meta-analyses, are marked by small sample sizes, high attrition, and lack of demographic diversity (6, 1320; D.A. Hien et al., 2021, unpublished). Hence, researchers and policy makers have been unable to make recommendations for practitioners about comparative effectiveness across treatment modalities or their combinations.

Table 1Table 1.2

To provide definitive guidance on the most effective treatment strategies for comorbid PTSD and substance use disorder, we integrated raw individual patient data from 36 representative randomized controlled trials using a “virtual clinical trial” (13) model combining integrative data analysis, propensity score weighting, and meta-analysis of individual patient data frameworks to accomplish what no single, multisite, or traditional meta-analysis could accomplish given the real-world clinical challenges of studying this common, yet underserved population. In our focal analysis of data for the Project Harmony Virtual Clinical Trials study, we conducted a comparative effectiveness analysis of each of eight active treatment classifications and one pharmacotherapy treatment classification, compared with behavioral treatment as usual on outcomes for PTSD and alcohol or other drug use at end of treatment and at an estimated 12-month follow-up.

METHODS

The methods are described in detail in our study protocol (13).

Study Design, Study Selection, and Participants

The analysis was conducted in compliance with the Preferred Reporting Items for Systematic Reviews and Meta-ANALYSIS (PRISMA) Individual Patient Data Statement (21). Criteria for study inclusion were 1) randomized clinical trial of a psychological and/or pharmacological intervention targeting either PTSD symptoms, alcohol or other drug use disorder symptoms, or both; 2) pre- and posttreatment collection of PTSD and substance use outcomes; and 3) an adult sample (age 18 and above) with a current diagnosis of full or subthreshold PTSD according to DSM-IV or DSM-5 criteria (subthreshold PTSD was defined as meeting PTSD criteria A, B, E, F, and either C or D [22]) and a current substance use disorder diagnosis (alcohol or other drug abuse or dependence in DSM-IV, and substance use disorder in DSM-5). Upon confirmation of study eligibility, data were requested from authors of eligible studies (i.e., the participating principal investigators). The present study was reviewed and approved by the institutional review boards of RTI International and Rutgers University. Permission to use data from 49 studies was requested, and we acquired data from 36 trials (N=4,046; see Table 1, the PRISMA chart in Figure 1, and the online supplement).

TABLE 1.

TABLE 1TABLE 1.2

FIGURE 1. PRISMA study selection flow diagram for a meta-analysis of comorbid PTSD and substance use disordersa.

Figure 1

Coding of treatment classifications.

Treatment conditions, based on groupings of each within-study treatment arm, were defined and coded according to whether the treatment was 1) trauma focused, 2) an integrated PTSD and alcohol or other drug treatment, 3) a pharmacotherapy that targeted PTSD (e.g., sertraline, paroxetine), 4) a pharmacotherapy that targeted alcohol or other drug use (e.g., methadone, naltrexone), 5) solely a behavioral treatment for alcohol or other drug use disorder, or 6) a nonmanualized, community-based treatment (i.e., treatment as usual). These groupings were not mutually exclusive.

Individual-level covariates.

The following variables were examined as covariates: gender, age, race/ethnicity, education level, population type (civilian, veteran, incarcerated), treatment dosage (proportion of available sessions attended or study medication doses taken), baseline diagnosis of current major depressive disorder, and concomitant non-study psychotropic medication use at baseline. Because treatments were grouped across studies, the original within-study randomization structure no longer holds, leading to possible relations between covariates and the “new” treatment classifications, which required mitigation using propensity score weighting (13, 23).

Primary Outcomes of Interest

Latent PTSD severity.

A total of 42 PTSD indicators (21 symptoms from a clinical interview and 21 self-report symptoms) were harmonized across the studies that had item-level PTSD data and were used to formulate the indicators of a 42-item latent PTSD construct estimated under the moderated nonlinear factor analysis (MNLFA) framework (24, 25) (considerable detail on MNLFA scale score estimation and item parameters is provided in the online supplement). The 42 symptoms include a mix of the 16 PTSD symptoms that are common to both the DSM-IV and DSM-5 diagnostic criteria, the one symptom that is unique to DSM-IV (sense of foreshortened future), and the four symptoms that are unique to DSM-5.

Latent substance use severity.

Latent substance use severity scores were also estimated under MNLFA. Binary indicators of any past-30-day use of the following substances were used to support a six-indicator latent substance use variable: cocaine, heroin, opioids (excluding heroin), sedatives, other stimulants (excluding cocaine), and hallucinogens.

Latent alcohol use.

A latent alcohol use variable was estimated under MNLFA using two indicators: number of days of alcohol use in the past 30 days and any alcohol use to intoxication in the past 30 days.

RESULTS

Sample Characteristics

The mean age in the sample was 39.0 years (SD=11.2); 53% of participants were male, 65% were White, 25% were African American, and 7% were Hispanic. Additional descriptive statistics (overall and treatment class–specific) are provided in the online supplement. To ensure raw data integrity, descriptive statistics for each study were checked for comparability against published descriptive data from the original trials. An analysis comparing descriptive data from the trials that were included here with the published descriptive data for the trials whose raw data we were unable to acquire revealed no statistically significant differences (all p values >0.17), suggesting that the data we acquired generalize to the universe of eligible randomized controlled trials.

Mitigation of Covariate Imbalance via Propensity Score Weighting

Propensity scores were estimated using a multinomial logit model with all covariates and study-level fixed effects using SAS Proc GLIMMIX. Covariate balance across treatment classes was achieved for all covariates after propensity score weighting, with all postweighting balance checks below a d value of |0.10| (see the online supplement). Thus, the inverse probability treatment weightings were of sufficient quality for use in primary outcomes analysis.

Outcomes Models

The primary analysis model was an inverse probability treatment weighting, three-level linear mixed model (using Proc MIXED in SAS) to account for 1) clustering of repeated observations within participants and 2) participants clustered within studies (i.e., one-stage meta-analysis of individual patient data). A study-level random effect was specified for the intercept, and participant-level random effects for the intercept and slopes were also included. Model results for all fixed-effect parameter estimates and standard errors, including two-way interaction effects with treatment phase and posttreatment phase time variables (i.e., single intervention treatment effects) and three-way interaction effects (i.e., treatment effects of combinations of interventions), were combined across the 20 multiply imputed, synthetic data sets using Proc MIANALYZE in SAS. Model estimates were then converted into model-based Cohen’s d effect sizes by using the methods of conversion outlined in reference 26.

PTSD Severity Outcomes

End-of-treatment data.

For the treatment-as-usual primary comparator condition, reductions in PTSD symptom severity by end of treatment corresponded to a d value of −0.61 (95% CI=−0.72, −0.52). Comparative effect sizes against treatment as usual (see Table 2 and the online supplement) that were both statistically significant and reached at least Cohen’s convention for small comparative effect sizes (d>|0.20|) were, in ascending order, placebo medication (d=−0.32, 95% CI=−0.53, −0.12), pharmacotherapy for alcohol or other drug use (d=−0.41, 95% CI=−0.77, −0.08), integrated trauma-focused therapies (d=−0.47, 95% CI=−0.94, −0.01), and behavioral therapies for alcohol or other drug use (d=−0.60, 95% CI=−0.80, −0.38). The largest comparative effect size overall was for the combination of trauma-focused therapies and pharmacotherapy for alcohol or other drug use (d=−0.92, 95% CI=−1.57, −0.30). Comparative effect sizes that exceeded a d value of |0.20| but were not statistically significant were observed for nonintegrated trauma-focused therapies (d=−0.24, 95% CI=−0.50, 0.01) and pharmacotherapies for PTSD (d=−0.41, 95% CI=−0.79, 0.24). The study-level intraclass correlation in this model was significant (τ2=0.116, z=3.54, p<0.001), suggesting significant heterogeneity in latent PTSD severity across studies. (Comparisons between pharmacotherapies and combination behavioral and pharmacotherapy interventions against placebo medication were also conducted; see Table S12 in the online supplement.)

TABLE 2.
Table 2

12-month follow-up.

For the treatment-as-usual primary comparator condition, reductions in PTSD symptom severity at 12-month follow-up corresponded to a d value of −1.16 (95% CI=−1.40, −0.92). The following treatments or treatment combinations were statistically superior to treatment as usual, with meaningful comparative effect sizes, in ascending order: nonintegrated trauma-focused therapies (d=−0.46, 95% CI=−0.93, −0.04), placebo medication (d=−0.57, 95% CI=−1.08, −0.01), pharmacotherapy for alcohol or other drug use (d=−1.37, 95% CI=−2.15, −0.63), and combined trauma-focused therapy and pharmacotherapy for alcohol or other drug use (d=−2.00, 95% CI=−3.38, −0.68). Integrated therapies showed meaningful effect size differences compared with treatment as usual but were nonsignificant (d=−0.22, 95% CI=−0.54, 0.09).

Alcohol Severity Outcomes

End-of-treatment data.

For the treatment-as-usual primary comparator condition, reductions in alcohol severity at end of treatment corresponded to a d value of −0.37 (95% CI=−0.44, −0.30). Comparative effect sizes against treatment as usual that were statistically significant and reached Cohen’s convention for a small comparative effect size (d>|0.20|) were (in ascending order) trauma-focused integrated behavioral treatments (d=−0.42, 95% CI=−0.74, −0.10), trauma-focused nonintegrated behavioral treatments (d=−0.45, 95% CI=−0.64, −0.26), placebo medication (d=−0.47, 95% CI=−0.64, −0.31), and pharmacotherapy for alcohol or other drug use (d=−0.83, 95% CI=−1.07, −0.60). Again, the largest comparative effect size overall was for the combination of trauma-focused therapies and pharmacotherapy for alcohol or other drug use (d=−1.10, 95% CI=−1.54, −0.68). The study-level intraclass correlation in this model was significant (τ2=0.067, z=4.02, p<0.001), suggesting significant heterogeneity in latent alcohol use severity across studies.

12-month follow-up data.

For the treatment-as-usual primary comparator condition, reductions in alcohol use severity by 12-month follow-up corresponded to a d value of −0.36 (95% CI=−0.50, −0.22). The following treatments or treatment combinations were statistically superior to treatment as usual, with meaningful comparative effect sizes: pharmacotherapy for alcohol or other drug use alone (d=−0.84, 95% CI=−1.30, −0.41) and the combination of trauma-focused therapy and pharmacotherapy for alcohol or other drug use (d=−1.24, 95% CI=−2.03, −0.40). Placebo medication (d=−0.29, 95% CI=−0.65, −0.09) and nonintegrated trauma-focused therapies (d=−0.24, 95% CI=−0.51, 0.03) showed meaningful effect size differences compared with treatment as usual but were nonsignificant.

Drug Use Severity Outcomes

End-of-treatment data.

For the treatment-as-usual primary comparator condition, reductions in drug use severity by end of treatment corresponded to d value of −0.53 (95% CI=−0.61, −0.47). There were no comparative effect sizes that were statistically significant or larger than Cohen’s convention for a small comparative effect size (d>|0.20|). The study-level intraclass correlation in this model was significant (τ2=0.246, z=3.99, p<0.001), suggesting significant heterogeneity in latent drug use severity across studies.

12-month follow-up data.

For the treatment-as-usual primary comparator condition, reductions in drug use severity by 12-month follow-up corresponded to a d value of −0.63 (95% CI=−0.78, −0.47). None of the treatment combinations was statistically superior to treatment as usual, but pharmacotherapy for drug use (d=−0.31, 95% CI=−0.79, 0.11) and the combination of trauma-focused therapy and pharmacotherapy for drug use (d=−0.27, 95% CI=−1.07, 0.53) had small comparative effect sizes, respectively, compared with treatment as usual. Pharmacotherapy for PTSD (d=0.82, 95% CI=−1.20, 2.99) had a comparative effect size that suggested worse drug use outcomes compared with treatment as usual.

Table 2

Risk of bias analysis.

Studies were assessed for risk of bias based on the Cochrane risk-of-bias assessment tool, version 2 (27, 28), with two independent raters per study. A reanalysis of all outcome models was conducted, with six of the 36 studies removed from the analysis; three were judged as having a high risk of bias (2931), one was judged as having an unclear risk of bias because the report on primary outcomes has yet to be published (32), and two were unpublished (M. Saladin, unpublished; S. Sonne, unpublished). A comparison of comparative effect sizes from the full data set versus the data set with studies at high risk of bias excluded showed no differences in effect sizes greater than |0.06| except for one effect: the PTSD medication comparative effect size on PTSD symptom severity at 12-month follow-up was −1.01 when restricted to the studies at low to moderate risk of bias (it was −0.04 with the full data set).

DISCUSSION

To date, systematic reviews and conventional meta-analyses in the area of treating comorbid PTSD and substance use disorders have left unanswered questions regarding the comparative effectiveness of behavioral and pharmacological treatments because, among other limitations (6, 33; D.A. Hien et al., unpublished), these methodologies have not allowed for direct head-to-head comparisons. The present study used a “virtual clinical trial” framework (13) to compare multiple sets of behavioral and pharmacological treatments for comorbid PTSD and alcohol or other drug use disorders using a single-stage individual-patient meta-analysis framework. The findings revealed that two broad groups of treatments—pharmacotherapy for alcohol use, and trauma-focused behavioral interventions—were significantly and consistently more likely to lead to improvements by end of treatment, which were sustained at 12-month follow-up for PTSD and alcohol use symptom severity. Notably, the strongest comparative effects appeared to favor the combination of trauma-focused treatments and alcohol-targeted pharmacotherapy when compared with behavioral treatment as usual and with placebo medication (see the online supplement). Indeed, this was the only treatment class that was superior to both treatment as usual and placebo medication.

Our findings regarding trauma-focused behavioral PTSD treatments provide support for some of the more tentative conclusions regarding efficacy previously drawn from systematic reviews and traditional meta-analyses (6, 1317, 19, 20, 33). The present study extends our knowledge substantially by demonstrating direct and significant impacts of treatment interventions on alcohol use severity for the first time, and underscores the efficacy of pharmacotherapy targeting alcohol use disorders that are comorbid with PTSD. In contrast, none of the treatment groups were superior to treatment as usual for drug use severity at either time point, although there were two pharmacotherapy effect sizes (for alcohol pharmacotherapy and for trauma-focused and alcohol pharmacotherapy combined) for drug use severity at 12 months posttreatment that were clinically meaningful. We have posited that for drug use outcomes, the mechanisms for improvement may differ from those for alcohol use, and involve more downstream impacts where changes in PTSD symptoms mediate changes in drug use (e.g., references 3436). Interestingly, pharmacotherapies for PTSD appeared to lead to clinical worsening across both drug use and alcohol use outcomes by 12-month follow-up; further study is needed to determine conditions for efficacy (such as moderator and mediator analyses).

Many single-site randomized controlled trials and conventional meta-analyses of treatments addressing comorbid PTSD and substance use disorders have shown robust clinical impacts on PTSD outcomes (6, 14) but have not shown consistent superiority on alcohol or drug use. The direct impacts of treatments for comorbid PTSD and substance use disorders on alcohol and other drug outcomes have been modest, if any, providing practitioners with far less clarity on the best research-informed practices to address alcohol and drug use disorders. In contrast, the present study is the first analysis to show consistent and direct effects of interventions for comorbid PTSD and alcohol or other drug use disorders—and specifically PTSD interventions with pharmacotherapies for substance use disorders—on alcohol severity outcomes above and beyond treatment as usual.

While in line with anecdotal clinical practice and knowledge (37), support for a particular intervention combination—trauma-focused behavioral treatment paired with an alcohol-targeting medication—may advance the field significantly (37, 38), although it should be noted that this treatment class was based on only two trials (cognitive processing therapy and zonisamide [39], and prolonged exposure and naltrexone [38]) and thus should be replicated for confirmation. To date, the number of pharmacotherapy trials for comorbid PTSD and substance use disorders remains small (20, 40) and formal meta-analytic study is lacking, so pharmacotherapy trial results have been unable to provide a strong signal in any particular direction. In contrast, the methods in the present study integrated 36 trials to 1) enlarge sample size, 2) address measurement variation, 3) increase population diversity, and 4) boost statistical power, and the results have illuminated previously unknown synergies between trauma-focused behavioral treatment and alcohol-targeted pharmacotherapy, suggesting that their combination may amplify their respective effects. Notably, even when offered alone or as a placebo, pharmacotherapies for alcohol use disorder (N-acetylcysteine, naltrexone, paroxetine, prazosin, sertraline, topiramate, and zonisamide) exerted medium to large effects on PTSD and alcohol use outcomes. However, the underrepresentation of studies combining pharmacotherapy with behavioral treatments (i.e., trauma-focused integrated treatments and PTSD-targeted pharmacotherapies combined with a behavioral platform) in the present study underscores the need for investments in novel combined behavioral and pharmacotherapy trials.

Integrated non-trauma-focused approaches—the most widely disseminated treatments for comorbid PTSD and substance use disorders provided in community-based settings, due to feasibility and acceptability—had small to medium effects on PTSD outcomes. They showed lower impacts on drug use outcomes but, notably, were similar to treatment as usual and behavioral approaches in outcomes for alcohol and other drug use across the end-of-treatment and 12-month time frames. Integrated non-trauma-focused treatments typically provide psychoeducation on the relationship between PTSD and alcohol or drug use. In contrast to trauma-focused treatments, these behavioral approaches largely avoid explicit trauma processing and focus on addressing trauma’s current impact (e.g., identifying triggers for relapse, setting boundaries in relationships, distinguishing between safe and unsafe situations, and managing intense emotional responses). Although we see that these models do have benefits (and do not lead to symptom worsening across the board), the effect sizes are much smaller relative to treatment as usual and do not reach statistical significance, in contrast to the trauma-focused integrated and trauma-focused nonintegrated models overall.

Eight of the nine treatments evaluated for comorbid PTSD and alcohol or other drug use disorders, including the treatment-as-usual and placebo comparators, had positive effects on PTSD, alcohol, and drug use severity outcomes at end of treatment. This was observed regardless of type, category, or target of approach (effect sizes ranging from small to large), except for PTSD pharmacotherapy at 12 months posttreatment on drug use outcomes. Also, regardless of whether or not the substance use disorder or PTSD is directly targeted, our analysis indicates that many approaches have some benefits—benefits that may extend beyond the targeted outcomes of the individual type of approach. For example, naltrexone, which is typically used to reduce alcohol cravings and other symptoms of alcohol dependence, also has effects on reducing PTSD symptom severity. Likewise, prolonged exposure, typically used to address PTSD symptoms, also has effects on both alcohol and drug use outcomes.

This analysis focused primarily on the question regarding overall comparative effectiveness across treatment platforms for comorbid PTSD and substance use disorders. Although additional analyses that are specific to optimizing matches between treatment platforms and patient characteristics (i.e., moderation) and the extent to which alcohol and other drug effects across treatment platforms are transmitted through PTSD (i.e., mediation) are planned (13), these issues are beyond the scope of this report. Therefore, we underscore that the findings presented are limited to the overall sample; we caution practitioners away from drawing conclusions about comparative effectiveness for subsamples (such as women only or veterans only). Our comparative effectiveness analysis focused on treatment effects in comparison with behavioral treatment as usual and did not aim to address direct head-to-head comparisons between the eight active classifications; however, the information needed to calculate specific comparative effect sizes between any two treatments not involving treatment as usual as the comparator is available in the online supplement. Instead, we highlight the importance of having many different treatment options for individuals with comorbid PTSD and substance use disorder. This may be one reason that the findings for significant pharmacotherapy effects were spotlighted, given that the typical pharmacotherapy trial compares active pharmacotherapies with placebo and not treatment as usual.

Our 36 studies included trials of 10 different medications (or combinations of medications) and multiple trauma-focused therapies, with at least three trials of the COPE intervention and eight trials of interventions based on Seeking Safety therapy. This represents many active treatment classifications, extracted from the 36 studies for which we were able to obtain data. We present the review findings based on categorization that we reference from the literature (6) and a recent publication from our team (41) that focuses on how interventions impacted outcomes (PTSD only, alcohol or other drug use disorder only, or comorbid PTSD and alcohol or other drug use disorder), and have reorganized the intervention types along several different vectors of classification, including target of the intervention (integrated vs. nonintegrated), disorder(s) of focus (PTSD only, alcohol or other drug use disorder only, or comorbid PTSD and alcohol or other drug use disorder), treatment modality (behavioral or pharmacologic), and whether the behavioral intervention is trauma focused or non–trauma focused.

All individual patient data meta-analyses are limited by what trials are available, and in the case of comorbid PTSD and alcohol and other drug use disorders, the studies are quite diverse, and therefore our findings still need replication, and further analyses focusing on individual differences and other comparators are needed to determine treatment-matching goals (13). Yet, these findings can serve as guideposts for which promising combinations of treatments and understudied treatments warrant further examination in future trials.

Limitations

While our combination of integrative data analysis and “one-stage” meta-analysis of individual patient data constitutes a more robust and precise method for estimating cross-study variation in measurement and treatment outcomes compared with other approaches (e.g., “two-stage” meta-analysis of individual patient data, conventional meta-analysis) (42), this study has some limitations. First, as with all treatment outcomes for randomized controlled trials, the findings of this study can only be generalized to individuals who volunteer to participate in randomized clinical studies. Future analysis of the Project Harmony data set could explore estimation of treatment effects that could generalize to the larger population of treatment seekers (43). Second, the results from the study suggested statistically significant study-level heterogeneity for all three outcomes. The more immediate cause of study-level heterogeneity in outcomes is the differences in inclusion criteria across studies (e.g., full PTSD vs. subthreshold PTSD), which both directly and indirectly impact variation in the study-level mean values of baseline severity measures of PTSD and substance use disorders at baseline. As structured, the covariates in the propensity score weighting model and the treatment class variables vary within the trial, and are thus between-individual predictors, which do not reduce unexplained variability at the study level. Inclusion of study-aggregated and (study-centered) individual-level moderators will reduce unexplained variability at the study level in continuing analysis of the Project Harmony data set (13).

Although the included trials aimed to be diverse with regard to inclusion, quasi-experimental designs and single-group studies were excluded; however, selection biases that may be created by “mixing and matching” treatment classes across randomized controlled trials in meta-analyses of individual patient data (13, 44, 45) were mitigated by propensity score weighting specifically for those types of designs (46, 47). Further, our risk-of-bias analyses, in which studies at high risk of bias were excluded, were robust to risk of bias across all comparative effect sizes except one, suggesting that our findings are robust to variation in trial design quality. Finally, our study generalizability analysis suggested that the studies we were able to include were representative of the larger universe of randomized controlled trials that we identified for potential inclusion in the study.

CONCLUSIONS

The comparative effectiveness results from this meta-analysis of individual patient data extend and offer greater precision than other forms of evidence synthesis as to which behavioral and pharmacological treatments, or their combination, are most effective in addressing PTSD and substance use disorder in individuals with both disorders, when holding a number of critical individual characteristics constant. The findings show that there are several effective options and that trauma-focused therapies combined with pharmacotherapy for alcohol use disorder significantly and consistently led to early and sustained improvements on both PTSD and alcohol use outcomes.

The indication of benefits of trauma-focused and combined alcohol pharmacotherapy may be an important beacon for service providers and users. This is particularly salient given the earlier adoption by the substance use treatment community of non-trauma-focused treatments (48), largely due to clinician and/or client fears that trauma processing may worsen PTSD or substance use. The present study findings demonstrate not only that individuals with comorbid PTSD and alcohol use disorders derive direct benefits in their drinking outcomes from trauma processing therapies, but also that they are able to tolerate the trauma-focused approaches, with PTSD effect sizes similar to those observed in individuals without substance use disorders (15). The findings show that this was the case whether or not treatments are offered in an integrated fashion (i.e., the behavioral treatment includes some content that addresses the relationship between PTSD and substance use across the majority of treatment sessions); study participants did not relapse in the process. On a policy level, our findings support the contention that there are “no wrong doors” (17) regarding the delivery of substance use intervention services that integrate PTSD treatment alongside them, as opposed to isolating approaches to substance use and PTSD in distinct services. However, as the findings provide clearer support for trauma-focused interventions, alcohol-targeted pharmacotherapy, and their combination, it does appear that “some doors are better than others.”

Abstract

Objective: Treatment efficacy for co-occurring posttraumatic stress disorder (PTSD) and substance use disorders is well established, yet direct evidence for comparative effectiveness across treatments is lacking. The present study compared the effectiveness of several behavioral and pharmacological therapies for adults with co-occurring PTSD and alcohol or other drug use disorders. Methods: A systematic search of PsycINFO, MEDLINE, and ClinicalTrials.gov was conducted through December 2020 for trials targeting PTSD, alcohol or other drug use disorders, or both disorders (36 studies, N=4,046). Primary outcomes were severity scores for PTSD, alcohol use, and drug use, estimated via moderated nonlinear factor analysis. Propensity score weight–adjusted multilevel models were used. Model-predicted effect sizes were estimated for each treatment, and comparative effect sizes for each active arm against treatment as usual, at end of treatment and at 12-month follow-up. Results: Compared with treatment as usual, combining trauma-focused therapy and pharmacotherapy for substance use disorders showed the largest comparative effect sizes for PTSD severity (d=−0.92, 95% CI=−1.57, −0.30) and alcohol use severity (d=−1.10, 95% CI=−1.54, −0.68) at end of treatment. Other treatments with large comparative effect sizes included pharmacotherapies for alcohol or other drug use disorders, trauma-focused integrated therapies, and trauma-focused nonintegrated therapies. Reductions in outcomes for PTSD symptoms and alcohol use were observed for nearly all treatments. Conclusions: The findings provide support for treating comorbid PTSD and substance use disorders using a variety of approaches, with alcohol-targeted pharmacotherapies and trauma-focused behavioral therapies as a combination of treatments that lead to early and sustained improvements in PTSD and alcohol use severity. Further treatment development is indicated for combining behavioral and pharmacological treatments for synergized impact and understanding the mechanisms of action and conditions under which each treatment type is optimized.

Summary

Comorbid posttraumatic stress disorder (PTSD) and substance use disorder represents a significant global health concern, characterized by high prevalence rates and substantial associated costs. Existing research demonstrates a negative impact on various health outcomes, including treatment adherence, functional impairment, and increased mortality risk. While various pharmacotherapies and behavioral interventions have shown efficacy, their comparative effectiveness remains unclear due to limitations in previous research methodologies.

Treatment Approaches and Limitations

Existing treatment approaches for comorbid PTSD and substance use disorder vary considerably, ranging from single-disorder focused interventions (e.g., relapse prevention for substance use disorder, prolonged exposure for PTSD) to integrated approaches that concurrently address both conditions (e.g., COPE). Furthermore, within PTSD-focused treatments, approaches differ in their emphasis on trauma-related content. Despite demonstrated efficacy, comparative effectiveness analyses of these diverse approaches have been hampered by small sample sizes, high attrition rates, and a lack of demographic diversity in previous studies.

Study Design and Methodology

To address these limitations, a "virtual clinical trial" was conducted, integrating individual patient data from 36 randomized controlled trials. This innovative approach leveraged integrative data analysis, propensity score weighting, and meta-analysis of individual patient data to conduct a robust comparative effectiveness analysis of nine treatment classifications (eight active treatments and one pharmacotherapy) against a behavioral treatment-as-usual comparator. The analysis focused on PTSD and alcohol or other drug use outcomes at both end-of-treatment and 12-month follow-up assessments. Stringent inclusion criteria ensured data quality and compliance with PRISMA-IPD guidelines. Propensity score weighting mitigated covariate imbalance, accounting for potential confounding factors. Latent variable modeling was used to create harmonized outcome measures.

Results: PTSD and Substance Use Severity

The analysis revealed that several treatment approaches significantly improved PTSD and alcohol use severity outcomes compared to treatment-as-usual. Specifically, pharmacotherapy for alcohol use, and trauma-focused behavioral interventions demonstrated consistent efficacy across both time points. The combination of trauma-focused therapies and alcohol-targeted pharmacotherapy yielded the strongest effects. In contrast, no treatment group exhibited statistically superior outcomes for drug use severity. Risk-of-bias analysis indicated robustness of the findings.

Discussion: Implications for Clinical Practice and Future Research

These findings provide crucial insights for clinical practice, supporting the efficacy of trauma-focused behavioral treatments and pharmacotherapy for alcohol use disorder, particularly their combined application. The results challenge previous assumptions regarding the limited impact of treatments on substance use outcomes and underscore the potential of synergistic effects. Limitations include generalizability to the broader population of treatment-seekers and the need for further research to address study-level heterogeneity. However, the study's large sample size, rigorous methodology, and exploration of multiple treatment classes provide valuable guidance for practitioners and policy makers, informing best practices for treating this complex comorbidity.

Abstract

Objective: Treatment efficacy for co-occurring posttraumatic stress disorder (PTSD) and substance use disorders is well established, yet direct evidence for comparative effectiveness across treatments is lacking. The present study compared the effectiveness of several behavioral and pharmacological therapies for adults with co-occurring PTSD and alcohol or other drug use disorders. Methods: A systematic search of PsycINFO, MEDLINE, and ClinicalTrials.gov was conducted through December 2020 for trials targeting PTSD, alcohol or other drug use disorders, or both disorders (36 studies, N=4,046). Primary outcomes were severity scores for PTSD, alcohol use, and drug use, estimated via moderated nonlinear factor analysis. Propensity score weight–adjusted multilevel models were used. Model-predicted effect sizes were estimated for each treatment, and comparative effect sizes for each active arm against treatment as usual, at end of treatment and at 12-month follow-up. Results: Compared with treatment as usual, combining trauma-focused therapy and pharmacotherapy for substance use disorders showed the largest comparative effect sizes for PTSD severity (d=−0.92, 95% CI=−1.57, −0.30) and alcohol use severity (d=−1.10, 95% CI=−1.54, −0.68) at end of treatment. Other treatments with large comparative effect sizes included pharmacotherapies for alcohol or other drug use disorders, trauma-focused integrated therapies, and trauma-focused nonintegrated therapies. Reductions in outcomes for PTSD symptoms and alcohol use were observed for nearly all treatments. Conclusions: The findings provide support for treating comorbid PTSD and substance use disorders using a variety of approaches, with alcohol-targeted pharmacotherapies and trauma-focused behavioral therapies as a combination of treatments that lead to early and sustained improvements in PTSD and alcohol use severity. Further treatment development is indicated for combining behavioral and pharmacological treatments for synergized impact and understanding the mechanisms of action and conditions under which each treatment type is optimized.

Summary

Comorbid posttraumatic stress disorder (PTSD) and substance use disorder is a significant global health concern, characterized by poorer treatment outcomes, reduced functioning, and elevated suicide risk compared to either disorder alone. While various pharmacotherapies and behavioral treatments exist, their comparative effectiveness remains unclear due to limitations in previous research, including small sample sizes and a lack of demographic diversity in existing studies.

Treatment Approaches and Existing Research Gaps

Behavioral treatments range from those focusing on a single disorder (e.g., relapse prevention for substance use disorder or prolonged exposure for PTSD) to integrated approaches targeting both simultaneously (e.g., COPE). Pharmacotherapies often address either alcohol use or PTSD symptoms, though some medications may impact both. Neurobiological similarities between PTSD and substance use disorders, involving dopamine, norepinephrine, and serotonin systems, suggest shared mechanisms. However, limited head-to-head comparisons of treatment approaches hinder the determination of best practices.

Study Design and Methodology

This study utilized a “virtual clinical trial” approach, integrating individual patient data from 36 randomized controlled trials (N=4,046). A comparative effectiveness analysis was conducted using integrative data analysis, propensity score weighting, and meta-analysis of individual patient data, comparing eight active treatment classifications and one pharmacotherapy classification against a behavioral treatment-as-usual control. Outcomes included latent PTSD and substance use severity, measured at treatment's end and at a 12-month follow-up. Propensity score weighting addressed covariate imbalance across treatment groups. Statistical analyses employed mixed-effects models to account for data clustering within participants and studies.

Results: PTSD and Substance Use Severity

End-of-treatment results showed that, compared to treatment-as-usual, combined trauma-focused therapies and pharmacotherapy for alcohol or other drug use demonstrated the largest reduction in PTSD symptom severity. Pharmacotherapy for alcohol or other drug use, integrated trauma-focused therapies, and behavioral therapies for alcohol or other drug use also showed significant improvements. At the 12-month follow-up, the combined trauma-focused and alcohol-targeted pharmacotherapy again exhibited the most substantial reduction in PTSD severity, followed by pharmacotherapy for alcohol or other drug use and nonintegrated trauma-focused therapies.

For alcohol use, at treatment's end, pharmacotherapy for alcohol or other drug use, along with trauma-focused behavioral interventions (integrated and nonintegrated), showed significant improvement over treatment-as-usual. The combination of trauma-focused therapies and pharmacotherapy for alcohol or other drug use yielded the largest effect size. At 12 months, pharmacotherapy for alcohol use and the combined trauma-focused and alcohol-targeted pharmacotherapy remained significantly superior to treatment-as-usual.

For drug use, no treatment class demonstrated significant superiority to treatment-as-usual at either time point.

Discussion and Conclusion

This study offers a more precise estimation of comparative treatment effectiveness than previous meta-analyses. Trauma-focused behavioral interventions and pharmacotherapy for alcohol use, particularly when combined, showed significant and sustained improvements in PTSD and alcohol use outcomes. While several treatments demonstrated benefits, the combination of trauma-focused therapy and alcohol-targeted pharmacotherapy emerged as particularly effective. These findings underscore the importance of integrated approaches and highlight promising avenues for future research. Limitations include generalizability to only individuals participating in clinical trials and the presence of study-level heterogeneity. Future research should explore potential moderators and mediators of treatment effects.

Abstract

Objective: Treatment efficacy for co-occurring posttraumatic stress disorder (PTSD) and substance use disorders is well established, yet direct evidence for comparative effectiveness across treatments is lacking. The present study compared the effectiveness of several behavioral and pharmacological therapies for adults with co-occurring PTSD and alcohol or other drug use disorders. Methods: A systematic search of PsycINFO, MEDLINE, and ClinicalTrials.gov was conducted through December 2020 for trials targeting PTSD, alcohol or other drug use disorders, or both disorders (36 studies, N=4,046). Primary outcomes were severity scores for PTSD, alcohol use, and drug use, estimated via moderated nonlinear factor analysis. Propensity score weight–adjusted multilevel models were used. Model-predicted effect sizes were estimated for each treatment, and comparative effect sizes for each active arm against treatment as usual, at end of treatment and at 12-month follow-up. Results: Compared with treatment as usual, combining trauma-focused therapy and pharmacotherapy for substance use disorders showed the largest comparative effect sizes for PTSD severity (d=−0.92, 95% CI=−1.57, −0.30) and alcohol use severity (d=−1.10, 95% CI=−1.54, −0.68) at end of treatment. Other treatments with large comparative effect sizes included pharmacotherapies for alcohol or other drug use disorders, trauma-focused integrated therapies, and trauma-focused nonintegrated therapies. Reductions in outcomes for PTSD symptoms and alcohol use were observed for nearly all treatments. Conclusions: The findings provide support for treating comorbid PTSD and substance use disorders using a variety of approaches, with alcohol-targeted pharmacotherapies and trauma-focused behavioral therapies as a combination of treatments that lead to early and sustained improvements in PTSD and alcohol use severity. Further treatment development is indicated for combining behavioral and pharmacological treatments for synergized impact and understanding the mechanisms of action and conditions under which each treatment type is optimized.

Summary

Posttraumatic stress disorder (PTSD) and substance use disorder frequently occur together, leading to serious problems. Many treatments exist, but comparing their effectiveness has been difficult due to limitations in previous research. This study used a large dataset from many trials to directly compare different treatments.

Study Design and Participants

Researchers analyzed data from 36 randomized controlled trials involving 4,046 adults with PTSD and a substance use disorder. These trials tested various behavioral and pharmacological treatments. The researchers used statistical methods to account for differences between the studies, ensuring a fair comparison.

Outcomes

The study measured PTSD and substance use severity at the end of treatment and at a 12-month follow-up. Results showed that:

  • Trauma-focused behavioral therapies, either alone or combined with medication for alcohol use, significantly improved PTSD and alcohol use symptoms. This improvement was maintained at the 12-month follow-up.

  • Medication for alcohol use significantly improved alcohol use, with effects lasting to the 12-month mark.

  • Treatments did not show significant improvement in drug use symptoms.

Discussion

This study provides strong evidence supporting the use of trauma-focused behavioral therapies, especially when combined with medication for alcohol use. These combined approaches produced the most substantial and lasting improvements. While other treatments showed some benefits, these combinations were most effective. Further research is needed to fully understand why certain treatments work better for different individuals and substances. There are still limitations concerning generalizability beyond the trials themselves.

Limitations

The study's findings are limited to participants in clinical trials. Study-level differences in the trials also led to some unexplained variation in results. However, the researchers used statistical methods to reduce the impact of this heterogeneity. The results are robust to variations in the quality of study design.

Conclusions

This large-scale analysis provides crucial information about effective treatments for PTSD and substance use disorders. The combined use of trauma-focused therapy and alcohol-focused medication appears to be a highly effective approach. These findings offer valuable guidance for clinicians and policymakers regarding treatment choices and service delivery.

Abstract

Objective: Treatment efficacy for co-occurring posttraumatic stress disorder (PTSD) and substance use disorders is well established, yet direct evidence for comparative effectiveness across treatments is lacking. The present study compared the effectiveness of several behavioral and pharmacological therapies for adults with co-occurring PTSD and alcohol or other drug use disorders. Methods: A systematic search of PsycINFO, MEDLINE, and ClinicalTrials.gov was conducted through December 2020 for trials targeting PTSD, alcohol or other drug use disorders, or both disorders (36 studies, N=4,046). Primary outcomes were severity scores for PTSD, alcohol use, and drug use, estimated via moderated nonlinear factor analysis. Propensity score weight–adjusted multilevel models were used. Model-predicted effect sizes were estimated for each treatment, and comparative effect sizes for each active arm against treatment as usual, at end of treatment and at 12-month follow-up. Results: Compared with treatment as usual, combining trauma-focused therapy and pharmacotherapy for substance use disorders showed the largest comparative effect sizes for PTSD severity (d=−0.92, 95% CI=−1.57, −0.30) and alcohol use severity (d=−1.10, 95% CI=−1.54, −0.68) at end of treatment. Other treatments with large comparative effect sizes included pharmacotherapies for alcohol or other drug use disorders, trauma-focused integrated therapies, and trauma-focused nonintegrated therapies. Reductions in outcomes for PTSD symptoms and alcohol use were observed for nearly all treatments. Conclusions: The findings provide support for treating comorbid PTSD and substance use disorders using a variety of approaches, with alcohol-targeted pharmacotherapies and trauma-focused behavioral therapies as a combination of treatments that lead to early and sustained improvements in PTSD and alcohol use severity. Further treatment development is indicated for combining behavioral and pharmacological treatments for synergized impact and understanding the mechanisms of action and conditions under which each treatment type is optimized.

Summary

Lots of people around the world have PTSD (Posttraumatic Stress Disorder) and problems with drugs or alcohol at the same time. This is a big problem because it makes people sicker and can even lead to death. Doctors and scientists are trying to find the best ways to help people get better.

Different Ways to Help

There are different ways to treat PTSD and substance use problems. Some focus on just one problem, like helping people stop using drugs (relapse prevention) or dealing with scary memories (prolonged exposure). Others try to treat both problems together (integrated treatment). Some treatments use medicine, and others use talking and learning new skills. Scientists know that the brain works differently in people with these problems, so they are working hard to figure out what works best.

Finding the Best Treatment

It's been hard to know which treatment is best because scientists haven't compared them all directly. Studies have had small numbers of people, and some people stopped going to treatment before it was finished.

A Big Study

Scientists looked at information from many studies to try and find out what works best. They put all the information together to make one giant study. This helped them see what treatments really worked well.

Results

They found that medicine for alcohol problems and treatments that help people deal with their trauma memories were very helpful. The best results came when people got both types of treatment. Helping people with drug problems was harder, and the scientists need to do more research to learn more.

What This Means

This big study shows that there are good ways to help people with PTSD and alcohol or drug problems get better. Working on trauma memories and using medicine for alcohol problems seems to work best. More studies are needed to help people with drug problems.

Footnotes and Citation

Cite

Hien, D. A., Morgan-López, A. A., Saavedra, L. M., Ruglass, L. M., Ye, A., López-Castro, T., Fitzpatrick, S., Killeen, T. K., Norman, S. B., Ebrahimi, C. T., & Back, S. E. (2023). Project Harmony: A Meta-Analysis With Individual Patient Data on Behavioral and Pharmacologic Trials for Comorbid Posttraumatic Stress and Alcohol or Other Drug Use Disorders. The American journal of psychiatry, 180(2), 155–166. https://doi.org/10.1176/appi.ajp.22010071

    Highlights