Person:

Weisz, John

Most everyday child and adolescent psychotherapy does not follow manuals that document the procedures. Consequently, usual clinical care has remained poorly understood and rarely studied. The Therapy Process Observational Coding System for Child Psychotherapy–Strategies scale (TPOCS–S) is an observational measure of youth psychotherapy procedures designed to support the study of usual clinical care by providing a means of characterizing it. Coders independently rated usual care therapy sessions conducted with 43 children (aged 8–15 years) diagnosed with anxiety and depressive disorders. The TPOCS–S showed good interrater reliability, its 5 subscales (e.g., Behavioral, Cognitive, Psychodynamic, Client-Centered, Family) showed good internal consistency, and analyses supported TPOCS–S validity.

Improving outcomes for children and adolescents with mental health needs demands a broad meta-systemic orientation to overcome persistent problems in current service systems. Improving outcomes necessitates inclusion of current and emerging evidence about effective practices for the diverse population of youth and their families. Key components of the meta-system for children with emotional or behavioral needs include families, cultural norms and values, and service sectors such as schools, pediatric health centers, specialty mental health systems, juvenile justice systems, child protection services, and substance use treatment systems. We describe each component of the meta-system, noting challenges to the provision of evidence-based practice (EBP) and highlighting ways to optimize outcomes. Our focus is on the inclusion of evidence-based assessment and interventions, including prevention, within a developmentally driven and culturally responsive contextual model. Recommendations for addressing disparities in research funding and essential steps to foster communication and coordination of EBP across settings are provided.

Objective: Most tests of cognitive behavioral therapy (CBT) for youth anxiety disorders have shown beneficial effects, but these have been efficacy trials with recruited youths treated by researcher-employed therapists. One previous (nonrandomized) trial in community clinics found that CBT did not outperform usual care (UC). The present study used a more stringent effectiveness design to test CBT versus UC in youths referred to community clinics, with all treatment provided by therapists employed in the clinics. Method: A randomized controlled trial methodology was used. Therapists were randomized to training and supervision in the Coping Cat CBT program or UC. Forty-eight youths (56% girls, 8 to 15 years of age, 38% Caucasian, 33% Latino, 15% African-American) diagnosed with DSM-IV anxiety disorders were randomized to CBT or UC. Results: At the end of treatment more than half the youths no longer met criteria for their primary anxiety disorder, but the groups did not differ significantly on symptom (e.g., parent report, eta-square = 0.0001; child report, eta-square = 0.09; both differences favoring UC) or diagnostic (CBT, 66.7% without primary diagnosis; UC, 73.7%; odds ratio 0.71) outcomes. No differences were found with regard to outcomes of comorbid conditions, treatment duration, or costs. However, youths receiving CBT used fewer additional services than UC youths (χ21 = 8.82, p = .006). Conclusions: CBT did not produce better clinical outcomes than usual community clinic care. This initial test involved a relatively modest sample size; more research is needed to clarify whether there are conditions under which CBT can produce better clinical outcomes than usual clinical care.

Objective: To support ongoing monitoring of child response during treatment, we sought to develop a brief, easily administered, clinically relevant, and psychometrically sound measure. Method: We first developed child and caregiver forms of a 12-item Brief Problem Checklist (BPC) interview by applying item response theory and factor analysis to Youth Self-Report (YSR; Achenbach & Rescorla, 2001) and Child Behavior Checklist (CBCL;Achenbach & Rescorla, 2001) data for a sample of 2,332 youths. These interviews were then administered weekly via telephone to an ethnically diverse clinical sample of 184 boys and girls 7–13 years of age and their caregivers participating in outpatient treatment, to examine psychometric properties and feasibility. Results: Internal consistency and test–retest reliability were excellent, and factor analysis yielded 1 internalizing and 1 externalizing factor. Validity tests showed large and significant correlations with corresponding scales on paper-and-pencil administrations of the CBCL and YSR as well as with diagnoses obtained from a structured diagnostic interview. Discriminant validity of the BPC interviews was supported by low correlations with divergent criteria. Longitudinal data for the initial 6 months of treatment demonstrated that the BPC significantly predicted change on related measures of child symptoms. Estimates obtained from random coefficient growth models showed generally higher slope reliabilities for the BPC given weekly relative to the CBCL and YSR given every 3 months. Conclusions: Given their combination of brevity and psychometric strength, the child and caregiver BPC interviews appear to be a promising strategy for efficient, ongoing assessment of clinical progress during the course of treatment.

Extensive research has linked youth depression symptoms to low levels of perceived control, using measures that reflect primary control (i.e., influencing objective conditions to make them fit one’s wishes). We hypothesized that depressive symptoms are also linked to low levels of secondary control (i.e., influencing the psychological impact of objective conditions by adjusting oneself to fit them). To test the hypothesis, we developed the Secondary Control Scale for Children (SCSC), examined its psychometrics, and used it to assess the secondary control-depression symptomatology association. In a large adolescent sample, the SCSC showed factorial integrity, internal consistency, test-retest stability, convergent and discriminant validity, and accounted for more than 40% of the variance in depression symptoms. Consistent with evidence on risk and gender, depression symptoms were more strongly associated with secondary control in girls and primary control in boys. Assessing secondary control may help us understand youth depression vulnerability in girls and boys.

Objective: Some critics of treatment manuals have argued that their use may undermine the quality of the client–therapist alliance. This notion was tested in the context of youth psychotherapy delivered by therapists in community clinics. Method: Seventy-six clinically referred youths (57% female, age 8–15 years, 34% Caucasian) were randomly assigned to receive nonmanualized usual care or manual-guided treatment to address anxiety or depressive disorders. Treatment was provided in community clinics by clinic therapists randomly assigned to treatment condition. Youth–therapist alliance was measured with the Therapy Process Observational Coding System—Alliance (TPOCS–A) scale at 4 points throughout treatment and with the youth report Therapeutic Alliance Scale for Children (TASC) at the end of treatment. Results: Youths who received manual-guided treatment had significantly higher observer-rated alliance than usual care youths early in treatment; the 2 groups converged over time, and mean observer-rated alliance did not differ by condition. Similarly, the manual-guided and usual care groups did not differ on youth report of alliance. Conclusions: Our findings did not support the contention that using manuals to guide treatment harms the youth–therapist alliance. In fact, use of manuals was related to a stronger alliance in the early phase of treatment.

Background: Evidence-based treatments for child mental health problems are not consistently available in public mental health settings. Expanding availability requires workforce training. However, research has demonstrated that training alone is not sufficient for changing provider behavior, suggesting that ongoing intervention-specific supervision or consultation is required. Supervision is notably under-investigated, particularly as provided in public mental health. The degree to which supervision in this setting includes ‘gold standard’ supervision elements from efficacy trials (e.g., session review, model fidelity, outcome monitoring, skill-building) is unknown. The current federally-funded investigation leverages the Washington State Trauma-focused Cognitive Behavioral Therapy Initiative to describe usual supervision practices and test the impact of systematic implementation of gold standard supervision strategies on treatment fidelity and clinical outcomes. Methods/Design The study has two phases. We will conduct an initial descriptive study (Phase I) of supervision practices within public mental health in Washington State followed by a randomized controlled trial of gold standard supervision strategies (Phase II), with randomization at the clinician level (i.e., supervisors provide both conditions). Study participants will be 35 supervisors and 130 clinicians in community mental health centers. We will enroll one child per clinician in Phase I (N = 130) and three children per clinician in Phase II (N = 390). We use a multi-level mixed within- and between-subjects longitudinal design. Audio recordings of supervision and therapy sessions will be collected and coded throughout both phases. Child outcome data will be collected at the beginning of treatment and at three and six months into treatment. Discussion This study will provide insight into how supervisors can optimally support clinicians delivering evidence-based treatments. Phase I will provide descriptive information, currently unavailable in the literature, about commonly used supervision strategies in community mental health. The Phase II randomized controlled trial of gold standard supervision strategies is, to our knowledge, the first experimental study of gold standard supervision strategies in community mental health and will yield needed information about how to leverage supervision to improve clinician fidelity and client outcomes. Trial registration ClinicalTrials.gov NCT01800266

Combining intervention diffusion with change in clinical practice and public policy is an ambitious agenda. The impressive effort in Hawaii can be instructive, highlighting questions for a science of treatment dissemination. Among these questions, some of the most important are the following: (a) Who should be targeted for change? (e.g., “downstream” clinicians in practice, “upstream” clinicians in training, consumers, “brokers,” policy makers, or payers?); (b) What should be disseminated? (e.g., full evidence-based protocols, specific treatment elements or “kernels”?); and (c) Which procedures maximize change? (e.g., what combination and duration of teaching, supervision, consultation, and other support?). Ultimately, change efforts need to assess what aspects of practice were actually altered, what measurable impact the changes had on clinical outcomes, and what changes in practices and outcomes can be sustained over time.

Current evidence-based assessment methods, such as structured interviews and lengthy assessment batteries, often require hours to administer, score, and interpret and thus are infrequently used in real-world practice. As evidence-based assessment tools are developed for implementation in real-world youth mental health settings, the transportability properties of assessment procedures (including administration and interpretation burden) need to be considered and improved. In the present study, we thus conducted an initial feasibility study using a clinical sample of community-based youths (N = 306) to develop an assessment protocol based on 2 child and 2 parent self-report questionnaires (thus low on administration burden). Using decision-tree analysis, we identified a series of cutoff scores across these scales that may be used to inform treatment need related to anxiety, depression, attention-deficit/hyperactivity disorder (ADHD), and disruptive behavior problems. This algorithm-based approach to interpreting assessment information provided clear and simple guidelines (thus low on interpretation burden) that matched the best estimate treatment determinations derived by trained assessors, supervisors, and expert consultants who integrated information provided by child and parent structured interviews and self-report scales. The present study demonstrated the feasibility of developing an assessment protocol to inform various treatment allocation decisions in a way that imposes little assessment administration and interpretation burden yet maintains adequate classification accuracy. These characteristics make the proposed protocol promising with regard to its transportability and suitability for adoption and implementation in real-world mental health settings.

The American Psychological Association Task Force on Evidence- Based Practice for Children and Adolescents (2008) recommended a systems approach to enhancing care in order to improve outcomes for children and adolescents with mental health needs and redress persistent systemic problems with the structure of services. Recommendations for enhancing an ecological approach to the adoption and implementation of evidence-based practices are offered through increased attention to practice-based research frameworks for adoption and dissemination. Five criteria are discussed for providing acceptable evidence, including (a) systematic evidence searching and adoption of evidence-based prevention and intervention practices, (b) implementation and adherence to intervention integrity, (c) invoking standards for drawing inferences from interventions, (d) using quality assessments to measure outcomes, and (e) adopting formal data analysis procedures to assess intervention outcomes. Each criterion is illustrated with an example. Future research and policy agendas are outlined.