A brief description of the sample that the researcher used; A description of how the researcher tested the intervention; Identify limitations or concerns with the research study; an

J Child Fam Stud (2017) 26:2090–2100 DOI 10.1007/s10826-017-0738-0

ORIGINAL PAPER

Increasing Youths’ Participation in Team-Based Treatment Planning: The Achieve My Plan Enhancement for Wraparound

Janet S. Walker 1 ● Celeste L. Seibel1 ● Sharice Jackson1

Published online: 3 May 2017 © Springer Science+Business Media New York 2017

Abstract Wraparound is a frequently implemented approach for providing individualized, community-based care for children and adolescents with serious mental health conditions and, typically, involvement in multiple child— and family-serving systems. Both Wraparound’s principles and its theory of change stress the importance of youths’ active participation throughout. However, research focusing on the experiences of youth in Wraparound indicates that they are often not particularly engaged in the process or participating actively with their teams, and the findings point to a lack of alliance between the young people and their teams. This article describes a randomized study testing the Achieve My Plan (AMP) enhancement for Wraparound, which is intended to increase young people’s satisfaction, active engagement and self-determined parti- cipation in Wraparound, as well as their alliance with the team. Study findings showed that, relative to youth who received “as usual” Wraparound, young people who received Wraparound with the AMP enhancement partici- pated more—and in a more active and self-determined manner—with their teams. They also rated their alliance with their Wraparound teams significantly higher. Further- more, adult team members in the intervention condition rated team meetings as being more productive, and they were more likely to say that the AMP meetings were “much better than usual” team meetings. Findings support the idea that it is possible—using a low-cost, low-“dose” interven- tion—to enhance young people’s self-determination and

their engagement in Wraparound without detracting from team functioning or the satisfaction of other team members.

Keywords Wraparound ● Self-determination ● Engagement ●

Youth ● Adolescents

Introduction

Wraparound is a frequently implemented, comprehensive approach for planning and providing individualized, community-based care for children and adolescents with serious mental health conditions and, typically, involvement in multiple child—and family-serving systems (Walker et al. 2008). According to estimates from the most recent state survey (Sather and Bruns 2016), Wraparound is now available in almost every state, with at least 75,000 young people and their families enrolled in close to 700 Wrap- around initiatives in the United States. The core work of Wraparound is carried out by a team that includes the child and family members, service providers that work with the child and family, and people from the family’s network of social support (Bruns et al. 2010). The work of the Wrap- around team is typically facilitated by a Wraparound care coordinator, who is responsible for ensuring that team members work together collaboratively to develop, imple- ment, and monitor an individualized plan of care that coordinates and adjusts services and supports for the child/ youth and family.

While the principles of Wraparound call for a colla- borative team process, the exact nature of the collaboration is somewhat unique. The Wraparound principles stress that youth and family perspectives are to be prioritized in determining the primary needs that the Wraparound team

* Janet S. Walker [email protected]

1 Research and Training Center for Pathways to Positive Futures, Regional Research Institute, School of Social Work, Portland State University, Portland, OR 97207, USA

will address, as well as the service and support strategies to be included in the Wraparound plan of care (Bruns et al. 2004). Theoretical models that explain how Wraparound produces results (Walker and Matarese 2011; Walker and Schutte 2004) emphasize the importance of engagement and, in particular, of carefully and thoroughly exploring strengths, needs, and goals from the perspective of the youth and family members. Theory also stresses that, as teamwork progresses, family and youth perspectives must continue to be prioritized as the team implements and monitors the plan of care, continually evaluating the extent to which the ser- vice and support strategies included in the plan are being successful in meeting needs and achieving goals. In short, the theory proposes that Wraparound is effective—and different from other forms or care planning—because it unites the young person, the family, service providers and other team members around a shared vision regarding what’s going well, what needs to be different, and how well strategies for change are working. Because of this alignment of perspectives, the team is collectively oriented toward the most important needs, and able to address these needs at a more profound and holistic level than usual treatment planning.

However, research focusing on the experiences of youth in Wraparound indicates that they may not be particularly engaged in the process or participating actively with their teams. (Haber et al. 2012; Walker et al. 2009, 2012; Walker and Schutte 2005). A consistent finding across these studies is that youth are less satisfied than other stakeholders regarding their experiences with Wraparound overall. In the earliest study to examine youth participation, Walker and Schutte (2005) found that young people were often not present at their Wraparound team meetings at all. When they were present, young people’s ratings not only of their satisfaction with the meeting, but also of their level of comfort during the meeting, were significantly lower than other participants’ ratings. Furthermore, one of the top challenges identified by service providers in the study was productively including the young person in the meeting. Haber et al. (2012) found that, compared to other team members, youth tended to see their Wraparound teams as less cohesive and as implementing fewer core features of Wraparound teamwork best practices. Walker and collea- gues (2012) reported data regarding youth participation and engagement from three separate studies. The first of these was a national study of Wraparound fidelity, which found that youth ratings of their active participation in Wrap- around were lower than ratings provided by caregivers (i.e., parents or other guardians). The second study, which reported on findings from a different study of Wraparound fidelity in Nevada, found that youth reported a lower level of involvement in Wraparound planning relative to their caregivers. The final study analyzed video-recordings of

Wraparound team meetings taking place in a high school, and found that, on average, youth spoke continuously— without being interrupted by an adult—for only 2% of the 20-second segments that were recorded.

It is not surprising to find that, compared to other team members, young people involved in Wraparound feel less comfortable or satisfied, given it is likely that private details of their lives will be the topic of discussion by the entire team, a group that typically includes five or more team members, most of whom are professional service providers from child—and family-serving systems such as mental health, child welfare, juvenile justice, schools, and so on. In many cases, the young person has been referred to Wrap- around precisely because of difficulties or conflicts that involve representatives of these systems. Furthermore, the adults who are present for these team discussions often have access to extensive agency records that may date back for many years. These records describe the young person’s service history with the system, usually in ways that highlight pathology, problems, deficits, and crises (e.g., Malysiak 1997; Rosenblatt 1996).

To any young person, the expectation that they will openly disclose personal opinions and information to a group that includes parents and authority figures may well feel unreasonable and intrusive. Adolescents are generally reluctant to disclose personal information to parents or other adults (Daddis and Randolph 2010; Hawk et al. 2009; Masche 2010; Smetana et al. 2009), and this is particularly true among young people with externalizing behavior or general adjustment problems (Daddis and Randolph 2010; Soenens et al. 2006; Stattin and Kerr 2000). What is more, pressuring young people to disclose this kind of information can lead to cycles of conflict and greater secrecy (Hawk et al. 2009; Tilton-Weaver et al. 2010). As described pre- viously, the theory of Wraparound ascribes central impor- tance to the team’s ability to elicit the young person’s genuine ideas and perspectives. Doing so is clearly a challenge given the potentially adversarial interpersonal context, adolescents’ general reluctance to disclose, and the possibility for conflict and alienation from the team to result if the young person feels pressured to provide personal information. The potential for conflict between young people and the team may be even further exacerbated by the fact that adolescents are much less likely than service pro- viders to perceive that there is a need for mental health treatment in the first place, and are very likely to disagree with providers about the problems that need to be addressed (Garland et al. 2003, 2004; Reyes et al. 2015).

The broader research on adolescent development sug- gests that, in the Wraparound context, additional challenges are likely to arise from efforts to manage and integrate the potentially divergent viewpoints of adolescents and their parents or other caregivers. The principles of Wraparound

J Child Fam Stud (2017) 26:2090–2100 2091

stress that family and youth perspectives are to be prioritized during the work. The principles also explicitly recognize that the balance of influence needs to be adjusted so that older youth are invited, and indeed encouraged, to become progressively more self-determined within the Wraparound process. The re-balancing of decision- making control between youth and parents during adoles- cence is of course not unique to families in Wraparound (Peterson et al. 1999; Wray-Lake et al. 2010), and the conflict that often attends this transition is well documented in families from a wide spectrum of ethnic and cultural backgrounds (Smetana et al. 2009). Simultaneously pro- moting and managing caregiver and adolescent perspectives may be particularly challenging within Wraparound, since parent-child conflict appears to be pronounced for families with adolescents who have emotional or behavioral dis- orders (Marmorstein and Iacono 2004). Indeed, engaging in mental health services is itself a potential source of conflict within families, since caregivers and young people often have highly divergent views regarding the need for mental health treatment, its purpose or goals, and its helpfulness (Garland et al. 2004; Hawley and Weisz 2005; Phares and Compas 1990; Phares and Danforth 1994; Reyes et al. 2015).

Taken together, these findings confirm the difficulties that are inherent in engaging young people, their parents or caregivers, and multiple service providers in the type of collaborative planning process described by the Wrap- around principles. The findings also suggest that young people’s feelings of relative dissatisfaction and lack of participation in Wraparound may be in large part a result of team members’ inability to truly engage the young person, and to demonstrate they are aligned with the young person’s own views about the goals the team should be pursuing and the best strategies for achieving them. In other words, the findings point to a potential lack of alliance between the young person and the team.

Alliance is a construct that has been extensively studied as a predictor of positive outcomes from psychotherapy (Ardito and Rabellino 2011). Across a number of meta- analyses focused on psychotherapy with adults, alliance— defined as both a positive, supportive bond between client and therapist, and mutual collaboration and agreement between client and therapist on the tasks and goals of therapy—has been shown to have a robust relationship with outcomes, and to explain a greater proportion of the var- iance in outcomes than many technique factors (Ardito and Rabellino 2011; Zack et al. 2007). While there are far fewer studies of alliance in the context of psychotherapy with adolescents, at least two meta-analyses of studies focused on youth have found a relationship between alliance and outcomes of similar magnitude to that found in the studies with adults (Shirk and Karver 2003; Zack et al. 2007). In

one study of youth who were receiving community-based mental health outpatient services, youth alliance (as rated by youth themselves) was significantly related to both youth and parent reports of symptom improvement, whereas par- ent ratings of alliance were not predictive of outcomes (Hawley and Weisz 2005).

In response to the challenges associated with engaging youth in team-based planning, Walker et al. (2012) devel- oped the Achieve My Plan (AMP) intervention as an enhancement to existing Wraparound practice. The AMP intervention was designed using a collaborative process in which research project staff worked together with young people with serious mental health conditions and a history of multi-system involvement, caregivers, and service pro- viders. A pre- post-pilot study of the AMP enhancement intervention (Walker et al. 2012) found that young people’s participation and engagement in Wraparound increased significantly across a number of indicators, and that young people’s perceptions of their ability to work with providers to optimize their services and supports were higher after AMP was implemented. Furthermore, the study also found that other team members’ satisfaction was higher post-AMP, suggesting that increasing youth participation in Wrap- around can be accomplished without “crowding out” parti- cipation or satisfaction on the part of caregivers or other team members.

The current study used a randomized design to examine various facets of the Wraparound experience for young people receiving as-usual Wraparound, as compared to those receiving Wraparound with the AMP enhancement. The study aimed to test whether or not there were sig- nificant differences between the control and intervention groups in terms of various indicators of youth engagement, participation and alliance with the team. The study also examined hypotheses related to the experiences of other team members, including whether any increases in youth participation might be associated with “crowding out,” i.e., decreases in other team members’ satisfaction or perceptions of the team’s productivity.

Method

Participants

As is typical elsewhere, children and youth in the state of Oregon are eligible for Wraparound only if they experience very high levels of mental health and related needs (Pro- gram Analysis and Evaluation Unit; Oregon Health Authority Office of Health Analytics 2012). They must have, or be at risk for developing, serious emotional, behavioral or substance use disorder, and they must be involved with two or more child-serving systems, most

2092 J Child Fam Stud (2017) 26:2090–2100

often mental health and child welfare. Youth being served by participating agencies offering Wraparound in the Port- land, Oregon metropolitan area were invited to participate in the study based on three criteria: (a) aged 12 to 18 years old, (b) had an active Wraparound treatment plan, and (c) were likely to receive services for at least 6 months. Young people who were eligible for participation were initially approached by their care coordinator, who provided basic information about the research project and found out if the young person had an interest in participating. Some other- wise eligible participants were not approached because the care coordinator—often in consultation with other Wrap- around team members—decided that the circumstances of the young person’s life made him or her a poor fit for the project (e.g., active crises, scheduled to move out of the area, etc.). Youth who expressed an interest to their care coordinators were invited to participate in an informational session with project staff. All of the youth who participated in these sessions assented to participation in the study. Once young people had assented, their legal guardians were asked to provide consent.

Fifty-five youth were enrolled in this study. Incoming youth who were deemed eligible were randomly assigned to Wraparound care coordinators who had themselves been randomly assigned to either the intervention or comparison group at the outset of the study. Youth in the comparison group participated in Wraparound “as usual,” while youth in the intervention group participated in as-usual Wraparound plus the AMP enhancement intervention.

Of the 55 enrolled youth, 35 were in the intervention group, and 20 were in the comparison group. Among the 35 intervention youth who participated in baseline assess- ments, 27 participated in assessments at T2 (typically 3–5 weeks after baseline) and 24 at T3. (post intervention). Of the 20 youth in the control condition at T1, 18 partici- pated in assessment at T2 and 17 at T3. The mean age of the study participants at baseline was 14.2 years (SD= 1.3), with females accounting for 42% of the sample. A little over half of the participants (56%) identified as White/Caucasian, 18% as “other,” 11% as Hispanic/Latino/a, 9% as Black/ African American, and 6% as Asian American. When asked to elaborate, almost all of the youth selecting “other” described themselves as a mix of two or more races from the list. There were no significant differences between the intervention and comparison groups on any of these characteristics.

Procedure

Intervention

After consent/assent had been secured, participants in the intervention condition met with their AMP coach three

times to prepare for the next regularly scheduled Wrap- around team meeting, which was referred to as the “target” team meeting. In AMP, the one-on-one coaching meetings are referred to as “prep sessions,” and each prep session has a fidelity checklist that the coach and the young person review together at the end of the session to ensure that all of the session elements have been covered.

The first prep session focuses on assisting young people to identify their strengths and long-term goals, and to develop action steps related to one of the goals. A key feature of AMP is that young people are supported in identifying goals that they find personally meaningful and motivating. The goals can be from any life domain and do not need to focus specifically on what other team members or systems might want for, or from, the youth. In fact, from the perspective of AMP, it is not problematic if the young person identifies goals that other team members might not agree with. Often, the long-term goals are not shared with the team at all. However, the AMP coach does help the young person to identify short-term action steps that are related to the goals, and that other team members are likely to support. These action steps are shared with the team.

The second prep session focuses on setting the agenda for the target team meeting. The meeting agenda items are collected from team members prior to this prep session, so that the young people can choose what sections of the agenda they want to lead, and can begin preparing what they would like to say during each section of the agenda. Typically, young people choose to lead the section of the meeting during which they present their proposed action steps, describe their own roles in carrying out the steps, and ask team members for support as needed.

The third prep session focuses on preparing young peo- ple to participate actively in all sections of the target meeting. The young people practice what they want to say for the sections they are leading as well as the sections that other team members will lead. The coaches help the young people to anticipate any conflicts that might arise during the meeting, and review strategies for managing these situa- tions. The AMP coach and the young person also develop a plan for support during the meeting so that they will be prepared to respond if the young person becomes angry, anxious, or uncomfortable, or if the young person has trouble remembering what to say. It is important to note that the care coordinator remains responsible for facilitating the team meeting and leading the team process, with the AMP coach in a supporting role focusing on the young person’s participation.

During the target meeting, the AMP coach provides the planned support for the young person, prompts the team (as needed) to use best practices for including the youth, and models behaviors that invite youth participation. For example, the AMP coach may remind the team to speak

J Child Fam Stud (2017) 26:2090–2100 2093

directly to the young person (rather than about him as if he were not in the room), to invite the young person to present her ideas on each topic on the agenda, or to use the parking lot for items that come up in the meeting but for which the young person has not had an opportunity to prepare. The AMP coach may also support the care coordinator in recognizing and interrupting common team member beha- viors that alienate young people or discourage their parti- cipation, such as when team members begin to lecture or badger young people about their plans, ideas or activities.

In between the target team meeting and the next Wrap- around team meeting, the coach and the young person meet for two short “booster” sessions to check in about the young person’s progress on his/her goals and action steps, to review what other team members are doing for the plan, and to prepare for the next Wraparound team meeting by repeating the main steps of the three prep sessions. The coach attends this next Wraparound team meeting to sup- port the young person before “handing off” the coaching work to the young person’s care coordinator.

AMP coach training

AMP coaches were undergraduate and master’s level social work students. The coaches received 6 weeks of training that focused on (a) learning to lead all of the steps that make up the prep sessions and booster sessions and (b) carrying out this work in a manner that ensured that the youth’s own ideas and perspectives were driving the work. The process that the trainee coaches participated in included the fol- lowing steps: reviewing the curriculum with an experienced coach and role-playing interactions; watching videos of experienced AMP coaches as they delivered the curriculum; video recording themselves delivering the AMP curriculum with a “practice” young person (a young person who was not participating in the study); and shadowing an experi- enced coach. The AMP trainee coaches received feedback on their video-recorded sessions from their supervisor, who was an experienced AMP coach. Trainee coaches continued submitting practice videos until they could deliver the AMP curriculum to fidelity. All of the trainee coaches completed training within the 6-week time frame.

Measures

The study used three sources of data: assessment surveys, post-meeting surveys, and video recordings of team meet- ings. All of the survey measures were chosen and, where necessary, adapted based on collaboration with a study advisory group that included young adults with significant experience in mental health systems, as well as service providers and caregivers.

Assessment surveys

Youth and their care coordinators completed online surveys (care coordinators) or in-person or telephone (youth) inter- views at three time points: baseline (T1), after the target meeting (usually 3–5 weeks after baseline; T2) and post- intervention (i.e., after two additional Wraparound meet- ings, usually about 10–12 weeks after baseline; T3). The initial interviews for youth were in-person. Subsequent assessments were either in person or by telephone, depending on youth preferences and placement. The origi- nal study design also called for online assessment surveys for caregivers, but caregiver data was discarded due to the youths’ frequent placement changes, which meant that in many cases there was not a consistent caregiver to inter- view. The measures included in the surveys focused on perceptions of meaningful youth participation and engage- ment in Wraparound. The youth survey also included a measure of mental health empowerment.

Three different aspects of meaningful youth participation in team-based planning were assessed using the three sub- scales of the Youth Participation in Planning Scale (YPP; Walker and Powers 2007). The YPP was developed by researchers collaboratively with an advisory group of youth and young adults with significant experience in mental health systems. All of the items are rated on a scale from 1 to 5, with higher scores reflecting greater participation. The planning subscale (8 items, Cronbach’s α= 0.90) focuses on the extent to which both the planning process and the plan itself incorporate the youth’s ideas and perspectives (e.g., During planning, we make changes to my plan based on my ideas and My plan includes the goals that are most important to me). The preparation subscale (4 items, α= 0.75) includes items that assess how thoroughly the youth was prepared for the meeting, both in terms of knowing what to expect and planning what and how to contribute to the discussion (e.g., Someone from the team helps me plan the things I want to say at the meeting and Before a team meeting, I am told about all the topics that will be on the agenda). The accountability subscale includes 4 items (α= 0.78) that focus on the extent to which the young person has access to information about whether or not team members are following up on what they agreed to do during the meeting (e.g., Team members report to me about what they are doing for my plan and Team members have specific tasks to do for my plan). The items on the care coordinator survey were altered so that the focus remained on the youth’s participation (e.g., During planning, we make changes to the plan based on the youth’s ideas). For each subscale the scores on the individual items were summed and divided by the number of items to produce a mean score that was used in the analyses.

2094 J Child Fam Stud (2017) 26:2090–2100

Measures of working alliance assess clients’ perceptions that there is a positive and productive relationship between the client and a mental health treatment provider. Working alliance was assessed using items drawn from the Working Alliance Inventory (WAI; Horvath and Greenberg 1989), one of the most commonly used measures of alliance between a client and clinician (Ardito and Rabellino 2011). Ratings are made on a 7-point scale with higher ratings reflecting greater alliance. The overall alliance is seen as including three aspects: agreement on the goals of the treatment, agreement on the tasks, and the development of a mutual and positive bond. While the WAI has separate subscale scores, the overall score is most commonly used in research studies, and this score has been shown to correlate moderately with treatment outcomes (Martin et al. 2000). Members of the study advisory group identified a subset of WAI items that were seen as most relevant to the Wrap- around context, and consulted on adapting the items to reflect alliance with the team as a whole, rather than an individual clinician. For this scale (7 items, α= 0.77 in this study), scores on the individual items were summed and divided by the number of items to produce a mean score that was used in the analyses.

Two of the three subscales from the Youth Empower- ment Scale-Mental Health (YES; Walker et al. 2010) were used for the study. All the items on the YES are rated on a 5-point scale, with higher ratings reflecting greater empowerment. The self subscale includes seven items (α= 0.84) that are intended to assess a youth’s confidence and optimism about coping with and managing a mental health condition (e.g.,