Evaluation Components for NYS Systems of Care

• Document also available in Portable Document Format (PDF)

Source	Perspective captured	Questions Answered
Administrative Records	Information collected on every enrolled youth/young adult	What does the service population look like? Are we capturing the participants we hope to serve with this project?
Interviews with individuals involved with implementation	Facilitation Team County leads Supervisors Peer TA state leads Others who are strongly involved in implementation	How are different providers experiencing implementation? What are the successes and challenges?
Focus groups with recipients of Wraparound	Youth and Young Adults Caregivers	How are youth and family participants experiencing Wraparound? What are the successes and challenges?
Meeting Notes review	Those attending implementation, county, and NYS team meetings	How is implementation going? What are the county/state priorities? What challenges have arisen, and how were they resolved?
Monthly County Reports	Supervisors/Leads for care managers, youth peers, and family peers	What is happening on the county level? What are the successes and challenges? What do counties need more assistance with?
IPP/Infrastructure Survey	County Supervisors/Leads (from monthly report responses) State Project Directors	Is state and local infrastructure developing to support SOC? 4 specific indicators tracked: Policy changes Peer involvement in services Individuals attending SOC trainings Collaborative agreements completed between agencies/parties
Wraparound Fidelity Measures: WFI-EZ Survey	Youth and young adults Caregivers Facilitation Team Other team members	Is Wraparound being delivered to NWI standards? How are team members experiencing Wraparound?
Wraparound Fidelity Measures: Team Observation Measure	Direct Observation	Is Wraparound being delivered to NWI standards? Is the meeting process operating according to the standards of Wraparound?
Wraparound Fidelity Measures: Document Assessment and Review Tool	Review of Documentation	Is Wraparound being delivered to NWI standards? Is the documentation available to assess whether standards are met? Does documentation offer support that Wraparound standards are being met in practice?
Interviews with Youth and Caregivers	Youth and Young Adults Caregivers	How are outcomes changing during the Wraparound process? Symptomology Functioning School Attendance Arrests Social Support Caregiver Strain (Caregivers only) Youth & Family Empowerment Hope (Youth only) How are youth and family satisfied with services? Perception of Care
CANS-NY	Care mangers perspective of youth and family strengths and needs	Are youth and caregiver strengths and needs changing during the Wraparound process? (e.g. a reduction in needs, or severity of needs, or an increase in strengths)
Medicaid data	Services use and cost (for Medicaid participants only)	Are participants experiencing a change in service use during and after the Wraparound process? (e.g., a reduction in formal services) Are participants using high cost/emergency services during and after Wraparound? (e.g., ER visits, RTFs, mental health inpatient stays)