Measuring Fidelity and Outcomes: What Each Tells Us

In this article

• Match the question to the information
• Understand the role of fidelity tools
• Define outcomes so they can be interpreted
• Interpret patterns before choosing an action
• Protect the meaning of published results
• Close the improvement cycle

Programs need to understand how Wraparound is delivered and what changes families experience. Fidelity information examines whether the model’s practices are present. Outcome information examines changes such as functioning, participation, stability, or family-defined progress. Reviewing both helps a team decide where improvement is needed.

Family experience adds another perspective. A caregiver may value a worker’s responsiveness while still reporting that the plan has not improved a difficult routine. A youth may make progress while feeling excluded from decisions. Those findings deserve attention together.

Match the question to the information

Begin by stating what the program wants to learn. To understand participation, ask how youth and caregivers influenced decisions and consider their accounts. To understand follow-through, examine whether agreed actions occurred. To understand placement stability, define the relevant placement events and follow the youth over a specified period.

Activity counts can identify workload and access patterns. They do not fully describe the quality of the interaction or the benefit to the family. A dashboard should make those distinctions visible so a high contact count does not conceal unresolved needs.

Understand the role of fidelity tools

California’s HFW resources discuss tools that include the Wraparound Fidelity Index, or WFI; the Team Observation Measure, or TOM; and the Document Assessment and Review Tool, or DART. These approaches draw on different kinds of evidence, such as participant perspectives, observed team practice, and documented practice.

Programs should confirm the current tool version, required training, authorized use, sampling, administration, and scoring procedures. A website article or locally designed checklist cannot confer official scoring competence. Use the applicable program and funder requirements when determining which instruments and assessments are required.

Current policy distinction: DHCS’s publicly posted April 2026 HFW Policy Manual describes a proposed Medi-Cal fidelity-designation process and use of DART. DHCS still labels that manual as a draft as of October 23, 2026. Check current issued guidance before treating a proposed threshold, timetable, or payment condition as final.

Define outcomes so they can be interpreted

For every measure, identify the population, time period, numerator, denominator, source, and responsible reviewer. Specify how missing information and changes in enrollment will be handled. If a family leaves services early, determine how that event is represented rather than allowing it to disappear from the analysis.

For a placement measure, distinguish planned moves toward permanency from unplanned disruptions. For a school measure, consider the youth’s age, enrollment status, and the attendance period. For crisis use, establish what counts as an event and whether repeated contacts for the same event are counted separately.

Interpret patterns before choosing an action

Illustrative example: A program finds that families report difficulty understanding their plans. Record review shows completed plans, but observation reveals that meetings end without asking families to summarize next steps. The improvement action could include coaching facilitators on checking understanding and offering usable summaries. The program then asks whether families report better understanding.

A different pattern may indicate a resource problem. If plans consistently identify a needed service that is unavailable, the program should address access with system partners. Training alone may have little effect on that barrier.

Protect the meaning of published results

Report what was measured and avoid extending a finding beyond its population or purpose. KFA’s published parent survey describes responses to a satisfaction question among respondents. It should not be presented as an HFW fidelity score or as proof of clinical or placement outcomes.

Changes observed during services can be useful, but causal claims require an appropriate evaluation design. Explain relevant limitations, including small samples, incomplete follow-up, differences in need, or lack of a comparison group. Acknowledge those limits while still using the information to improve practice.

Close the improvement cycle

Assign an action, a responsible person, and a review date. Return to the same question after the change has had a reasonable opportunity to work. Keep a record of what improved, what remained difficult, and what the team will try next. Data become useful when people can connect them to a decision.

For KFA’s current certification, funding, and service availability, visit our HFW program page. For questions about a particular family or situation, contact info@mykfa.org to arrange a private conversation.