The assessment of the Pathways Clearinghouse of whether the intervention is likely to produce favorable results if faithfully replicated with a similar population.
We have strong and consistent evidence that the intervention produces favorable results for a specific outcome domain, such as short-term earnings. These interventions have at least two impact studies of moderate or high quality that show evidence of favorable findings within the domain. However, because implementation challenges and successes often vary, and because no two implementations of an intervention are identical, Pathways Clearinghouse users should not view this rating as a guarantee of future success.
We have some evidence that the intervention improves outcomes. These ratings are domain specific, meaning that the intervention is considered supported only for the particular domains for which we have given this rating. These interventions have at least one study of moderate or high quality and show evidence of favorable findings in the domain, but the evidence is less conclusive than that for evidence-based interventions.
We have the strongest evidence that the intervention is unlikely to produce substantial favorable results in a given outcome domain. Studies of these interventions have found only a pattern of null and/or unfavorable findings. We only consider impact studies of at least moderate quality in determining this rating.
We have some evidence, from impact studies of moderate or high quality, that indicates the intervention improves outcomes in a given outcome domain, and some evidence that indicates it worsens outcomes in that domain. For instance, in the educational attainment domain, an intervention might have unfavorable effects on attainment of a high school diploma, but favorable effects on GED attainment.
Insufficient evidence to assess support
We have some research, from impact studies of moderate or high quality, on the intervention’s effect in a given outcome domain. But we do not have a sufficient body of evidence to assign one of the other ratings.
No evidence to assess support
We did not find any studies that rated moderate or high that studied the intervention’s effect on outcomes in a given outcome domain. These interventions need further study to support conclusions about their effectiveness.