Fourth R Alaska Statewide Evaluation

SPS directed a three-year research project (2011-2014) in Alaska that tested whether an evidence-based school health curriculum designed in Canada (Fourth R), was effective when adapted and implemented among Alaskan populations. This was the first evaluation of the Fourth R within the United States. Specifically, the study was a multi-site statewide quasi-experimental evaluation of the Fourth R, a comprehensive 9th grade school health curriculum. The purpose of the study was to determine if youth who participated in the Fourth R curriculum improved their applied knowledge, attitudes, behavioral intentions and behaviors, and increased protective factors more than youth who participated in a regular health class. Over 500 ninth graders in thirteen schools across twelve communities in Alaska participated in this study. Six of these schools implemented the Fourth R curriculum, while the remaining seven schools implemented their regular health class and served as a comparison group. Youth who participated in the Fourth R were statistically significantly different than comparison group youth in:

  • Improved awareness of abusive behavior
  • Reduced adherence to rape myths
  • Increased positive social support among youth with high ACE scores

And were trending toward statistical difference in:

  • Reduced acceptance of physical aggression

A unique contribution of this study to the field of violence prevention is the connection of adverse childhood experiences (ACEs) and high-risk populations to positive improvements after participation in a comprehensive health education curriculum. A high number of youth who participated in this study reported having experienced four or more ACEs in their lifetime. For a number of the study outcomes, we found that youthwho had experienced more ACEs were more significantly impacted by the Fourth R program than youth who had not participated in the Fourth R. This finding aligns with the current proposition within prevention science indicating that youth who are at a higher risk for adverse outcomes may benefit the most from socio-emotional programming. The research team included organizational partners within and outside of Alaska, including the state domestic violence/sexual assault coalition, Department of Education, and Department of Health and Social Services, Governor’s Council on Domestic Violence and Sexual Assault and the University of Western Ontario, Canada. The collaborative partnership that resulted from this research study, and was led by Wendi Siebold, is noted as a model for utilizing multi-sectoral collaborations to leverage resources for advanced community-based research studies.

Download the final evaluation report here.

Alaska Green Dot Community Pilot Evaluation

SPS was contracted by the State of Alaska to evaluate the pilot implementation of the community version of the Green Dot violence prevention strategy across Alaska. Wendi Siebold directed the project in partnership with staff from Green Dot, Inc. Focus groups were conducted in five pilot communities to determine the scope, successes and challenges of implementation. Findings were communicated to Green Dot, Inc. and were used to inform the implementation of Green Dot in both Alaska and other communities in the United States.

Green Dot Community Action & Mattering Study

Wendi Siebold is consulting on this research project awarded by the Centers for Disease Control and Prevention to test the new community-version of the Green Dot strategy. The project is being directed by the University of New Hampshire’s Dr. Victoria Banyard and Dr. Katie Edwards. While it builds on founding Green Dot principles of mobilizing bystander intervention, Green Dot Community goes beyond individual levels of prevention strategies. Rather it focuses on building community-level engagement and changing two key community level factors that have been implicated in rates of sexual violence and intimate partner violence: collective efficacy and injunctive norms. The current project uses a quasi-experimental research design to evaluate the effectiveness of Green Dot Community to reduce rates of sexual violence and intimate partner violence in two communities in contrast to two matched comparison communities and one matched alternate treatment community.

CDC DELTA (National Domestic Violence Prevention Initiative)

SPS staff and contractors lead the full-time empowerment evaluation of the state of Alaska, Florida, California and Idaho’s CDC-funded DELTA statewide initiative, which funds domestic violence state and community coalitions to do primary prevention of intimate partner violence and involves a statewide multi-stakeholder planning process for each state’s primary prevention of intimate partner violence/domestic violence. From 2006 – 2011 we also were contracted with Montana in the same capacity. From 2010-2012, we worked with Kansas in the same capacity.

Washington Pregnant and Parenting Women and Teens Project

In this project, SPS worked closely with project partners to evaluate the implementation of statewide guidelines for addressing and preventing reproductive coercion within the fields of health care, law enforcement, prosecution, and domestic and sexual violence advocacy. The Pregnant and Parenting Women and Teens Project was funded by a grant from the U.S. Department of Health and Human Services (HHS) through the Pregnancy Assistance Fund, created by the Affordable Care Act. The Washington State Department of Health (DOH) was the lead agency for the grant. The Attorney Generals’ Office (AGO) provided the project coordination and administration of funds for both the Washington Coalition of Sexual Assault Programs (WCSAP) and the Washington State Coalition Against Domestic Violence (WSCADV).

Washington Housing First Project

SPS was funded to evaluate the first cohort of this pilot project to obtain permanent housing for survivors of domestic violence. Funded by the Bill & Melinda Gates Foundation and administered by the Washington State Coalition Against Domestic Violence.

Native Aspirations National Evaluation

From 2008-2011 SPS was part of a larger team of evaluators, including ICF International, EMT Associates, and University of Colorado at Denver. Staff at SPS were the Evaluation Liaisons for the Northwest Alaskan villages that are participating in this national project focused on preventing suicide, bullying and violence in highest need communities in Indian Country. We also provide content-specific trainings for community members and project staff at Kauffman & Associates (KAI). This project is funded by SAMHSA.
Training & Capacity Building

Prevention Capacity Assessment

SPS has been a national leader in the assessment of organizational capacity for prevention. We continue to provide trainings and assessments of organizational capacity for prevention, and are in the final stages of testing a new online tool to assess the capacity of organizations to engage in the primary prevention of intimate partner violence and sexual assault. Originally developed by our President, Wendi Siebold, SPS administered and analyzed a version of the assessment, called the “Coalition Prevention Capacity Assessment” with funding from the CDC Foundation as part of the CDC and RWJF-funded DELTA-PREP project. Findings from this pilot administration have been summarized for CDC’s capacity-building efforts with the 19 DELTA PREP-funded states. Psychometric analyses are being conducted to finalize this assessment for larger use within the field. Access the online toolkit for administering the PCA here.

CDC DELTA (National Domestic Violence Prevention Initiative)

SPS staff and contractors lead the full-time empowerment evaluation of the state of Alaska, Florida, California and Idaho’s CDC-funded DELTA statewide initiative, which funds domestic violence state and community coalitions to do primary prevention of intimate partner violence and involves a statewide multi-stakeholder planning process for each state’s primary prevention of intimate partner violence/domestic violence. From 2006 – 2011 we also were contracted with Montana in the same capacity. From 2010-2012, we worked with Kansas in the same capacity.

Prevention, Intervention, Evaluation & Sustainability (PIES) for IPV/SV

Contracted to write the science content of three chapters (process evaluation, outcome evaluation, continuous quality improvement) in the PIES prevention planning manual that was adapted for intimate partner violence and sexual violence prevention by the Centers for Disease Control and Prevention, Division of Violence Prevention.

CALCASA (Evaluation Training Series)

We conducted a series of in-person workshops to develop the evaluation skills of prevention practitioners in California. Workshops were offered in two parts entitled “Measuring Sexual Violence Prevention Efforts: Phase I and II.” Phase I focuses on an introduction to basic evaluation skills, such as: Process vs. outcome evaluation; using an evaluation work plan vs. a logic model; Evaluation for improvement; Keeping evaluation feasible and within resources; and Avoiding common mishaps. Phase II covers more advanced topics such as: Data management & entry basics; Getting data ready for analysis, Simple data analyses (using online survey software and hand calculations in Excel), and Viewing online survey results.
See our President, Wendi Siebold, speaking about the value of online survey tools for prevention practitioners: CALCASA Podcast W. Siebold

CDC DELTA and EMPOWER Coordination of Empowerment Evaluators

SPS was contracted by the Centers for Disease Control & Prevention (CDC) to coordinate the communication between and among the statewide evaluators in each of the 14 DELTA states and 6 EMPOWER states. We facilitated monthly meetings and one in-person national meeting for all evaluators. We served as a liaison between the evaluators and the federal CDC project officers at the Division of Violence Prevention.

Collective Impact – Pathways to a Safer Sitka (Alaska)

SPS is currently assisting the Pathways to a Safer Sitka community coalition in its transition to using a Collective Impact model of multi-sectoral partnership. The prevention Coalition has existed for ten years and is broadening its scope of work and membership. SPS has facilitated the planning and meetings that have transitioned the group into the phase of selecting shared measures, after affirming and re-writing their vision statement, goals, principles of practice and creating criteria for implementing new programming (helps maintain boundaries for Pathways programming).