Evaluation of the Massachusetts Reading First Program

We serve as evaluator for the Massachusetts Department of Education’s Reading First program. Funded through No Child Left Behind, Reading First is intended to help underperforming elementary schools improve reading skills for students in kindergarten through third grade. Schools must implement curricula aligned with scientifically based reading research. In addition, participating educators receive ongoing professional development and support. Eighty-nine schools are participating.

Our work for Reading First includes:

• Designing and analyzing annual implementation reports from each district and annual educator surveys
• Administering and analyzing results from educator pre/post tests
• Creating and maintaining an assessment dataset with more than 40,000 student records and conducting analyses to answer key questions about student outcomes
• Developing focused case studies of schools with promising student assessment results

Through our evaluation efforts, Massachusetts has begun to document initial gains in student reading achievement in its Reading First schools.

For more information, contact:

Jennifer Gordon
Research Manager
(508) 856-1349

National Cancer Institute: A Study of Factors Affecting the Translation of Research into Practice

The National Cancer Institute (NCI) is working to improve the dissemination of cancer research and increase the rates at which findings are implemented into clinical care. We worked with NCI to improve “research translation” by conducting a study to identify issues effecting practitioners' use of research; supporting a comprehensive strategy for research dissemination; and identifying ways NCI could work with external partners to influence the national agenda for research translation.
 
Key activities of this project included:

• A comprehensive review of relevant literature
• A nationwide interview process with primary care practitioners, cancer care specialists, researchers, and health system administrators
• A targeted interview process with leaders of professional associations who represent health care practitioners
• A broad-based survey of targeted practitioner groups
• Presentation of findings at national meetings
• Support to NCI's internal dialogue on strategies to improve the effectiveness of research translation efforts

For more information, contact:

Steven Ellis
Senior Manager
(413) 587-2405

ServiceNet: An Evaluation of the Integrated Shelter and Treatment Program

The Integrated Shelter and Treatment Program was funded by the Substance Abuse and Mental Health Services Administration’s (SAMHSA) Center for Substance Abuse Treatment to provide services to homeless persons with co-occurring mental health and substance abuse disorders. Using an evidence-based model, ServiceNet treats chronically homeless individuals in Hampshire and Franklin counties (Massachusetts). ServiceNet aims to improve housing stability and decrease the negative consequences associated with mental illness and substance use.

As the outside evaluator, our commitment to the program began during the initial proposal phase where we assisted in the development of program goals and objectives. Throughout the grant, we have worked collaboratively with ServiceNet to provide actionable program feedback, document program outcomes, and respond to required performance monitoring.

Key activities of this evaluation include:

• Developing and refining program goals and objectives
• Developing and refining the program logic model
• Identifying and creating appropriate measurement tools
• Managing and analyzing all program data
• Monitoring and reporting on SAMHSA required performance measures
• Providing ongoing, biweekly feedback to the team on process and outcome measures
• Monitoring fidelity to the evidence-based program model
• Writing quarterly and yearly evaluation reports
• Participating in SAMHSA grantee meetings and workshops

For more information, contact:

Christina Citino
Research Manager
(413) 587-2404