When it comes to understanding the effectiveness of programs or initiatives, two terms that are often used interchangeably are “research” and “evaluation.” While both are important for gathering information and making informed decisions, their differences are not always clear. Whether you're a program manager, academic researcher, or just interested in learning more about these concepts - this article is sure to provide valuable insights.
Research vs evaluation: What's the difference?
The largest difference between research and evaluation projects are the questions you intend to answer. Research is often focused on experimental and exploratory questions, while evaluation questions are broader & focus on overall effectiveness and impact of an effort. Traditionally, research involves collecting more quantitative data (i.e., numbers), while evaluation often leans more heavily on collecting qualitative data (i.e., narrative). However, the best research and evaluation projects involve both qualitative and quantitative data.
What is research?
Research is used to develop knowledge or theories about a particular subject. A “research study” investigates a question, problem, or phenomenon. Research uses many different data collection methods, such as surveys, observations, interviews, and more. Research can be conducted in various fields or sectors, including public health, social science, psychology, education, and more! The primary aim of research is to expand knowledge & generate new insights into a particular area to make more informed decisions.
What is evaluation?
Evaluation, on the other hand, is used to assess effectiveness, impact, or value of a program, policy, initiative, or service. An evaluator collects and analyzes data to determine whether the program or initiative achieved its intended goals or outcomes, its cost-effectiveness, efficiency, and if it was implemented correctly. The primary aim of evaluation is to provide feedback and recommendations for planning, implementing, and improving programs and initiatives. At Strategic Prevention Solutions, evaluation is approached by working alongside an agency and rooted in understanding the context of the project & community, and values using local expertise to inform best practices and recommendations for the project.
Data collection methods for research and evaluation
Research and evaluation often use similar methods to collect data. However, as stated above, whether you’re conducting research or evaluation is mostly determined by the questions you intend to answer. Some common methods (with examples) for research and evaluation include:
Method of Data Collection | Research | Evaluation |
|---|---|---|
Surveys | Gathers frequency of experiences from individuals | Gathers feedback from participants on their experience in a program |
Example Question | "How often do individuals with lack of transportation visit the doctor?" | "To what extent was the program useful for participants in achieving their goals? |
Interviews & Focus Groups | Provides an understanding of experiences within a group of people | Provides insights into the impact of an initiative |
Example Question | "Why do some individuals have a lack of access to transportation?" | "To what extent did the program change participants behavior?" |
Document Review | Reviews reports and written documents to understand experiences or events | Reviews comment cards to improve presentations |
Example Question | "What level of servity in health conditions do individuals without transportation visit the doctor?" | "What feedback do participants have on the presentation topic or speakers?" |
Observation | Observes the behaviors of a group of people | Observes the facilitation of a pilot program |
Example Question | "What is the participants experience like in the doctors office? | "What are the interactions between facilitators and participants like?" |
Examples of Research and Evaluation
The following examples can help illustrate the differences between research and evaluation:
Research: A researcher is interested in understanding following question: What is the impact of fatigue and burnout in social workers, such as staff turnover and negative client outcomes? They conduct a survey and host interviews with social workers who provide insight into their scheduling, workplace environment, staffing, client experiences, and their physical and mental health. The researcher analyzes the data to pick out themes across experiences. After analyzing the qualitative and quantitative data, they can determine whether staffing and workplace environment have an impact on fatigue and burnout – which may lead to staff turnover and negative client outcomes.
Evaluation: A program manager is interested in assessing the following question: What is the effectiveness of a new job training program to reduce staff turnover? They gather feedback from program participants through surveys and interviews to assess their experiences and opinions in the training program. They also consider program outcomes, such as job placement rates, salary increases, performance reviews, and duration of employment to determine whether the program is achieving its intended goals.
In both of these examples, the approach used is tailored to the specific questions being asked. Research is used to answer a specific scientific question, while evaluation is used to assess the effectiveness of a program or initiative.
Understanding the importance of research and evaluation in decision-making
Research and evaluation evidence are critical to help decision-makers understand a problem and make adjustments to better address needs. Utilizing research and evaluation in decision-making can help with the following:
Resource Allocation
Determining the need for funding and other resources
Deciding how to allocate funding, resources, programs, and services
Eliminating ineffective activities
Policy Making
Planning and Improvement
Advocacy and Education
New best practices in research and evaluation
An up and coming trend in research and evaluation is the use of “participatory” approaches. Participatory research and evaluation is the process of involving those who would be most impacted by the project. Participatory approaches in decision-making are often helpful because it provides realistic context of the short and long term impacts of decisions.
Participatory approaches can help with the following: Improve accuracy and relevancy of programs
Identify potential impacts
Empower participants
Build capacity
Sustain learning and growth
Conclusion
Research generates new knowledge, while evaluation assess the impact and effectiveness. Both research and evaluation involve the use of data and scientific methods to collect and analyze information to make more informed decisions. Are you interested in understanding experimental and exploratory questions (research) or broader & focused questions on overall effectiveness and impact (evaluation)? Contact us to start your project!
Sources
Better Evaluation. (n.d.). Establish decision making processes. Better Evaluation. Retrieved from: https://www.betterevaluation.org/frameworks-guides/rainbow-framework/manage/establish-decision-making-processes
Gopal, S., Preskill, H. (2014). What is evaluation, really? FSG. Retrieved from: https://www.fsg.org/blog/what-evaluation-really/
Khalid, A., Lavis, J.,El-Jardali, F., Vanstone, M. (2020). Supporting the use of research evidence in decision-making in crisis zones in low- and middle-income countries: A critcal interpretive synthesis. Health Research Policy and Systems. Retrieved from: https://health-policy-systems.biomedcentral.com/articles/10.1186/s12961-020-0530-2#ref-CR14
Purdue Univeristy. (n.d.). What is research? Purdue University. Retrieved from: https://www.purdue.edu/science/careers/find_internship_research/getting_started_with_research/what_is_research.html
Sette, C. (2021). Participatory evaluation. Better Evaluation. Retrieved from: https://www.betterevaluation.org/methods-approaches/approaches/participatory-evaluation
U.S. Department of Energy. (n.d.). Why evaluate: Making informed decisions. U.S. Department of Energy. Retrieved from: https://www.energy.gov/eere/analysis/why-evaluate-making-informed-decisions