|
Approaches to evaluation vary depending upon the nature and scope of the project. Successful evaluation begins with a clear description of the program and its activities, and sets specific, measurable goals to be accomplished during a particular time period. A useful tool to help guide organizations in building their evaluation process is to construct a logic model. Moreover, as mentioned in our overview of evaluation, the logic model helps evaluate learning by serving as a tool to develop a shared understanding of the organization and program. More than any other evaluation approach, the logic model requires everyone to ask questions, seek answers, make changes based on what is learned, and repeat the process as often as necessary.
The logic model, according to the W.K. Kellogg Foundation, is “a picture of how your organization does its work—the theory and assumptions underlying the program.” A logic model is a depiction of the flow of processes to produce the results desired by the organization or program. The model can be very useful to organize planning and analysis when designing the organization and its programs or when designing outcomes-based evaluations of programs or engaging in evaluative learning. Additionally, it can also be useful for describing organizations and programs (for example, in grant proposals).
Evaluation Planning
Issues to consider when designing an evaluation:
- Intended Outcome: Who or what is expected to change because of this project?
- Activities to Achieve Outcome: What activities or set of activities are planned to achieve this outcome?
- Information Needed (Measures): What baseline information do we have? What new information will be collected and reported to demonstrate progress toward and achievement of these outcomes and activities? For sample measurements of educational programs, see Evaluation Indicators.
- Target Goals and Dates: What is the numerical target goal and date for each measure?
- Data Collection Methods: What methods will be used to gather the information and who will be responsible for gathering it?
- Resources Needed: What resources (human and financial) are needed to conduct the evaluation and what is available?
- Results: How will evaluation results be used? Who will receive them?
Utilizing Logic Models as means of Evaluation
Logic models typically depict the inputs, processes, outputs and outcomes associated with an organization and its programs. Logic models describe how a program works and to what end. Listed below are basic terms describing the nature of logic model building:
Inputs
These are materials that the organization or program takes in and then processes to produce the results desired by the organization. Types of inputs are people, money, equipment, facilities, supplies, people's ideas, people's time, etc.
Strategies/Activities
Strategies/activities are the specific activities, interventions, services, and/or programs that serve a target audience in order to meet the goal.
Outputs
Outputs are the short-term, tangible and direct measures of the major processes in the organization. They are usually quantified, for example, the number of students who failed or passed a test, courses taught, tests taken, teachers used, etc. Outputs are frequently misunderstood to indicate long-term success of an organization or program.
Outcomes
Outcomes are the short- and long-term effects of program strategies on client behaviors, attitudes, knowledge, and/or perceptions. The outcome sought by the KDK-Harman Foundation through its grantmaking efforts is to transform the lives of economically disadvantaged Central Texas families, with a focus on women, from poverty to financial independence to enable a better life for them and future generations. Short-term outcomes should be attainable within 1 to 3 years, while longer-term outcomes should be achievable within a 4-10 year timeframe.
Impact
Impact is the fundamental intended or unintended change occurring in the organization, communities, or systems as a result of the program’s activities.
 View sample logic model
The above information regarding evaluation techniques and logic model building are utilized courtesy of The Meadows Foundation and W.K. Kellogg Foundation.
|
