![]() |
||||||||||||||||
![]() |
||||||||||||||||
|
Planning the EvaluationDeveloping and Working with Program Logic ModelsWhile there are many forms, logic models specify relationships among program goals, objectives, activities, outputs, and outcomes. Logic models are often developed using graphics or schematics and allow the program manager or evaluator to clearly indicate the theoretical connections among program components: that is, how program activities will lead to the accomplishment of objectives, and how accomplishing objectives will lead to the fulfillment of goals. In addition, logic models used for evaluation include the measures that will be used to determine if activities were carried out as planned (output measures) and if the program's objectives have been met (outcome measures). Why Use a Logic Model?Logic models are a useful tool for program development and evaluation planning for several reasons:
Learn More About What a Logic Model Is and Why To Use ItDeveloping a Logic Model (The Urban Institute) Developing and Using a Logic Model (The Urban Institute) A Guide on Logic Model Development for CDC’s Prevention Research Centers (Sundra, Scherer, and Anderson) Logic Model for Program Planning and Evaluation (University of Idaho-Extension) How to Develop a Logic ModelDeveloping a logic model requires a program planner to think systematically about what they want their program to accomplish and how it will be done. The logic model should illustrate the linkages of among the elements of the program including the goal, objectives, resources, activities, process measures, outcomes, outcome measures, and external factors. Logic Model Schematic At the top of the logic model example is a goal which represents a broad, measurable statement that describing the desired long-term impact of the program. Knowing the expected long-term achievements a program is expected to make will help in determining what the overall program goal should be. Sometimes goals are not always achieved during the operation of a program. However, evaluators or program planners should continually re-visit the program's goals during program planning. An objective is a more specific, measurable concept focused on the immediate or direct outcomes of the program that support accomplishment of your goal. Unlike goals, objectives should be achieved during the program. A clear objective will provide information concerning the direction, target, and timeframe for the program. Knowing the difference your program will make, who will be impacted, and when will be helpful when developing focused objectives for your program. Resources or inputs can include staff, facilities, materials, or funds, etc--anything invested in the program to accomplish the work that must be done. The resources needed to conduct a program should be articulated during the early stages of program development to insure that a program is realistically implemented and capable of meeting its stated goal(s). Activities represent efforts conducted to achieve the program objectives. After considering the resources a program will need, the specific activities that will be used to bring about the intended changes or results must be determined. Process Measures are data used to demonstrate the implementation of activities. These include products of activities and indicators of services provided. Process measures provide documentation of whether a program is being implemented as originally intended. For example, process measures for a mental health court program might include the number of treatment contacts or the type of treatment received. Outcome measures represent the actual change(s) or lack thereof in the target (e.g., clients or system) of the program that are directly related to the goal(s) and objectives. Outcomes may include intended or unintended consequences. Three levels of outcomes to consider include: External Factors, located at the bottom of the logic model example, are factors within the system that may affect program operation. External factors vary according to program setting and may include influences such as development of or revisions to state/federal laws, unexpected changes in data sharing procedures, or other similar simultaneously running programs. It is important to think about external factors that might change how your program operates or affect program outcomes. External factors should be included during the development of the logic model so that they can be taken into account when assessing program operations or when interpreting the absence or presence of program changes. If-Then Logic Model In reality, the if-then logic model looks like this: Another way to conceptualize the "if-then" format:
Developing program logic using an "if-then" sequence can help a program manager or evaluator maintain focus and direction for the project and help specify what will be measured through the evaluation. Common Problems When Developing Logic Models It should be obvious which objective is tied to which activity, process measure, etc. Oftentimes logic models contain lists of each of the elements of a logic model without specifying which item on one list is related to which item on another list. This can easily lead to confusion regarding the relationship among elements or result in accidental omission of an item on a list of elements. The logic model should include only the primary elements related to program/project design and operation. As a general rule, it should provide the "big picture" of the program/project and avoid providing very specific details related to how, for example, interventions will occur, or a list of all the agencies that will serve to improve collaboration efforts. If you feel that a model with all those details is necessary, consider developing two models; a model with the fundamental elements and a model with the details. Make sure that items listed as objectives are in fact objectives rather than activities. Anything related to program implementation or a task that is being carried out in order to accomplish something is an activity rather than an objective. For example, 'hire 10 staff members' is an activity that is being carried out in order to accomplish an objective such as 'improve response time for incoming phone calls.' Unlike goals which are not considered measurable because they are broad, mission-like statements, objectives should be measurable and directly related to the accomplishment of the goal. An objective is measurable when it specifically identifies the target (who or what will be affected), is time-oriented (when it will be accomplished), and indicates direction of desired change. In many cases, measurable objectives also include the amount of change desired. Other Logic Model ExamplesUnited Way Program Outcome Model University of Missouri Extension Program Planning and Development Logic Model Learn More About How to Develop a Logic ModelDeveloping a Basic Logic Model for Your Program (The University of Arizona School of Public Health) Enhancing Performance with Logic Models (University of Wisconsin-Extension, Division of Cooperative Extension) Establishing Goals, Objectives and Evaluation Criteria (U.S. Department of Housing and Urban Development) Using the Logic Model for Program Planning (Legal Service Corporation Resource Information) CONTINUE to "Assessing Program Performance" Main Page | About the Center | Evaluation and Performance Measurement Resources | Program Areas BJA Required Performance Measures | Contact Us | Site Map | BJA Home |
|||||||||||||||