Data Collection

Using New Data

Even if some evaluation data are currently collected, they will often need to be supplemented by the collection of additional data. These new data can be collected through various strategies:

Direct Observation
Obtaining data by on-site observation has the advantage of providing an opportunity to learn in detail how the project works, the context in which it exists, and what its various consequences are. However, this type of data collection can be expensive and time-consuming. Observations conducted by program staff, as opposed to an outside evaluator, may also suffer from subjectivity.

Interviews
Interviews are an effective way of obtaining information about the perceptions of program staff and clients. An external evaluator will often conduct interviews with program managers, staff members, and clients to obtain their perceptions of how well the program functions. A disadvantage to conducting interviews is that they can be time-consuming and costly, and produce subjective information.

Surveys and Questionnaires
Surveys and questionnaires can provide information on program staff members' perceptions of program operations and their own functions. Surveys of clients can provide information on attitudes, beliefs, and self-reported behaviors. An important benefit of surveys is that they provide anonymity to respondents, which can reduce the likelihood of biased reporting and increase data validity. A variety of issues are associated with the use of surveys and questionnaires, including reading level, cultural bias, and sensitivity to particular wording.

Official Records
Official records and files are one of the most common sources of data for criminal justice evaluations. Arrest reports, court files, and prison records all contain much useful information for assessing program outcomes. Often these files are automated, making accessing these data easier and less expensive.

Learn More...

Basic Guidelines for the Development of Survey Items (Office of Juvenile Justice and Delinquency Prevention)

Data Collection Strategies (The Urban Institute)

Developing and Using Questionnaires (General Accounting Office)

Consortium Survey Questions on Drug Use and Drug Control Strategies (Bureau of Justice Assistance)

Special Topics in Program Evaluation: Sources of Data (Office of Juvenile Justice and Delinquency Prevention)

Use of Observation in Program Evaluation (Office of Juvenile Justice and Delinquency Prevention)

Using Structured Interviewing Techniques (General Accounting Office)

| | |
| | |