• Home
  • The University of British Columbia
  • Research Methods
  • Special Research Designs and Program Evaluation

Special Research Designs and Program Evaluation

PSYC217 Chapter 10 - Special Research Designs Introduction - In the basic experimental design participants are randomly assigned to the levels of the IV, and a DV is measured. - Responses on the DV for the groups are then compared to determine whether the IV affected the DV. " If all variables are held constant, differences on DV can be attributed to effect of IV. · When designed correctly, simple experiments can be said to possess high internal validity > allows us to infer that the IV caused observed differences in the DV. · If all aspects of a basic experimental design are present, and absent any threats to internal validity, this design is sometimes called a true experiment. - Not all research topics are amenable to the use of a true experiment. · Single case experimental designs, relying on just a single participant, were developed for instances when only one appropriate participant is available. · Quasi-experimental designs are employed when random assignment for a variable is not possible (e.g., participant variables such as cultural background). · Studying changes that occur with age requires yet another set of variations on the basic experimental design. Program Evaluation - Program evaluation: research designed to evaluate programs (e.g., social reforms, innovations) designed to produce changes or certain outcomes in a target population. - Researchers frequently investigate applied research questions and evaluate real-world programs and interventions. - Applied research and evaluation research can present numerous difficulties that prevent researchers from using true experiments. " Sometimes budget limitations rule out some forms of data collection · Complexities are common for research in the real world - Program evaluation is research on programs that are proposed and implemented to achieve some positive effect on a group of people " Programs may be implemented in schools, work settings, or entire communities. . E.g., the "At My Best" program designed to reduce obesity by teaching primary school children to make healthy choices about diet and activity. o Program is conducted by classroom teachers with supporting materials developed by Physical and Health Education Canada. - Donald Campbell (1969) · Influential social psychologist urged a culture of evaluation in which programs are thoroughly evaluated to determine whether they are effective or not for the population · Initial focus of evaluation research was outcome evaluation > did the program result in the positive outcome for which it was designed? - A full program evaluation can be an extensive long-term undertaking . "Shoestring evaluation" > constraints related to time, budget, and data collection options - As the field of program evaluation has progressed, evaluation research has broadened its scope · Categorized into five broad types of questions that can guide program evaluations emphasizing the purpose of the evaluation 1. Needs Assessment > Are there problems that need to be addressed in a population? 2. Program Theory Assessment > How will the problems be addressed? Will proposed programs address the need appropriately? 3. Process Evaluation > Is the program addressing the needs appropriately?