Experimental Methods

A 2-Day Seminar in Philadelphia, PA

May 16 – 17, 2019

Taught by Dr. S. Michael Gaddis

Presented through Statistical Horizons

Experiments in the social and behavioral sciences have become more popular as the Internet has made implementing experiments easier, cheaper, and faster. Although researchers may have a conceptual knowledge of how experiments work, the actual experience of implementing an experiment for the first time is often frustrating and time consuming. The initial learning curve may be steep, but the rewards are plentiful as experiments produce highly valued original data, lend themselves to causal analysis in ways that traditional survey data cannot, and become easier to implement as a researcher’s experience level increases.

This seminar is a moderately-paced introduction to experimental methods that will leave researchers able to begin designing their own experiments and embarking on data collection. We begin by focusing on the what, when, and why of experiments in the social sciences, with a comprehensive introduction to vocabulary, diagramming, and the theoretical basis of conducting experiments. We then walk through the specific steps required in experimental design, from ethical issues to power analysis to the universe of validity concerns. We conclude with two sections on practical design issues of survey and field experiments, drawing on recent published cases and the instructor’s own experiences. These sections incorporate hands-on practice using online resources to give students the confidence to begin designing their own experiments.

By the end of the seminar, participants should understand the basic terminology of experiments, when experiments can and should be implemented, the causal advantages of experiments, the ethical issues surrounding experiments, the major aspects of randomization, blocking, matching, and sampling, and the major issues regarding different types of validity. Participants will also gain practical knowledge of MTurk, Qualtrics, and SurveyMonkey for use with survey experiments, along with a variety of programming scripts and tools for use with field experiments. Overall, participants will gain the knowledge to immediately begin designing valid and robust experiments to address a variety of research questions.

Visit the Statistical Horizons website to see full information on this workshop and to register.

COMPUTING

To participate in the hands-on exercises, you are strongly encouraged to bring a laptop computer (Windows or Mac) and not rely on a tablet only. No software is necessary.

WHO SHOULD ATTEND?

This seminar is designed for researchers at any level who have an interest in conducting their own experiments or simply want to be able to better understand the methodological details of experiments conducted by others. Participants need only a basic understanding of general research design.

LOCATION, FORMAT AND MATERIALS

The class will meet from 9 am to 5 pm each day with a 1-hour lunch break at Temple University Center City, 1515 Market Street, Philadelphia, PA 19103.

Participants receive a bound manual containing detailed lecture notes (with equations and graphics), examples of computer printout, and many other useful features. This book frees participants from the distracting task of note taking.

REGISTRATION

The fee of $995.00 includes all seminar materials. The early registration fee of $895.00 is available until April 16.

SEMINAR OUTLINE

1. Using experiments to establish causation
2. The ethics of experimental design
3. Major issues of design – randomization, blocking, matching, and sampling
4. Major issues of validity – internal, construct, external, and statistical conclusion
5. Statistical power and conducting a power analysis
6. Analyzing your results
7. Turning the theoretical into the practical: Hands-on with survey experiments
8. Turning the theoretical into the practical: Hands-on with field experiments