Surveys and Experiments: Design, Implementation and Analysis

Module title	Surveys and Experiments: Design, Implementation and Analysis
Module code	POLM897
Academic year	2023/4
Credits	15
Module staff	Dr Simge Andi (Convenor)

Duration: Term	1	2	3
Duration: Weeks	11

Number students taking module (anticipated)	20

Module description

Every organization, whether public or private, conducts surveys to understand their audience: customers, constituents, and the public at-large. For example, in market research it is necessary to examine data on sales and customer satisfaction to make decisions about a future marketing strategy. In political research, you may want to collect and analyse data from polls. Surveys are therefore a critically important methodological tool for evaluating policy, performance, and measuring impact. This module will provide you with an essential skill set in data science increasing your employability in various sectors including consulting, polling, data analysis. This module also prepares you for conducting research for your dissertation.

No pre-requisites needed for this module.

Module aims - intentions of the module

In this module,

You will learn to design and implement surveys and experiments that provide meaningful insights.
You will learn also learn to use survey software such as Qualtrics.
You will get acquainted with sampling, participant recruitment and management.
You will be introduced to data analysis in surveys and experiments.

Intended Learning Outcomes (ILOs)

ILO: Module-specific skills

On successfully completing the module you will be able to...

1. Design, implement, and analyse surveys and experiments for conducting research and evaluating programs, policies, and outcomes
2. Identify sources of error and bias in surveys and experiments

ILO: Discipline-specific skills

On successfully completing the module you will be able to...

3. Use quantitative methods of data collection and analysis
4. Critically evaluate empirical research in the social sciences.

ILO: Personal and key skills

On successfully completing the module you will be able to...

5. Apply methodological and substantive knowledge from the course to the design and implementation of an original survey
6. Demonstrate how to successfully manage large survey data collection efforts

Syllabus plan

Whilst the module’s precise content may vary from year to year, it is envisaged that the syllabus will cover some or all of the following themes.

Introduction to observational and experimental research
Populations and Sampling Frames, Sampling Techniques
Questionnaire Design
Survey Evaluation and Pilot Testing
Recruitment and Fielding
Data Management in surveys
Experiments: Introduction to different types of experiments
Designing an experiment
Introduction to data analysis in surveys and experiments

Learning activities and teaching methods (given in hours of study time)

Scheduled Learning and Teaching Activities	Guided independent study	Placement / study abroad
22	128	0

Details of learning activities and teaching methods

Category	Hours of study time	Description
Scheduled Learning and Teaching	22	(11 x 2 hour) The weekly lectures detail conceptual frameworks, key issues and debates in surveys and experiments, and help guide your reading. The lectures also include group discussion or in-class exercises.
Guided Independent Study	128	Coursework and independent study includes: Reading 3 hours per week Note taking 1 hour per week Sketching answers to class discussions 1 hour per week Preparing for formative assignments, research plan preparation 1 to 3 hours per week This study is continuous throughout the course and should take six to eight hours a week

Formative assessment

Form of assessment	Size of the assessment (eg length / duration)	ILOs assessed	Feedback method
Lab assignment 1	300 words	1, 2, 4	Written or oral feedback
Lab assignment 2	300 words	1-4	Written or oral feedback
Lab assignment 3	300 words	1-6	Written or oral feedback

Summative assessment (% of credit)

Coursework	Written exams	Practical exams
100	0	0

Details of summative assessment

Form of assessment	% of credit	Size of the assessment (eg length / duration)	ILOs assessed	Feedback method
Research Design Essay	100	3000 words	1-6	Written

Details of re-assessment (where required by referral or deferral)

Original form of assessment	Form of re-assessment	ILOs re-assessed	Timescale for re-assessment
Research Design Essay (3000 words)	Research Design Essay (3000 words)	1-6	Referral/Deferral period

Indicative learning resources - Basic reading

Robert M. Groves, Floyd J. Fowler, Mick P. Couper, James M. Lepkowski, Eleanor Singer, and Roger Tourangeau. Survey Methodology. Wiley-Interscience, second edition, 2009.
William R. Shadish, Thomas D. Cook, and Donald T. Campbell. Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Houghton- Mifflin, Boston, MA, 2001.

Indicative learning resources - Other resources

Douglas D. Heckathorn. Respondent-driven sampling: A new approach to the study of hidden populations. Social Problems, 44(2):174–199, May 1997.
Converse, Jean M., and Stanley Presser. 1986. Survey Questions: Handcrafting the Standardized Questionnaire. Thousand Oaks, CA: Sage Publications.
DeVellis, Robert F. 2011. Scale Development: Theory and Applications. 3rd ed. Thousand Oaks, CA: Sage. Weisberg,
Erin C. Cassese, Leonie Huddy, Todd K. Hartman, Lilliana Mason, and Christopher R. Weber. Socially mediated internet surveys: Recruiting participants for online experiments. PS: Political Science & Politics, 46(4):1–10, 2013.
David Scott Yeager, Jon A. Krosnick, Linchiat Chang, Harold S. Javitz, Matthew S. Leven- dusky, Alberto Simpser, and Rui Wang. Comparing the accuracy of RDD telephone surveys and internet surveys conducted with probability and non-probability samples. Public Opinion Quarterly, 75(4):709–747, October 2011.
Holland, P. W. 1986. “Statistics and Causal Inference.” Journal of the American Statistical Association 81: 945-960.
Druckman, J. N., Green, D. P., Kuklinski, J. H., and Lupia, A. 2006. “The Growth and Development of Experimental Research in Political Science.” American Political Science Review 100: 627-635.

Key words search

Surveys, experiments, data analysis, research methods, research design

Credit value	15
Module ECTS	7.5
Module pre-requisites	None
Module co-requisites	None
NQF level (module)	7.5
Available as distance learning?	No
Origin date	29/05/2023
Last revision date	29/05/2023