Policy Analysis and Evaluation
| Module title | Policy Analysis and Evaluation |
|---|---|
| Module code | POLM008M |
| Academic year | 2019/0 |
| Credits | 20 |
| Module staff | Professor Oliver James (Convenor) |
| Duration: Term | 1 | 2 | 3 |
|---|---|---|---|
| Duration: Weeks | 12 |
| Number students taking module (anticipated) | 15 |
|---|
Module description
Effective policy making requires that decision-makers are well placed to understand what has worked in the past. Consequently, the policy process has become increasingly quantified and analysed using sophisticated statistical models. But the measurement, analysis and interpretation of performance data can be controversial. Care needs to be taken to avoid crude and misleading conclusions being drawn from poor analysis. Knowledge of the analytical and evaluative techniques used in this activity is increasingly important for decision making at senior levels across many parts of the public sector. In the module you will also explore how the techniques are put to use.
Module aims - intentions of the module
A key theme of contemporary public policy and public management is the use of evidence to discover 'what works', with the aim of improving theory and practice. Measurement, analysis and evaluation of public service performance, especially as part of performance management, are increasingly practised. The module aims to introduce you to these techniques. The module will describe and critically assess a set of potentially powerful and widely used analysis and evaluation tools. The aim is to obtain an overview of techniques rather than full proficiency in all of them. We look at policy interventions in socioeconomic policy, local public management and public service performance.
Intended Learning Outcomes (ILOs)
ILO: Module-specific skills
On successfully completing the module you will be able to...
- 1. critically examine the theory and method of policy analysis and evaluation;
- 2. demonstrate an understanding of the range of techniques used in contemporary analysis and their appropriate use for different policy issues;
- 3. critically examine the contemporary use of these techniques in a range of policy settings;
ILO: Discipline-specific skills
On successfully completing the module you will be able to...
- 4. critically assess the theory and practice of policy analysis and evaluation as part of public policy and administration;
- 5. analyse and comment critically on the academic and policy literature on these topics;
- 6. apply public policy administration theories to contemporary problems in public services and organisation contexts;
ILO: Personal and key skills
On successfully completing the module you will be able to...
- 7. undertake independent/self-directed learning (including time management) to achieve consistent, proficient and sustained attainment;
- 8. work as a participant or leader of a group and contribute effectively to the achievement of objectives; and
- 9. reflect on the process of learning and evaluate personal strengths and weaknesses.
Syllabus plan
Whilst the module’s precise content may vary from year to year, it is envisaged that the syllabus will include the following topics in the order indicated:
1. Policy analysis and evaluation: definition and key themes
2. Overview of techniques: valuation, observation and experimentation, case studies and large sample approaches
3. Field experiments and natural experiments
4. Meta-analysis and combining evidence
5. Using evaluation in evidence based policy, performance management
6. Review and comment on exercises
Teaching of subject knowledge will be through a) preliminary directed learning and compulsory reading of core texts b) two day block of intensive teaching using lectures, linked tutorials, seminar speakers and completion of exercises c) submission of exercises and reflective learning log and feedback.
Students are provided with a module handbook (also available via ELE) consisting of background material to inform the preliminary directed learning, the topics for discussion and learning in the intensive teaching days and teaching exercises. The intensive teaching days provide hands on experience with data analysis techniques for evaluation purposes and review the preliminary learning. The teaching exercises consist of evaluation problems with methods, and data analysis. The learning log will require students to relate what they have learned on the module to their current or prospective work practices and issues. In addition, the dedicated MPA ELE platform will have timed downloads of material and links to key reading and directed learning. Students are required to submit the mini-project to deadline at the end of the module.
Learning activities and teaching methods (given in hours of study time)
| Scheduled Learning and Teaching Activities | Guided independent study | Placement / study abroad |
|---|---|---|
| 18 | 182 | 0 |
Details of learning activities and teaching methods
| Category | Hours of study time | Description |
|---|---|---|
| Scheduled Learning and Teaching | 9 | Nine Lectures (1 hour each) |
| Scheduled Learning and Teaching | 6 | Six Seminars (1 hour each) |
| Scheduled Learning and Teaching | 3 | One Guest Presentation (3 hours) |
| Guided independent study | 82 | Reading, thinking and preparing for lectures and seminars |
| Guided independent study | 100 | Preparation for assignment |
Formative assessment
| Form of assessment | Size of the assessment (eg length / duration) | ILOs assessed | Feedback method |
|---|---|---|---|
| Participation in seminars and workshops | Teaching week | 1-9 | Verbal feedback |
Summative assessment (% of credit)
| Coursework | Written exams | Practical exams |
|---|---|---|
| 100 | 0 | 0 |
Details of summative assessment
| Form of assessment | % of credit | Size of the assessment (eg length / duration) | ILOs assessed | Feedback method |
|---|---|---|---|---|
| Evaluation Exercises to be completed prior and during the teaching period | 80 | 3,200 words | 1-9 | One week marking turnaround with written feedback |
| Reflective Learning Log | 20 | 800 words | 1-9 | One week marking turnaround with written feedback |
Details of re-assessment (where required by referral or deferral)
| Original form of assessment | Form of re-assessment | ILOs re-assessed | Timescale for re-assessment |
|---|---|---|---|
| Evaluation Exercises to be completed prior and during the teaching period | Evaluation Exercises (3,200 words) | 1-9 | Next reassessment period |
| Reflective Learning Log | Reflective Learning Log (800 words) | 1-9 | Next reassessment period |
Indicative learning resources - Basic reading
Blundell, R. and Costa Dias, M. (2002) Alternative approaches to evaluation in empirical microeconomics, CEMMAP working paper CWP10/02
Burtless, G (1995) 'The Case for Randomized Field Trials in Economic and Policy Research'. Journal of Economic Perspectives, Spring 1995, pp 63-84.
James, O (2008) Citizens Use of Public Service Performance Information: A Field Experiment Paper presented to Administration and Democracy Conference 2008.
Layard, R. and Glaister, S. (2003) Cost benefit analysis, Cambridge University Press,
Positer, T.H. (2003) Measuring Performance in Public and Nonprofit Organizations The Jossey-Bass Nonprofit and Public Management Series.
Smith P.C et al (2000) What Works? Evidence Based Policy and Practice in Public Services, Bristol, Policy Press.
Weiss, C (1998) Evaluation Prentice Hall; 2 edition.
Wholey, J.S, Hatry, H.P. and Newcomer, K.E. (2004) Handbook of Practical Program Evaluation Jossey Bass Nonprofit & Public Management Series.
The module will be supported by ELE materials, including links to core texts
ELE – vle.exeter.ac.uk
| Credit value | 20 |
|---|---|
| Module ECTS | 10 |
| Module pre-requisites | This module is available to students on the MPA Programme only. |
| Module co-requisites | None |
| NQF level (module) | 7 |
| Available as distance learning? | No |
| Origin date | 01/10/2009 |
| Last revision date | 06/05/2014 |
