AYN572 Program Evaluation in Organisations


To view more information for this unit, select Unit Outline from the list below. Please note the teaching period for which the Unit Outline is relevant.


Unit Outline: Semester 1 2024, Gardens Point, Internal

Unit code:AYN572
Credit points:12
Pre-requisite:48credit points of completed studies.
Coordinator:Kylie Kingston | k.kingston@qut.edu.au
Disclaimer - Offer of some units is subject to viability, and information in these Unit Outlines is subject to change prior to commencement of the teaching period.

Overview

This unit introduces students to the discipline of program evaluation. Program evaluation is a transdisciplinary field that focusses on understanding the merit, worth or significance of programs, policies, and/or practices in order to determine their suitability and assess their effectiveness and efficiency. Evaluation can also help to enhance organisational transparency and accountability toward different stakeholders. In this unit, students will be introduced to critical theoretical perspectives and worldviews underpinning different evaluation practices and purposes, including ethical and stakeholder considerations. This will lead to students learning how to plan and design evaluations including understanding different methodological approaches and their application in varied contexts. The focus of the unit is program evaluation in organisations such as charities, foundations, nonprofit organisations, public sector entities and social enterprises. 

Learning Outcomes

On successful completion of this unit you will be able to:

  1. Identify and compare different theoretical perspectives underpinning approaches to conducting evaluations and their application in real-world contexts. KS (1.1), HO (2.1)
  2. Critically analyse and justify approaches to evaluation in light of ethical principles and impact upon stakeholders. SE (5.1, 5.2)
  3. Plan, and justify, a detailed program evaluation design, including how to report evaluation findings. HO (2.2)

Content

  • Exploring the theory of evaluation and its value within foundations, charities, nonprofit organisations and social enterprises 
  • Designing and applying theories of change and logic models to plan and justify evaluations   
  • Reviewing evaluation approaches and methodologies  
  • Identifying ethical considerations and including stakeholders in evaluative practices  

Learning Approaches

This unit is delivered in a blended format to maximise flexibility for students.

Weekly combined lecture/tutorials are presented and recorded to provide a background, introduction and overview to the main topics and perspectives being considered each week. Class discussion and participation is encouraged. Additionally, readings and associated weekly tutorial activities will be made available online. Completing the assigned activities prior to class is recommended for maximising learning from the unit.

The unit is therefore appropriate for both on-campus and off-campus students through the use of both classroom-based settings as well as online collaborative tools (such as Zoom) to facilitate discussion.

All resource materials will be available each week from the Canvas Site, including a recording of the lecture/tutorials.

Feedback on Learning and Assessment

Students will receive feedback in various forms throughout the semester which may include: 

  • Informal: worked examples, such as verbal feedback in class, personal consultation 
  • Formal: in writing, such as checklists (e.g. criteria sheets), written commentary 
  • Direct: to individual students, either in written form or in consultation 
  • Indirect: to the whole class 

Assessment

Overview

The assessment for this unit is designed to encourage critical and reflective thinking upon evaluation within organisations and its application in different contexts. In light of this, the assessment tasks support students to develop and apply knowledge of evaluation theories, purposes, and approaches whilst also considering who benefits from evaluation. This leads to demonstrating the ability to apply ethical principles and considerations.  

Students may be required to attend campus or an assessment centre for the purposes of assessment, regardless of the attendance mode for the unit.

Unit Grading Scheme

7- point scale

Assessment Tasks

Assessment: Evaluation Theory Test

In response to the presentation of different real-world contextual examples and challenges, students will identify, describe, and reflect upon different evaluation purposes and their suitability based on theoretical considerations. 

Weight: 20
Length: 1000
Individual/Group: Individual
Due (indicative): Week 4
Related Unit learning outcomes: 1

Assessment: Evaluation, ethics and stakeholder analysis

Using a case study approach, students will prepare stakeholder analyses and critically reflect upon ethical dilemmas and practices in relation to evaluation within the different real-world contexts. The analyses must be supported by academic literature and identify underpinning theoretical perspectives.  

This is an assignment for the purposes of an extension.

Weight: 30
Length: 2000 words
Individual/Group: Individual
Due (indicative): Week 8
Related Unit learning outcomes: 2

Assessment: Evaluation Design Report

Students will plan and design a program evaluation for a real-world context. The evaluation design will be embedded within an appropriate evaluation paradigm and include an overview of the evaluation context, evaluation purpose, and a theory of change. The design will include an appropriate methodology and proposed reporting techniques.  

This is an assignment for the purposes of an extension.

Weight: 50
Length: 3000 words
Individual/Group: Individual
Due (indicative): Week 13
Related Unit learning outcomes: 1, 2, 3

Academic Integrity

Students are expected to engage in learning and assessment at QUT with honesty, transparency and fairness. Maintaining academic integrity means upholding these principles and demonstrating valuable professional capabilities based on ethical foundations.

Failure to maintain academic integrity can take many forms. It includes cheating in examinations, plagiarism, self-plagiarism, collusion, and submitting an assessment item completed by another person (e.g. contract cheating). It can also include providing your assessment to another entity, such as to a person or website.

You are encouraged to make use of QUT’s learning support services, resources and tools to assure the academic integrity of your assessment. This includes the use of text matching software that may be available to assist with self-assessing your academic integrity as part of the assessment submission process.

Further details of QUT’s approach to academic integrity are outlined in the Academic integrity policy and the Student Code of Conduct. Breaching QUT’s Academic integrity policy is regarded as student misconduct and can lead to the imposition of penalties ranging from a grade reduction to exclusion from QUT.

Resources

The resources for this unit are provided primarily online via QUT Readings. There is also a single required textbook for this unit:

Resource Materials

Prescribed text(s)

Mertens, D. M., & Wilson, A. T. (2018). Program evaluation theory and practice. Guilford Publications 

Standards/Competencies

This unit is designed to support your development of the following standards\competencies.

QUT Business Capabilities (Postgraduate)

HO (2.1): Critical Analysis

Relates to: ULO1, Evaluation Theory Test

HO (2.2): Independent Judgement and Decision-Making

Relates to: ULO3, Evaluation Design Report

KS (1.1): Discipline and Professional Practice Knowledge

Relates to: ULO1, Evaluation Theory Test, Evaluation Design Report

SE (5.1): Ethical and Legal Understanding

Relates to: ULO2, Evaluation, ethics and stakeholder analysis

SE (5.2): Global Social Responsibility

Relates to: ULO2, Evaluation, ethics and stakeholder analysis , Evaluation Design Report

Course Learning Outcomes

This unit is designed to support your development of the following course/study area learning outcomes.

BS11 Master of Business

  1. Demonstrate and apply integrated and advanced discipline and professional practice knowledge, including knowledge of relevant research principles and methods.
    Relates to: ULO1, Evaluation Theory Test, Evaluation Design Report
  2. Demonstrate and apply knowledge of socially responsible behaviour in analysing and addressing business issues and critically reflect on the responsibilities and impacts of organisations in national and international business contexts.
    Relates to: ULO2, Evaluation, ethics and stakeholder analysis , Evaluation Design Report
  3. Critically investigate real world business issues and problems drawing on analysis, evaluation and synthesis of discipline knowledge, including theory and practice.
    Relates to: ULO1, Evaluation Theory Test
  4. Exercise creativity and intellectual independence and make informed decisions and judgements in planning, designing, and executing strategic and research-based responses to address real world issues and problems.
    Relates to: ULO3, Evaluation Design Report
  5. Demonstrate and apply knowledge of ethical and legal principles and practices of business in critically analysing and effectively responding to complex business issues.
    Relates to: ULO2, Evaluation, ethics and stakeholder analysis