Moving beyond reasonable adjustments: supporting employability through inclusive assessment design
DOI:
https://doi.org/10.21153/jtlge2023vol14no2art1785Abstract
Higher education is moving towards being more inclusive. However, students with disabilities continue to report that their assessment experiences are less than optimal. In these situations, if an assessment format does not enable demonstration of achievement due to aspects irrelevant to the capabilities of interest, then such students are unfairly penalised. In this way, assessment impacts on students’ success at university and beyond. Assessment adjustments are required by law, but are only partially effective since they may impact on assessment validity and hence opportunities for students to accurately represent their learning and achievement. To ensure assessment supports, rather than detracts, from student success and employability, assessment design should be scrutinised in terms of inclusion, with consideration of future potential work environments and graduate attributes. This paper presents an analysis of 2860 assessment adjustments implemented for students with a range of conditions and students’ experiences of adjustments, to highlight possibilities for inclusive assessment design which promote graduate employability. Adjustments relating to exams were most common (71% of students), but group work and oral presentations were also problematic for inclusion. Redesigning exams, including formative opportunities and structures for oral and group tasks, offering flexibility in tasks, and involving students in understanding equivalence across assessment types could improve inclusion. Through supporting students in these ways, assessment design could also incorporate the development of graduate attributes, such as teamwork, global citizenship and communication. This is likely to have a positive impact on students’ success and employability.Metrics
References
Ashworth, M., Bloxham, S., & Pearce, L. (2010). Examining the tension between academic standards and inclusion for disabled students: the impact on marking of individual academics’ frameworks for assessment. Studies in Higher Education, 35(2), 209–223. https://doi.org/10.1080/03075070903062864
Bearman, M., & Ajjawi, R. (2021). Can a rubric do more than be transparent? Invitation as a new metaphor for assessment criteria. Studies in Higher Education, 46(2), 359–368. https://doi.org/10.1080/03075079.2019.1637842
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa
Burgstahler, S. (2020). Equal Access: Universal Design of Instruction. Disabilities, Opportunities, Internetworking, and Technology. https://www.washington.edu/doit/equal-access-universal-design-instruction
Carnegie Mellon University. (n.d.). Design inclusive assessments. Eberly Center. https://www.cmu.edu/teaching/designteach/teach/classroomclimate/strategies/designassessment.html
Center for Applied Special Technology. (2018). Universal Design for Learning Guidelines version 2.2. http://udlguidelines.cast.org
Cordiner, M., & Kift, S. (2008). Briefing paper on first year assessment. https://transitionpedagogy.com.au/wp-content/uploads/2014/05/ALTCKiftAssessmentBriefingPaperforDesktop_15Dec09.pdf
Craddock, D., & Mathias, H. (2009). Assessment options in higher education. Assessment and Evaluation in Higher Education, 34(2), 127–140. https://doi.org/10.1080/02602930801956026
Davies, W. M. (2009). Groupwork as a form of assessment: Common problems and recommended solutions. Higher Education, 58(4), 563–584. https://doi.org/10.1007/s10734-009-9216-y
Department of Education. (2019). 2018 Section 16 Equity performance data. Australian Government. https://www.education.gov.au/higher-education-statistics/resources/2018-section-16-equity-performance-data
Disability Discrimination Act 1992 (Cth). https://www.legislation.gov.au/Details/C2018C00125
Duke Learning Innovation. (n.d.). Best Practices for Inclusive Assessment. https://learninginnovation.duke.edu/blog/2018/11/inclusive-assessment/
Duncan, H., & Purcell, C. (2020). Consensus or contradiction? A review of the current research into the impact of granting extra time in exams to students with specific learning difficulties (SpLD). Journal of Further and Higher Education, 44(4), 439–453. https://doi.org/10.1080/0309877X.2019.1578341
Equality Challenge Unit. (2014). Understanding Adjustments: Supporting Staff and Students who are Experiencing Mental Health Difficulties. https://web.archive.org/web/20211010153025/http://www.ecu.ac.uk/wp-content/uploads/2015/02/ECU_Understanding-adjustments.pdf
Fovet, F. (2019). Not just about disability. In S. Bracken and K. Novak (Eds.), Transforming Higher Education Through Universal Design for Learning, 179–200. Routledge. https://doi.org/10.4324/9781351132077-11
Fuller, M., Healey, M., Bradley, A., & Hall, T. (2004). Barriers to learning: A systematic study of the experience of disabled students in one university. Studies in Higher Education, 29(3), 303–318. https://doi.org/10.1080/03075070410001682592
Golan, M., Singer, G., Rabin, N., & Kleper, D. (2020). Integrating actual time usage into the assessment of examination time extensions provided to disabled college engineering students. Assessment and Evaluation in Higher Education, 45(7), 988–1000. https://doi.org/10.1080/02602938.2020.1717434
Grimes, S., Scevak, J., Southgate, E., & Buchanan, R. (2017). Non-disclosing students with disabilities or learning challenges: characteristics and size of a hidden population. Australian Educational Researcher, 44(4–5), 425–441. https://doi.org/10.1007/s13384-017-0242-y
Grimes, S., Southgate, E., Scevak, J., & Buchanan, R. (2019). University student perspectives on institutional non-disclosure of disability and learning challenges: reasons for staying invisible. International Journal of Inclusive Education, 23(6), 639–655. https://doi.org/10.1080/13603116.2018.1442507
Grimes, S., Southgate, E., Scevak, J., & Buchanan, R. (2021). Learning impacts reported by students living with learning challenges/disability. Studies in Higher Education, 46(6), 1146–1158. https://doi.org/10.1080/03075079.2019.1661986
Hanafin, J., Shevlin, M., Kenny, M., & Neela, E. M. (2007). Including young people with disabilities: Assessment challenges in higher education. Higher Education, 54(3), 435–448. https://doi.org/10.1007/s10734-006-9005-9
Hockings, C. (2010). Inclusive learning and teaching in higher education: a synthesis of research. EvidenceNet, Higher Education Academy. https://www.advance-he.ac.uk/knowledge-hub/inclusive-learning-and-teaching-higher-education-synthesis-research
Hughes, K., Corcoran, T., & Slee, R. (2016). Health-inclusive higher education: listening to students with disabilities or chronic illnesses. Higher Education Research & Development, 35(3), 488–501. https://doi.org/10.1080/07294360.2015.1107885
Jamieson, J. P., Peters, B. J., Greenwood, E. J., & Altose, A. J. (2016). Reappraising Stress Arousal Improves Performance and Reduces Evaluation Anxiety in Classroom Exam Situations. Social Psychological and Personality Science, 7(6), 579–587. https://doi.org/10.1177/1948550616644656
Jisc. (n.d.). Inclusive assessment. https://www.jisc.ac.uk/guides/transforming-assessment-and-feedback/inclusive-assessment
Jopp, R., & Cohen, J. (2020). Choose your own assessment–assessment choice for students in online higher education. Teaching in Higher Education, 22(6), 738-755. https://doi.org/10.1080/13562517.2020.1742680
Jorre de St Jorre, T., Boud, D., & Johnson, E. D. (2021). Assessment for distinctiveness: recognising diversity of accomplishments. Studies in Higher Education, 46(7), 1371–1382. https://doi.org/10.1080/03075079.2019.1689385
Ketterlin-Geller, L. R., Johnstone, C. J., & Thurlow, M. L. (2015). Universal Design of Assessment. In S. Burgstahler & R. Cory (Eds.), Universal Design in Higher Education: From Principles to Practice (2nd ed.), 163–175. Harvard Education Press.
Kift, S. (2009). Articulating a transition pedagogy to scaffold and to enhance the first year student learning experience in Australian higher education Final Report for ALTC Senior Fellowship Program. https://transitionpedagogy.com.au/wp-content/uploads/2014/05/Kift-Sally-ALTC-Senior-Fellowship-Report-Sep-091.pdf
Kilpatrick, S., Johns, S., Barnes, R., Fischer, S., McLennan, D., & Magnussen, K. (2017). Exploring the retention and success of students with disability in Australian higher education. International Journal of Inclusive Education, 21(7), 747–762. https://doi.org/10.1080/13603116.2016.1251980
Kurth, N., & Mellard, D. (2006). Student perceptions of the accommodation process in postsecondary education. Journal of Postsecondary Education and Disability, 19(1), 71–84. http://ahead.org/publications/jped/vol_19
Lawrie, G., Marquis, E., Fuller, E., Newman, T., Qiu, M., Nomikoudis, M., Roelofs, F., & van Dam, L. (2017). Moving towards inclusive learning and teaching: A synthesis of recent literature. Teaching and Learning Inquiry, 5(1), 9–21. https://doi.org/10.20343/teachlearninqu.5.1.3
Leeds Beckett University. (2018). Inclusive Teaching and Assessment Practice: Guidance for staff.
Madriaga, M., Hanson, K., Heaton, C., Kay, H., Newitt, S., & Walker, A. (2010). Confronting similar challenges? disabled and non-disabled students’ learning and assessment experiences. Studies in Higher Education, 35(6), 647–658. https://doi.org/10.1080/03075070903222633
McKinney, E. L., & Swartz, L. (2020). Integration into higher education: experiences of disabled students in South Africa. Studies in Higher Education, 47(2), 367-377. https://doi.org/10.1080/03075079.2020.1750581
Morris, C., Milton, E., & Goldstone, R. (2019). Case study: suggesting choice: inclusive assessment processes. Higher Education Pedagogies, 4(1), 435–447. https://doi.org/10.1080/23752696.2019.1669479
Naylor, R., & Mifsud, N. (2019). Structural inequality in higher education: Creating institutional cultures that enable all students. https://www.ncsehe.edu.au/wp-content/uploads/2019/09/NaylorMifsud-FINAL.pdf
Nieminen, J. H. (2022). Assessment for Inclusion: rethinking inclusive assessment in higher education. Teaching in Higher Education, 1–19. https://doi.org/10.1080/13562517.2021.2021395
O’Shea, S., Lysaght, P., Roberts, J., & Harwood, V. (2016). Shifting the blame in higher education – social inclusion and deficit discourses. Higher Education Research and Development, 35(2), 322–336. https://doi.org/10.1080/07294360.2015.1087388
Oliver, B. (2015). Redefining graduate employability and work-integrated learning: Proposals for effective higher education in disrupted economies. Journal of Teaching and Learning for Graduate Employability, 6(1), 56–65. https://doi.org/10.21153/jtlge2015vol6no1art573
Oliver, B., & Jorre de St Jorre, T. (2018). Graduate attributes for 2020 and beyond: recommendations for Australian higher education providers. Higher Education Research and Development, 37(4), 821–836. https://doi.org/10.1080/07294360.2018.1446415
Quality Indicators for Learning and Teaching (QILT). (2021). 2021 Graduate Outcomes Survey [Report]. https://www.qilt.edu.au/resources?survey=GOS&type=Reports&year=2021
Ryan, J. (2005). ‘Uni is a serious thing, why are you here if you’ve got learning difficulties?’: Access and exclusion in higher education. Melbourne Studies in Education, 46(1), 45–62. https://doi.org/10.1080/17508480509556415
Schuwirth, L. W. T., & Van der Vleuten, C. P. M. (2011). Programmatic assessment: From assessment of learning to assessment for learning. Medical Teacher, 33(6), 478–485. https://doi.org/10.3109/0142159X.2011.565828
Smith, J., & Firth, J. (2011). Qualitative data analysis: the framework approach. Nurse Researcher, 18(2), 52–62. https://doi.org/10.7748/nr2011.01.18.2.52.c8284
Sridharan, B., Tai, J., & Boud, D. (2019). Does the use of summative peer assessment in collaborative group work inhibit good judgement? Higher Education, 77(5), 853–870. https://doi.org/10.1007/s10734-018-0305-7
Stentiford, L., & Koutsouris, G. (2021). What are inclusive pedagogies in higher education? A systematic scoping review. Studies in Higher Education, 46(11), 2245–2261. https://doi.org/10.1080/03075079.2020.1716322
Tai, J., Ajjawi, R., Bearman, M., Boud, D., Dawson, P., & Jorre de St Jorre, T. (2023). Assessment for inclusion: rethinking contemporary strategies in assessment design. Higher Education Research & Development, 42(2), 483–497. https://doi.org/10.1080/07294360.2022.2057451
Tai, J., Ajjawi, R., Boud, D., Dawson, P., & Panadero, E. (2018). Developing evaluative judgement: enabling students to make decisions about the quality of work. Higher Education, 76(3), 467–481. https://doi.org/10.1007/s10734-017-0220-3
Tai, J., Ajjawi, R., & Umarova, A. (2021). How do students experience inclusive assessment? A critical review of contemporary literature. International Journal of Inclusive Education, 1–18. https://doi.org/10.1080/13603116.2021.2011441
Tai, J., Dollinger, M., Ajjawi, R., Jorre de St Jorre, T., Krattli, S., McCarthy, D., & Prezioso, D. (2023). Designing assessment for inclusion: an exploration of diverse students’ assessment experiences. Assessment & Evaluation in Higher Education, 48(3), 403–417. https://doi.org/10.1080/02602938.2022.2082373
The Quality Assurance Agency for Higher Education. (n.d.). UK Quality Code for Higher Education 2013-18. https://web.archive.org/web/20190704105053/https://www.qaa.ac.uk/quality-code/UK-Quality-Code-for-Higher-Education-2013-18
Tufts. (n.d.). What are inclusive assessment practices? https://provost.tufts.edu/celt/inclusive-and-equitable-teaching/what-is-inclusive-and-equitable-teaching/what-are-equitable-assessment-practices/
University of New South Wales. (2011). Assessing Inclusively. http://teaching.unsw.edu.au/assessment-toolkit
University of Plymouth. (2016). Inclusive assessment good practice guide. University of Plymouth. https://www.plymouth.ac.uk/rails/active_storage/blobs/proxy/eyJfcmFpbHMiOnsibWVzc2FnZSI6IkJBaHBBb1ZSIiwiZXhwIjpudWxsLCJwdXIiOiJibG9iX2lkIn19--41e9a2ea4e69be7cd949ffaaf5b7b377e4c64770/Good_practice_inclusive_assessment_updated_May_2016.pdf
Waterfield, J., & West, B. (2006). Inclusive Assessment in Higher Education: A Resource for Change. University of Plymouth. https://www.plymouth.ac.uk/uploads/production/document/path/3/3026/Space_toolkit.pdf
Downloads
Published
Issue
Section
License
Copyright (c) 2023 Joanna Tai
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
How to Cite
