Evaluation of the use of Assessment Centre methodology to enhance development planning, work placement outcomes and work readiness for postgraduate students - a pilot

Sophie Melinda Keele; Vanessa L. Sturre; Kathryn von Treuer; Frances Feenstra

doi:10.21153/jtlge2010vol1no1art548

Authors

Sophie Melinda Keele Deakin University, Australia
Vanessa L. Sturre Deakin University, Australia
Kathryn von Treuer Deakin University, Australia
Frances Feenstra People Measures, Australia

DOI:

https://doi.org/10.21153/jtlge2010vol1no1art548

Keywords:

Assessment Centres, Development Centres, work readiness, Work Integrated Learning, work placements, graduate attributes, professional competencies

Abstract

Work placements as a form of Work Integrated Learning are widely recognised for the positive impact they have on improving the employability and work readiness of students. Assessment Centres (ACs) are widely used in corporate settings for recruitment, selection and more recently to provide developmental feedback to participants. The present project aimed to evaluate the application of AC methodology as a tool for measuring and subsequently enhancing professional competencies in a sample of postgraduate students in organisational psychology (n=15). A longitudinal design was utilised with numerous evaluation points from work placement stakeholders. This paper presents the first wave of findings. Students undertook a range of activities, including an in-tray exercise, a role play, a written report and a leaderless group discussion. Comprehensive feedback was provided to the students by Organisational Psychologists who also fulfil the role of placement co-ordinators. With the assistance of the Placement Co-ordinators, students prepared development plans relating to the competencies identified as requiring development. These development plans were to be addressed whilst on consecutive work placements. Performance evaluations collected to date, as measured by behaviourally based ratings scales completed by the students themselves and their organisational supervisors illustrate the positive effect of this methodology. Initial perceptions gathered from students with regards to their participation in this initiative were very encouraging. The ongoing application of AC methodology as a process to enhance development planning, placement outcomes and work readiness for postgraduate students is discussed.

Metrics

Metrics Loading ...

Author Biographies

Sophie Melinda Keele, Deakin University, Australia

Sophie Keele is a lecturer and placement coordinator in the Masters of Industrial and Organisational Psychology program at Deakin University. Prior to assuming this role at Deakin, Sophie was in a similar role at the University of Melbourne. Sophie's academic interests lie in the evaluation of student placements and the contribution they make to student learning, and graduate outcomes.
Vanessa L. Sturre, Deakin University, Australia

School of Psychology, Deakin University.
Kathryn von Treuer, Deakin University, Australia

School of Psychology, Deakin University.
Frances Feenstra, People Measures, Australia

People Measures, South Melbourne.

References

Australian Chamber of Commerce and Industry. (2007). Skills for a Nation: A Blueprint for Improving Education and Training 2007-2017. Canberra: ACCI Retrieved 1 December 2010 from http://www.acci.asn.au/SkillsBlueprintMain.htm

Australian Council of Educational Research (2005). Graduate Skills Assessment. Melbourne, Australia. Retrieved 1 December 2010 from http://www.acer.edu.au/tests/university/gsa/intro.html

Bates, A., Bates, M., & Bates L. (2007). Preparing students for the professional workplace: who has responsibility for what? Asia-Pacific Journal of Cooperative Education, 8(2), 121-129.

Boehm, V.R. (1985). Using assessment centre for management development – Five applications. Journal of Management Development, 4(4), 40-53.

Coll, R.K., Eames, C., Paku, L., Lay, M., Ayling, D., Hodges, D., Ram, S., Bhat, R., Fleming, J., Ferkins, L., Wiersma, C., & Martin, A. (2009). An exploration of the pedagogies employed to integrate knowledge in work-integrated learning in New Zealand higher education institutions. Wellington, New Zealand: Crown.

Crebert, G., Bates, M., Bell, G., Patrick, C., & Cragnolini, V. (2004). Developing generic skills at university, during work placement and in employment: graduates‟ perceptions. Higher Education Research and Development, 23(2), 147-165.

Deakin (2010). Graduate Attributes at Deakin, Higher education courses operational policy, Deakin University. Retrieved March 2010 from http://www.deakin.edu.au/itl/pd/tl-modules/curriculum/grad-attrib/grad-attr02.php

Department of Education, Employment & Workplace Relations (2008). Australian Core Skills Framework, Canberra, ACT: Commonwealth of Australia.

Department of Education, Science & Training (2002). Employability skills for the future. Prepared by the Australian Chamber of Commerce and Industry and the Business Council of Australia for the Department of Education, Science & Training. Canberra, ACT: Commonwealth of Australia.

Department of Education, Science & Training (2005). Administrative information for providers. Canberra, ACT: Commonwealth of Australia.

Department of Education, Science & Training (2007). Graduate Employability Skills. Prepared for the Business, Industry and Higher Education Collaboration Council. Canberra, ACT: Commonwealth of Australia.

Engelbrecht, A.S., & Fisher, A.H. (1995). The Managerial Performance Implications of a Developmental Assessment Center Process. Human Relations, 48(4), 387-404.

Gaugler. B.B., Rosenthal, D.B., Thornton, G.C. III., Bentson, C. (1987). Metaanalyses of assessment centre validity. Journal of Applied Psychology, 72(3), 493-511.

Hardison, C.M., & Sackett, P.R. (2004). Assessment center criterion-related validity: A meta-analytic update. Paper presented at the 19th annual conference of the Society for Industrial and Organizational Psychology, Chicago, IL.

Hermelin, E., Lievens, F., & Roberston, I.T. (2007). The validity of assessment centres for the prediction of supervisory performance. International Journal of Selection and Assessment, 15(4), 405-411.

Howard, A. (1997). A Reassessment of Assessment Centers: Challenges for the 21st Century. Journal of Social Behavior and Personality, 12(1997), 13-52.

Iles, P, Roberston I., & Rout, U. (1989). Assessment-based Development Centres. Journal of Managerial Psychology, 4(3), 11-16.

International Taskforce on Assessment Center Guidelines (2009). Guidelines and ethical considerations for assessment center operations. International Journal of Selection and Assessment, 17(3), 243 – 253.

Joiner, D,A. (1984). Assessment Centres in the public sector: A practical approach. Public Personnel Management Journal, 13(1984), 435-450.

Kadushin, A. (1992). Supervision in Social Work. New York, Columbia University Press.

Kottke, J.L., & Shultz, K.S. (1997). Using an assessment centre as a developmental tool for graduate students: A demonstration. Journal of Social Behavior and Personality, 12, 289-302.

Lance C.E. (2008). Why Assessment Centers Do Not Work the Way They Are Supposed To. Industrial and Organizational Psychology, 1(1), 84-97.

Lefevre, M. (2005). Facilitating practice learning and assessment. The influence of relationship. Social Work Education, 24(5), 565-583.

Lievens, F. (2001). Assessors and use of assessment centre dimensions: a fresh look at a troubling issue. Journal of Organizational Behaviour, 22(2001), 203221.

Lievens, F. (2002) Trying to understand the different pieces of the construct validity puzzle of assessment centers: An examination of assessor and assessee effects. Journal of Applied Psychology, 87(4). 675-686.

Lorenzo, R.V. (1984). Effects of assessorship on managers‟ proficiency in acquiring, evaluating, and communicating information about people. Personnel Psychology, 37(4), 617-634.

Mullin, R, G., Shaffer, P.L., & Grelle, M.J. (1991). A study of the assessment center method of teaching basic management skills. In J.D. Bigelow (Ed)., Managerial skills: Explorations in practical knowledge (pp 116 – 153). Newbury Park, CA: Sage.

Murakami, K., Murray, L., Sims, D. & Chedzey K. (2009). Learning on work placement: The narrative development of social competence. Journal of Adult Development, 16(1), 12-24.

Patrick, C., Peach, D., Pocknee, C., Webb, F., Fletcher, M., & Pretto, G. (2009). The WIL Report: Work Integrated Learning - A national scoping study. Prepared for the Australian Learning and Teaching Council. Brisbane, Qld: Queensland University of Technology.

Renn, K.A., & Jessup-Anger E.R. (2008). Preparing New Professionals: Lessons for Graduate Preparation Programs from the National Study of New Professionals in Student Affairs. Journal of College Student Development, 49(4), 319-335.

Riggio, R.E., Mayes, B.T. & Schleicher, D.J. (2003). Using Assessment Centers Methods for Measuring Undergraduate Business Student Outcomes. Journal of Management Inquiry, 12(1), 68 – 78.

Robertson I.T & Iles, P.A. (1988). Approaches to Managerial Selection. In Cooper, C.L. and Robertson I.T. (Eds.), International Review of Industrial Organisational Psychology, Chichester: John Wiley.

Sagie, A., & Magnezy, R. (1997). Assessor type, number of distinguishable dimension categories and assessment centre construct validity. Journal of Occupational and Organizational Psychology, 70(1997), 103-108.

Schleicher, D.J., Day, D.V., Mayes, B.T., & Riggio, R.E. (2002). A new frame for frame of reference training: Enhancing construct validity of assessment centers. Journal of Applied Psychology, 87(4), 735-746.

SHL Group (2005). OPQ32 Technical Manual. Thames Ditton, England: SHL Group plc.

SHL Group plc (2004). Competency Profiler, Version 4.0, Thames Ditton, England: SHL Group plc.

Smith, M., Brooks, S., Lichtenberg, A., McIlveen, P., Torjul, P.& Tylor, J. (2009). Career Development Learning: Maximising the contribution of work integrated learning to the student experience. Final project report. National Association of Graduate Careers Advisory Services. N.S.W.: University of Wollongong. Careers Central. Academic Services Division.

Thornton, G.C., & Gibbons, A.M., (2009). Validity of assessment centres for personnel selection. Human Resource Management Review, 19(3). 169-187.

Turnage, J.J., & Muchinsky, P.M. (1984). A comparison of the predictive validity of assessment center evaluations versus traditional measures in forecasting supervisory job performance: Interpretive implications of criterion distortion for the assessment paradigm. Journal of Applied Psychology. 69(4), 595-602.

Woodruffe, C., (2000). Development and assessment centres: identifying and developing competence (3rd Edition). London: Human Assets Ltd.