Towards a Framework for the Assessment and Quality Assurance of Non-Traditional Learning Experiences

Authors

DOI:

https://doi.org/10.38140/obp2-2024-11

Keywords:

Quality assurance, assessment, non-traditional learning experiences, regulatory framework, skills

Abstract

Non-traditional learning experiences have arguably gained momentum and prevalence in the ed­ucation system due to their perceived flexibility, broader outreach, responsiveness, and inclusivity. However, the speed at which these alternative learning experiences have been institutionalised parallels grow­ing concerns and antagonisms regarding their quality. First, the sluggish and rigid response to developing ef­fective frameworks for assessing and quality-assuring non-traditional learning experiences can be counter­productive, stifling innovation and adaptation to new demands. Second, the lack of quality assurance hinders quality improvement, compromising the overall quality of the education system. These limitations have made it difficult for stakeholders to advocate for the uptake and integration of these non-traditional learning expe­riences into the broader education system. In light of these issues, the study employed a mixed-method ap­proach to investigate what assessing and quality-assur­ing non-traditional learning experiences will entail, through the examination of literature and the develop­ment of survey questionnaires for participation from the following quality assurance bodies: Council on Higher Education (CHE), South African Qualifications Authority (SAQA), Council for Quality Assurance in General and Further Edu­cation and Training (UMALUSI), Quality Council for Trades and Occupations (QCTO), and Sector Education and Training Authorities (SETAs) provided valuable insights. The results in­dicated the key design considerations for institutions when developing their respective frame­works for quality assurance and assessment of non-traditional learning experiences. Respond­ents highlighted the importance of prioritising factors such as academic integrity, student infor­mation integrity, equity of access, and quality student experiences. The study's findings are an­ticipated to significantly contribute to the body of knowledge regarding non-traditional learning experiences in South Africa, offering a promising future for these innovative learning methods.

References

Baillie, C., Bowden, J., & Meyer, J. (2013). Threshold capabilities: Threshold concepts and knowledge capability linked through variation theory. Higher Education. 65, 227–246. https://doi.org/10.1007/s10734-012-9540-5

Banson, J. (2022). Co-regulated learning and online learning: A systematic review, Social Sciences & Humanities Open, 6(1). 1–12. https://doi.org/10.1016/j.ssaho.2022.100376.

Bengoetxea, E., Kallioinen, O., Schmidt-Jortzig, I., & Thorn, R. (2011). Quality Assurance in Lifelong Learning. European Association for Quality Assurance in Higher Education (ENQA) Workshop Report 18, 5-28.

Bond, K., Gibbs, B., Harris, G., Lewis, E., Pate, A., Renyard, J., Wint, N. & Wood, G.C. (2023). Literature Reviews: When Quality Assurance Meets Innovation in Higher Education. Working Paper. 3–15.

Broadbent, J., & Poon, W.L. (2015). Self-regulated learning strategies & academic achievement in online higher education learning environments: A systematic review. The Internet and Higher Education, 27, 1–13. https://doi.org/10.1016/j.iheduc.2015.04.007

Butler-Henderson, K., & J. Crawford. (2020). A Systematic Review of Online Examinations: A

Pedagogical Innovation for Scalable Authentication and Integrity. Computers & Education. 159,

–9. https://doi.org/10.1016/j.compedu.2020.104024

Campbell, M., Saltmarsh, S., McPherson, A., & Drew, C. (2013). Issues of teacher professional learning within 'non-traditional' classroom environments. Improving Schools, 16(3), 209–222. https://doi.org/10.1177/1365480213501057

Demir, M. (2021). Alternative Assessment Methods in Primary Education: Review and Future Directions. In Kiray, S.A. & Tomevska-Ilievska, E. (Eds.), Current Studies in Educational Disciplines. (227–272). International Society for Research in Education and Science (ISRES).

Ellis, B. & Herbert, S.I. (2011). Complex adaptive systems (CAS): An overview of key elements, characteristics and application to management theory. Informatics in Primary Care. 19(1), 33-37. https://doi.org/10.14236/jhi.v19i1.791

Foerster, M., Gourdin, A., Huertas, E., Möhren, J., Ranne, P., & Roca, R. (2020). Framework for the Quality Assurance of e-Assessment. Trust based Authentication and Authorship e- E-assessment Analysis (TESLA). 5-21.

Greenhow, C., Graham, C. R., & Koehler, M. J. (2022). Foundations of online learning: Challenges and opportunities. Educational Psychologist, 57(3), 131-147. https://doi.org/10.1080/00461520.2022.2090364

Haleem, A., Javaid, M., Qadri, M.A. & Suman, R. (2022). Understanding the role of digital technologies in education: A review, Sustainable Operations and Computers, 3, 275-285. https://doi.org/10.1016/j.susoc.2022.05.004

Holland, J.H. (1992). Complex Adaptive Systems. American Academy of Arts & Sciences and The MIT Press, 121, 17-30.

Huber, E., Harris, L., Wright, S., White, A., Raduescu, C., Zeivots, S., Cram, A., & Brodzeli, A.

(2024). Towards a framework for designing and evaluating online assessments in business education. Assessment and Evaluation in Higher Education, 49(1), 102–106. https://doi.org/10.1080/02602938.2023.2183487

Jung, I., & Latchem, C. (2007). Assuring quality in Asian open and distance learning, Open Learning: The Journal of Open, Distance and e-Learning, 22, 235-250. https://doi.org/10.1080/02680510701619885

Kuhlmann, S.L., Greene, J.A. & Bernacki, M.L. (2024). Online learning. Reference Module in Neuroscience and Biobehavioral Psychology. 1-8. https://doi.org/10.1016/B978-0-323-96023-6.00089-0

Leadbeater, C., & Wong, A. (2010). Learning from the Extremes: A White Paper.Learning-centred educational experiences in the higher education classroom. International Journal of Instructional Media, 29(1), 69–77. CISCO.

Maddison, T., Doi, C., Lucky, S., & Kumaran, M. (2017). Literature Review of Online Learning in Academic Libraries. In Maddison, T & Kumaran, M. (Eds.), Distributed Learning, (13–46). Chandos Publishing. http://doi.org/10.1016/B978-0-08-100598-9.00002-7

Martirosov, A. L., Alex, J., Doane, A., Patel, R., Aprilliano, B., & Kale-Pradhan, P. (2023). Podcasts and videos and slides… oh my!: Traditional vs. nontraditional teaching methods in remote settings. Currents in Pharmacy Teaching and Learning, 15(6), 587-592. https://doi.org/10.1016/j.cptl.2023.06.007

McLean, S. (2022). Understanding the evolving context for lifelong education: global trends, 1950–2020. International Journal of Lifelong Education, 41(1), 5–26. https://doi.org/10.1080/02601370.2021.2015634

Moore, M. G., & Kearsley, G. (2012). Distance education: A systems view of online learning (3rd Ed.), Wadsworth Publishing Company.

OECD (2024), Bridging Talent Shortages in Tech: Skills-first Hiring, Micro-credentials and Inclusive Outreach, Getting Skills Right, OECD Publishing https://doi.org/10.1787/f35da44f-en

Okada, A., Noguera, I., Alexieva, L., Rozeva, A., Kocdar, S., Brouns, F., Ladonlahti, T., Whitelock, D., & Guerrero?Roldán, A. E. (2019). Pedagogical approaches for e-assessment with authentication and authorship verification in higher education. British Journal of Educational Technology, 50(6), 3264–3282. https://doi.org/10.1111/bjet.12733

Petrides, L. A. (2002). Web-based technologies for distributed (or distance) learning: Creating learning-centred educational experiences in the higher education classroom. International Journal of Instructional Media, 29(1), 69–77.

Preiser, R., Biggs, R., De Vos, A., & Folke, C. (2018). Social-ecological systems as complex adaptive systems: organising principles for advancing research methods and approaches. Ecology and Society, 23(4), 1-15. https://doi.org/10.5751/ES-10558-230446

Scott, C.L. (2015). The Futures of learning 2: What kind of learning for the 21st century? Education, Research and Foresight: Working papers, 14 (UNESCO). 1–14.

Shet, A. (2024). New Horizons in Teaching: A Comparative Review of Online and Traditional Teaching Method. International Journal for Multidisciplinary Research, 6(3), 1–8. https://doi.org/10.36948/ijfmr.2024.v06i03.22785

Snyder, S. (2013). The Simple, the Complicated, and the Complex: Educational Reform Through the Lens of Complexity Theory. OECD Education Working Papers, 6–29. https://doi.org/10.1787/5k3txnpt1lnr-en

UNESCO. (2015). UNESCO and Education 2030: Framework for Action and Sustainability Development goals 4, SDG4. UNESCO.

Timmis, S., Broadfoot, P., Sutherland, R., & Oldfield, A. (2015). Rethinking assessment in a digital age: opportunities, challenges and risks. British Educational Journal. 42(3), 454–476. https://doi.org/10.1002/berj.3215

Tularam, G.A., & Machisella, P. (2018). Traditional vs Non-Traditional Teaching and Learning Strategies -- The Case of E-Learning! International Journal for Mathematics Teaching and Learning, 19 (1), 129-158. https://doi.org/10.4256/ijmtl.v19i1.21

Yang, C. (2019). The Fourth Industrial Revolution, Aging Workers, Older Learners, and Lifelong Learning. Adult Education Research Conference. Conference Proceeding. Buffalo, New York. 1–7.

Published

2024-12-20