The Usability of Training Management System for Teachers’ Professional Development: A Preliminary Study
Abstract
The usability study of the Ministry of Education’s Training Management System (SPLKPM) is a preliminary study conducted by the researcher to determine the rationale and analysis of research needs regarding system usage behaviour among teachers. The purpose of this study is to assess the system's usability in the management of in-service teacher training. SPLKPM serves as a platform that records and stores training data and credit point reporting for all Ministry of Education (MoE) staff members based on 13 activities outlined in continuous professional development credit points (MyPBB). The respondents for this study were in-service teachers who are also regular users of SPLKPM. A total of 32 respondents provided feedback that was randomly distributed through several mediums; emails and mobile messaging apps. The study found that the existing system has a usability score of 45.9, compared to the average of 68, indicating that it requires improvement and that a comprehensive analysis of the factors that influence system use should be done. In conclusion, most teachers believe that the system needs to be improved to facilitate more frequent recording and use.
Downloads
References
Bangor, A., Kortum, P. T., & Miller, J. T. (2008). An Empirical Evaluation of the System Usability Scale. International Journal of Human–Computer Interaction, 24(6), 574–594. https://doi.org/10.1080/10447310802205776
Ab Rahim, S. A., Ghani, M. F. A., Hamid, H. S. A., Samsudin, N., Ismail, Z., & Yusof, M. A. M. (2021). Cabaran pelaksanaan program pembangunan profesionalisme pemimpin guru sekolah berprestasi tinggi. Jurnal Kepimpinan Pendidikan, 8(2), 25–40.
Anderson, E. W., & Fornell, C. (2000). Foundations of the American Customer Satisfaction Index. Total Quality Management, 11(7), 869–882. https://doi.org/10.1080/09544120050135425
Bevan, N., Carter, J., Earthy, J., Geis, T., & Harker, S. (2016). New ISO standards for usability, usability reports, and usability measures. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9731, 268-278. https://doi.org/10.1007/978-3-319-39510-4_25
Brooke, J. (1996). SUS: A 'quick and dirty' usability scale. In P. Jordan, B. Thomas, & B. Weerdmeester (Eds.), Usability evaluation in industry (pp. 189–194). Taylor & Francis.
Brooke, J. (2013). SUS: A Retrospective. Journal of Usability Studies, 8(2), 29–40.
Daradkeh, M. (2019). Determinants of self-service analytics adoption intention: The effect of task-technology fit, compatibility, and user empowerment. Journal of Organizational and End User Computing, 31(4), 19–45. https://doi.org/10.4018/JOEUC.2019100102
Estdale, J., & Georgiadou, E. (2018). Applying the ISO/IEC 25010 Quality Models to Software Product. In Communications in Computer and Information Science (Vol. 896). Springer International Publishing. https://doi.org/10.1007/978-3-319-97925-0_42
Economic Planning Unit (EPU). (2021). National Fourth Industrial Revolution (4IR) Policy. Putrajaya. Economic Planning Unit, Prime Minister’s Department.
Elling, S., Lentz, L., de Jong, M., & van den Bergh, H. (2012). Measuring the quality of governmental websites in a controlled versus an online setting with the “Website Evaluation Questionnaire”. Government Information Quarterly, 29(3), 383–393. https://doi.org/10.1016/j.giq.2011.11.004
Ferreira, J. M., Acuña, S. T., Dieste, O., Vegas, S., Santos, A., Rodríguez, F., & Juristo, N. (2020). Impact of usability mechanisms: An experiment on efficiency, effectiveness, and user satisfaction. Information and Software Technology, 117 (September 2019), 106195. https://doi.org/10.1016/j.infsof.2019.106195
Finstad, K. (2006). The system usability scale and non-native English speakers. Journal of Usability Studies, 1(4), 185–188.
Finstad, K. (2010). The usability metric for user experience. Interacting with Computers, 22(5), 323–327.
Forrester, V. V. (2019). School Management Information Systems: Challenges to Educational Decision Making In The Big Data Era. International Journal on Integrating Technology in Education, 08(01), 01–11. https://doi.org/10.5121/ijite.2019.8101
Gunesekera, A. I., Bao, Y., & Kibelloh, M. (2019). The role of usability on e-learning user interactions and satisfaction: a literature review. Journal of Systems and Information Technology, 21(3), 368–394. https://doi.org/10.1108/JSIT-02-2019-0024
Hassan, W. A. W., Teridi, N. A., Abdullah, K. A., Hamid, A., & Zainuddin, N. M. M. (2010). An assessment study on usability of academic management system. Proceedings - 2010 International Conference on User Science and Engineering, iUSEr 2010, 199–202. https://doi.org/10.1109/IUSER.2010.5716751
Huang, Z., & Benyoucef, M. (2014). Usability and credibility of e-government websites. Government Information Quarterly, 31(4), 584–595. https://doi.org/10.1016/j.giq.2014.07.002
Kementerian Pendidikan Malaysia (MoE). (2014). Pelan Pembangunan Profesionalisme Berterusan. Putrajaya: Kementerian Pendidikan Malaysia.
Kementerian Pendidikan Malaysia (MoE). (2016). Dokumen Awal Pelan Induk Pembangunan Profesionalisme Keguruan. Putrajaya: Kementerian Pendidikan Malaysia.
Kirakowski, J., & Cierlik, B. (1998). Measuring the usability of websites. In Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting (pp. 424–428). Santa Monica, CA: HFES.
Kirakowski, J., & Corbett, M. (1993). SUMI: The software usability measurement inventory. British Journal of Educational Technology, 24, 210–212.
Klug, B. (2017). An Overview of the System Usability Scale in Library Website and System Usability Testing. Weave: Journal of Library User Experience, 1(6), 1–19. https://doi.org/10.3998/weave.12535642.0001.602
Kwok, L. F., & Hui, Y. K. (2017). The Role of e-Portfolio for Smart Life Long Learning. Smart Universities, 327–356. https://doi.org/10.1007/978-3-319-59454-5_11
Lewis, J. R., Utesch, B. S., & Maher, D. E. (2013). UMUX-LITE-When there’s no time for the SUS. In Proceedings of CHI 2013 (pp. 2099–2102). Paris, France: Association for Computing Machinery. http://dx.doi.org/10.1145/2470654.2481287
Lewis, J. R. (2018). The System Usability Scale: Past, Present, and Future, International Journal of Human–Computer Interaction. https://doi.org/10.1080/10447318.2018.1455307
Lewis, J. R., & Sauro, J. (2018). Item Benchmarks for the System Usability Scale. Journal of Usability Studies, 13(3), 158-167.
Lyerla, F., Durbin, C. R., & Henderson, R. (2018). Development of a Nursing Electronic Medical Record Usability Protocol. CIN - Computers Informatics Nursing, 36(8), 393–397. https://doi.org/10.1097/CIN.0000000000000432
Mol, M., van Schaik, A., Dozeman, E., Ruwaard, J., Vis, C., Ebert, D. D., Etzelmueller, A., Mathiasen, K., Moles, B., Mora, T., Pedersen, C. D., Skjøth, M. M., Pensado, L. P., Piera-Jimenez, J., Gokcay, D., Ince, B. Ü., Russi, A., Sacco, Y., Zanalda, E., … Smit, J. H. (2020). Dimensionality of the system usability scale among professionals using internet-based interventions for depression: a confirmatory factor analysis. BMC Psychiatry, 20(1), 218. https://doi.org/10.1186/s12888-020-02627-8
Munaiseche, C. P. C., & Liando, O. E. S. (2016). Evaluation of expert system application based on usability aspects. IOP Conference Series: Materials Science and Engineering, 128(1). https://doi.org/10.1088/1757-899X/128/1/012001
Musti, K. S. (2020). Management Information Systems for Higher Education Institutions: Challenges and opportunities. In Quality management implementation in higher education: Practices, models, and case studies (pp. 110–131). IGI Global.
Muylle, S., Moenaert, R., & Despontin, M. (2004). The conceptualization and empirical validation of web site user satisfaction. Information & management, 41(5), 543-560. https://doi.org/10.1016/S0378-7206(03)00089-2
Nielsen, J. (1992). The usability engineering life cycle. Computer, 25(3), 12-22. https://doi.org/10.1109/2.121503
Nur Leenna Abdul Rahman, Mahani Mokhtar & Dayana Farzeeha Ali (2020). Self-Initiated Professional Development among Malaysian TVET Teachers in Vocational Colleges. International Journal of Psychosocial Rehabilitation, 24(05), 1000–1009. https://doi.org/10.37200/I JPR/V24I5/PR201773
OECD (2014). Indicator D7: How extensive are professional development activities for teachers? In Education at a Glance 2014: OECD Indicators (pp.516-533) OECD Publishing. https://dx.doi.org/10.1787/888933120461OECD
Rahman, M. J. A., Sheng, L. W., Daud, M. Y., & Ensimau, N. K. (2019). The Relationship between Efficiency and Level of Satisfaction on CPD among Teachers. Creative Education, 10(12), 3223–3234. https://doi.org/10.4236/ce.2019.1012246
Razak, R. A, & Yusop, F. D. (2013). Designing framework of electronic continued professional development for teachers (e-CPD). Management and Technology in Knowledge, Service, Tourism and Hospitality, 2013, 55–57. https://doi.org/10.1201/b16700-13
San Jose, D. L. (2017). Evaluating, comparing, and best practice in electronic portfolio system use. Journal of Educational Technology Systems, 45(4), 476–498. https://doi.org/10.1177/0047239516672049
Segaran, M. K., & Hasim, Z. (2021). Self-regulated learning through ePortfolio: A meta-analysis. Malaysian Journal of Learning and Instruction, 18(1), 131-156. https://doi.org/10.32890/mjli2021.18.1.6
Smailes, P. S., Zurmehly, J., Schubert, C., Loversidge, J. M., Sinnott, L. T. (2019). An Electronic Medical Record Training Conversion for Onboarding Inpatient Nurses, CIN: Computers, Informatics, Nursing, 37(8), 405-412. https://doi.org/10.1097/CIN.0000000000000514
Song, B. K. (2021). E-portfolio implementation: Examining learners’ perception of usefulness, self-directed learning process, and value of learning. Australasian Journal of Educational Technology, 37(1), 68–81. https://doi.org/10.14742/ajet.6126
Taat, M. S., & Francis, A. (2020). Factors influencing the students’ acceptance of e-learning at teacher education institute: An exploratory study in Malaysia. International Journal of Higher Education, 9(1), 133–141. https://doi.org/10.5430/ijhe.v9n1p133
UNICEF. (2020). Review Of Education Management Information Systems (EMIS) That Track Individual Student Data Malaysia. Retrieved from https://www.unicef.org/eap/reports/education-management-information-systems-emis-track-individual-student-data-malaysia
Van Schaik, P., & Ling, J. (2005). Five psychometric scales for online measurement of the quality of human-computer interaction in web sites. International Journal of Human-Computer Interaction, 18(3), 309-322. https://doi.org/10.1207/s15327590ijhc1803_4
Viitanen, J., Hyppönen, H., Lääveri, T., Vänskä, J., Reponen, J., & Winblad, I. (2011). National questionnaire study on clinical ICT systems proofs: Physicians suffer from poor usability. International Journal of Medical Informatics, 80(10), 708–725. https://doi.org/10.1016/j.ijmedinf.2011.06.010
Wang, L. Y. K., Lew, S. L., Lau, S. H., & Leow, M. C. (2019). Usability factors predicting continuance of intention to use cloud e-learning application. Heliyon, 5(6), e01788. https://doi.org/10.1016/j.heliyon.2019.e01788
Wattearachchi, W. D., Hettiarachchi, E., & Hewagamage, K. P. (2019). Critical success factors of analysing user emotions to improve the usability of systems. Proceedings - 2019 12th International Conference on Ubi-Media Computing, Ubi-Media 2019. https://doi.org/10.1109/Ubi-Media.2019.00026
