The Usability of Training Management System for Teachers’ Professional Development: A Preliminary Study

  • Noradlina Mohd Faculty of Educational Studies, Universiti Putra Malaysia, 43400, Serdang, Selangor, Malaysia.
  • Masrah Azrifah Azmi Murad Faculty of Computer Science and Information Technology, Universiti Putra Malaysia, 43400, Serdang, Selangor, Malaysia. https://orcid.org/0000-0002-0335-5873
Keywords: System usability, Training management system, Professional development

Abstract

The usability study of the Ministry of Education’s Training Management System (SPLKPM) is a preliminary study conducted by the researcher to determine the rationale and analysis of research needs regarding system usage behaviour among teachers. The purpose of this study is to assess the system's usability in the management of in-service teacher training. SPLKPM serves as a platform that records and stores training data and credit point reporting for all Ministry of Education (MoE) staff members based on 13 activities outlined in continuous professional development credit points (MyPBB). The respondents for this study were in-service teachers who are also regular users of SPLKPM. A total of 32 respondents provided feedback that was randomly distributed through several mediums; emails and mobile messaging apps. The study found that the existing system has a usability score of 45.9, compared to the average of 68, indicating that it requires improvement and that a comprehensive analysis of the factors that influence system use should be done. In conclusion, most teachers believe that the system needs to be improved to facilitate more frequent recording and use.

Downloads

Download data is not yet available.

References

Bangor, A., Kortum, P. T., & Miller, J. T. (2008). An Empirical Evaluation of the System Usability Scale. International Journal of Human–Computer Interaction, 24(6), 574–594. https://doi.org/10.1080/10447310802205776

Ab Rahim, S. A., Ghani, M. F. A., Hamid, H. S. A., Samsudin, N., Ismail, Z., & Yusof, M. A. M. (2021). Cabaran pelaksanaan program pembangunan profesionalisme pemimpin guru sekolah berprestasi tinggi. Jurnal Kepimpinan Pendidikan, 8(2), 25–40.

Anderson, E. W., & Fornell, C. (2000). Foundations of the American Customer Satisfaction Index. Total Quality Management, 11(7), 869–882. https://doi.org/10.1080/09544120050135425

Bevan, N., Carter, J., Earthy, J., Geis, T., & Harker, S. (2016). New ISO standards for usability, usability reports, and usability measures. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9731, 268-278. https://doi.org/10.1007/978-3-319-39510-4_25

Brooke, J. (1996). SUS: A 'quick and dirty' usability scale. In P. Jordan, B. Thomas, & B. Weerdmeester (Eds.), Usability evaluation in industry (pp. 189–194). Taylor & Francis.

Brooke, J. (2013). SUS: A Retrospective. Journal of Usability Studies, 8(2), 29–40.

Daradkeh, M. (2019). Determinants of self-service analytics adoption intention: The effect of task-technology fit, compatibility, and user empowerment. Journal of Organizational and End User Computing, 31(4), 19–45. https://doi.org/10.4018/JOEUC.2019100102

Estdale, J., & Georgiadou, E. (2018). Applying the ISO/IEC 25010 Quality Models to Software Product. In Communications in Computer and Information Science (Vol. 896). Springer International Publishing. https://doi.org/10.1007/978-3-319-97925-0_42

Economic Planning Unit (EPU). (2021). National Fourth Industrial Revolution (4IR) Policy. Putrajaya. Economic Planning Unit, Prime Minister’s Department.

Elling, S., Lentz, L., de Jong, M., & van den Bergh, H. (2012). Measuring the quality of governmental websites in a controlled versus an online setting with the “Website Evaluation Questionnaire”. Government Information Quarterly, 29(3), 383–393. https://doi.org/10.1016/j.giq.2011.11.004

Ferreira, J. M., Acuña, S. T., Dieste, O., Vegas, S., Santos, A., Rodríguez, F., & Juristo, N. (2020). Impact of usability mechanisms: An experiment on efficiency, effectiveness, and user satisfaction. Information and Software Technology, 117 (September 2019), 106195. https://doi.org/10.1016/j.infsof.2019.106195

Finstad, K. (2006). The system usability scale and non-native English speakers. Journal of Usability Studies, 1(4), 185–188.

Finstad, K. (2010). The usability metric for user experience. Interacting with Computers, 22(5), 323–327.

Forrester, V. V. (2019). School Management Information Systems: Challenges to Educational Decision Making In The Big Data Era. International Journal on Integrating Technology in Education, 08(01), 01–11. https://doi.org/10.5121/ijite.2019.8101

Gunesekera, A. I., Bao, Y., & Kibelloh, M. (2019). The role of usability on e-learning user interactions and satisfaction: a literature review. Journal of Systems and Information Technology, 21(3), 368–394. https://doi.org/10.1108/JSIT-02-2019-0024

‌Hassan, W. A. W., Teridi, N. A., Abdullah, K. A., Hamid, A., & Zainuddin, N. M. M. (2010). An assessment study on usability of academic management system. Proceedings - 2010 International Conference on User Science and Engineering, iUSEr 2010, 199–202. https://doi.org/10.1109/IUSER.2010.5716751

Huang, Z., & Benyoucef, M. (2014). Usability and credibility of e-government websites. Government Information Quarterly, 31(4), 584–595. https://doi.org/10.1016/j.giq.2014.07.002

Kementerian Pendidikan Malaysia (MoE). (2014). Pelan Pembangunan Profesionalisme Berterusan. Putrajaya: Kementerian Pendidikan Malaysia.

Kementerian Pendidikan Malaysia (MoE). (2016). Dokumen Awal Pelan Induk Pembangunan Profesionalisme Keguruan. Putrajaya: Kementerian Pendidikan Malaysia.

Kirakowski, J., & Cierlik, B. (1998). Measuring the usability of websites. In Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting (pp. 424–428). Santa Monica, CA: HFES.

Kirakowski, J., & Corbett, M. (1993). SUMI: The software usability measurement inventory. British Journal of Educational Technology, 24, 210–212.

Klug, B. (2017). An Overview of the System Usability Scale in Library Website and System Usability Testing. Weave: Journal of Library User Experience, 1(6), 1–19. https://doi.org/10.3998/weave.12535642.0001.602

Kwok, L. F., & Hui, Y. K. (2017). The Role of e-Portfolio for Smart Life Long Learning. Smart Universities, 327–356. https://doi.org/10.1007/978-3-319-59454-5_11

Lewis, J. R., Utesch, B. S., & Maher, D. E. (2013). UMUX-LITE-When there’s no time for the SUS. In Proceedings of CHI 2013 (pp. 2099–2102). Paris, France: Association for Computing Machinery. http://dx.doi.org/10.1145/2470654.2481287

Lewis, J. R. (2018). The System Usability Scale: Past, Present, and Future, International Journal of Human–Computer Interaction. https://doi.org/10.1080/10447318.2018.1455307

Lewis, J. R., & Sauro, J. (2018). Item Benchmarks for the System Usability Scale. Journal of Usability Studies, 13(3), 158-167.

Lyerla, F., Durbin, C. R., & Henderson, R. (2018). Development of a Nursing Electronic Medical Record Usability Protocol. CIN - Computers Informatics Nursing, 36(8), 393–397. https://doi.org/10.1097/CIN.0000000000000432

Mol, M., van Schaik, A., Dozeman, E., Ruwaard, J., Vis, C., Ebert, D. D., Etzelmueller, A., Mathiasen, K., Moles, B., Mora, T., Pedersen, C. D., Skjøth, M. M., Pensado, L. P., Piera-Jimenez, J., Gokcay, D., Ince, B. Ü., Russi, A., Sacco, Y., Zanalda, E., … Smit, J. H. (2020). Dimensionality of the system usability scale among professionals using internet-based interventions for depression: a confirmatory factor analysis. BMC Psychiatry, 20(1), 218. https://doi.org/10.1186/s12888-020-02627-8

Munaiseche, C. P. C., & Liando, O. E. S. (2016). Evaluation of expert system application based on usability aspects. IOP Conference Series: Materials Science and Engineering, 128(1). https://doi.org/10.1088/1757-899X/128/1/012001

Musti, K. S. (2020). Management Information Systems for Higher Education Institutions: Challenges and opportunities. In Quality management implementation in higher education: Practices, models, and case studies (pp. 110–131). IGI Global.

Muylle, S., Moenaert, R., & Despontin, M. (2004). The conceptualization and empirical validation of web site user satisfaction. Information & management, 41(5), 543-560. https://doi.org/10.1016/S0378-7206(03)00089-2

Nielsen, J. (1992). The usability engineering life cycle. Computer, 25(3), 12-22. https://doi.org/10.1109/2.121503

Nur Leenna Abdul Rahman, Mahani Mokhtar & Dayana Farzeeha Ali (2020). Self-Initiated Professional Development among Malaysian TVET Teachers in Vocational Colleges. International Journal of Psychosocial Rehabilitation, 24(05), 1000–1009. https://doi.org/10.37200/I JPR/V24I5/PR201773

OECD (2014). Indicator D7: How extensive are professional development activities for teachers? In Education at a Glance 2014: OECD Indicators (pp.516-533) OECD Publishing. https://dx.doi.org/10.1787/888933120461OECD

Rahman, M. J. A., Sheng, L. W., Daud, M. Y., & Ensimau, N. K. (2019). The Relationship between Efficiency and Level of Satisfaction on CPD among Teachers. Creative Education, 10(12), 3223–3234. https://doi.org/10.4236/ce.2019.1012246

Razak, R. A, & Yusop, F. D. (2013). Designing framework of electronic continued professional development for teachers (e-CPD). Management and Technology in Knowledge, Service, Tourism and Hospitality, 2013, 55–57. https://doi.org/10.1201/b16700-13

San Jose, D. L. (2017). Evaluating, comparing, and best practice in electronic portfolio system use. Journal of Educational Technology Systems, 45(4), 476–498. https://doi.org/10.1177/0047239516672049

Segaran, M. K., & Hasim, Z. (2021). Self-regulated learning through ePortfolio: A meta-analysis. Malaysian Journal of Learning and Instruction, 18(1), 131-156. https://doi.org/10.32890/mjli2021.18.1.6

Smailes, P. S., Zurmehly, J., Schubert, C., Loversidge, J. M., Sinnott, L. T. (2019). An Electronic Medical Record Training Conversion for Onboarding Inpatient Nurses, CIN: Computers, Informatics, Nursing, 37(8), 405-412. https://doi.org/10.1097/CIN.0000000000000514

Song, B. K. (2021). E-portfolio implementation: Examining learners’ perception of usefulness, self-directed learning process, and value of learning. Australasian Journal of Educational Technology, 37(1), 68–81. https://doi.org/10.14742/ajet.6126

Taat, M. S., & Francis, A. (2020). Factors influencing the students’ acceptance of e-learning at teacher education institute: An exploratory study in Malaysia. International Journal of Higher Education, 9(1), 133–141. https://doi.org/10.5430/ijhe.v9n1p133

UNICEF. (2020). Review Of Education Management Information Systems (EMIS) That Track Individual Student Data Malaysia. Retrieved from https://www.unicef.org/eap/reports/education-management-information-systems-emis-track-individual-student-data-malaysia

Van Schaik, P., & Ling, J. (2005). Five psychometric scales for online measurement of the quality of human-computer interaction in web sites. International Journal of Human-Computer Interaction, 18(3), 309-322. https://doi.org/10.1207/s15327590ijhc1803_4

Viitanen, J., Hyppönen, H., Lääveri, T., Vänskä, J., Reponen, J., & Winblad, I. (2011). National questionnaire study on clinical ICT systems proofs: Physicians suffer from poor usability. International Journal of Medical Informatics, 80(10), 708–725. https://doi.org/10.1016/j.ijmedinf.2011.06.010

Wang, L. Y. K., Lew, S. L., Lau, S. H., & Leow, M. C. (2019). Usability factors predicting continuance of intention to use cloud e-learning application. Heliyon, 5(6), e01788. https://doi.org/10.1016/j.heliyon.2019.e01788

Wattearachchi, W. D., Hettiarachchi, E., & Hewagamage, K. P. (2019). Critical success factors of analysing user emotions to improve the usability of systems. Proceedings - 2019 12th International Conference on Ubi-Media Computing, Ubi-Media 2019. https://doi.org/10.1109/Ubi-Media.2019.00026

Published
2022-05-17
How to Cite
Mohd, N. and Azmi Murad, M. A. (2022) “The Usability of Training Management System for Teachers’ Professional Development: A Preliminary Study”, Malaysian Journal of Social Sciences and Humanities (MJSSH), 7(5), p. e001503. doi: 10.47405/mjssh.v7i5.1503.
Section
Articles