Rasch Analysis for Thinking Levels of Sustainability Thinking Skills Instrument Among Secondary School Students
Abstract
An Instrument of sustainability thinking was developed to measure students’ level towards sustainability thinking. Instrument of Sustainability Thinking Skills (STSI) was developed to measure the level of sustainability thinking towards STEM and non-STEM education among secondary school students. STSI consisted of 51 items measuring the four constructs of curiosity towards sustainability, namely sustainability thinking, green technology in sustainability, sustainable behavior (environmental value) and sustainable behavior (general ecological behavior). A total of 471 form 4 students aged 16 to 17 years enrolled in six urban and non-urban schools in Malaysia, were involved as research sample Rasch Measurement Model was applied to determine the validity and reliability of STSI. The results of the validity analysis found that the polarity of the items through the PTMEA-CORR values showed that all 51 items were >0.00 (+). Through item fit analysis, all items were retained because items meet the requirements of the range in MNSQ outfit, ZSTD outfit and PTMEA-CORR. Results also showed that STSI has an excellent item reliability and moderate high item separation value of 0.99 and 7.53 respectively. STSI also has a high person reliability and person separation value of 0.98 and 5.72 respectively. In conclusion, STSI has good validity and high reliability in measuring curiosity towards STEM Education among form 4 students in secondary schools.
Downloads
References
Axon, S., & James, D. (2018). The UN Sustainable Development Goals: How can sustainable chemistry contribute? A view from the chemical industry. Current Opinion in Green and Sustainable Chemistry, 13, 140–145.
Anastas, P. T., & Zimmerman, J. B. (2018). The United Nations sustainability goals: How can sustainable chemistry contribute? Current Opinion in Green and Sustainable Chemistry, 13, 150–153.
Aziz, A.A., Masodi, M.S., & Zaharim, A. (2015). Rasch measurement model basis: Scale development and measurement structure (3rd ed.). UKM Press.
Azrilah, A. A., Mohd Saidfudin, M., & Azami, Z. (2015). Asas model pengukuran Rasch: Pembentukan skala & struktur pengukuran. In Penerbit UKM.
Avvisati, F., Echazarra, A., Givord, P., & Schwabe, M. (2018). Programme for International Student Assessment (PISA) - Results from PISA 2018 (pp. 1–10). https://www.oecd.org/pisa/publications/PISA2018_CN_BRN.pdf
Balsamo, M., Giampaglia, G., & Saggino, A. (2014). Building a new Rasch-based self-report inventory of depression. Neuropsychiatric Disease and Treatment, 10,153-165. https://doi.org/10.2147/ndt.s53425
Baumgarten, E. (2001). Curiosity as a moral virtue. International Journal of Applied Philosophy, 15(2), 169–184.
Berlyne, D. E. (1960). Conflict, arousal and curiosity. British Journal of Psychology, 45(3), 180– 191. https://doi.org/10.1037/e417772008-001
Bond, T G, & Fox, C. M. (2007). Applying the Rasch model. Fundamental measurement in the Human science. New Jersey: Lawrence Earlbaum Associates. Inc. Publicers.
Bond, T. G., & Fox, C. M. (2015). Applying the Rasch model : fundamental measurement in the human sciences (3rd ed., Vol. 1). New York: Routledge. https://doi.org/10.1207/S15327574IJT013&4_10
Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch Analysis in the Human Sciences. Springer. https://doi.org/10.1007/978-94-007-6857-4
Bybee, R. W. (2010). Advancing STEM Education: A 2020 vision. Technology and Engineering Teacher, 70(1), 30.
Carley-Baxter, L. R., Hill, C. A., Roe, D. J., Twiddy, S. E., Baxter, R. K., & Ruppenkamp, J. (2009). Does response rate matter? journal editors use of survey quality measures in manuscript publication decisions. Survey Practice, 2(7), 1–7. https://doi.org/10.1021/jp012662w
Committee on STEM Education. (2018). Charting a Course for Success: America’s Strategy for STEM Education. In National Science and Technology Council.
Conrad, K. M., Conrad, K. J., Dennis, M. L., & Funk, R. (2012). Validation of the Self-Help Improvement Scale to the Rasch measurement model GAIN methods report 1.0. Chicago.
Creswell, J. W. (2009). Research design qualitative, quantitative, and mixed methods approach pp. 3rd Edition. United States of America: Sage Publications, Inc.
Creswell, J. W. (2012). Educational research: Planning, conducting, and evaluating quantitative and qualitative research (4th ed.). Pearson Education Inc.
Creswell, J. W., & Creswell, J. D. (2018). Research design: Qualitative, quantitative, and mixed methods approaches (5th ed.). Sage Publications, Inc.
Curriculum Development Division. (2015). Dokumen standard kurikulum dan pentaksiran Sains Tingkatan 1. Putrajaya: Kementerian Pendidikan Malaysia.
Curriculum Development Division. (2016a). Dokumen standard kurikulum dan pentaksiran Sains Tingkatan 4. Putrajaya: Kementerian Pendidikan Malaysia.
Curriculum Development Division. (2016b). Panduan pelaksanaan Sains, Teknologi, Kejuruteraan dan Matematik (STEM) dalam pengajaran dan pembelajaran. Putrajaya: Ministry of Education.
Day, H. Y. (1968). Role of specific curiosity in school achievement. Journal of Educational Psychology, 59(1), 37.
DeVellis, R. (2017). Scale development: theory and applications (4th ed.). SAGE Publications Inc.
DeVon, H. A., Block, M. E., Moyle-Wright, P., Ernst, D. M., Hayden, S. J., Lazzara, D. J., Savoy, S. M., & Kostas-Polston, E. (2007). A psychometric toolbox for testing validity and reliability. Journal of Nursing Scholarship, 39(2), 155–164. https://doi.org/10.1111/j.1547-5069.2007.00161.x
Eakman, A. M. (2012). Measurement characteristics of the engagement in meaningful cctivities survey in an age-diverse sample. American Journal of Occupational Therapy, 66(2), 20–29.
Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Lawrence Erlbaum Associates.
Fisher, J. W. P. (2006). Survey design recommendations. Rasch Measurements Transactions Contents and Archives, 20(3), 1072–1074.
Fisher, J. W. P. (2007). Rating scale instrument quality criteria. Rasch Measurement Transactions, 21(1), 1095.
Fisher, W. (1992). Reliability, separation, strata statistics. Rasch Measurement Transactions, 6, 238.
Foster, K. M., Bergin, K. B., McKenna, A. F., Millard, D. L., Perez, L. C., Prival, J. T., Rainey, D. Y., Sevian, H. M., VanderPutten, E. a, & Hamos, J. E. (2010). Partnerships for STEM education. Science, 329(5994), 906–907.
Fox, C. M., & Jones, J. A. (1998). Uses of Rasch modeling in counseling psychology research. Journal of Counseling Psychology, 45(1), 30–45. https://doi.org/10.1037/0022-0167.45.1.30
Gagné, E. D. (1985). The cognitive psychology of school learning. Boston, MA: Little, Brown and Company.
Garrosa, E., Blanco-Donoso, L. M., Carmona-Cobo, I., & Moreno-Jiménez, B. (2017). How does curiosity, meaning in life, and search for meaning predict college students’ daily emotional exhaustion and engagement? Journal of Happiness Studies, 18(1), 17–40.
Gay, L. R., & Mills, G. E. (2018). Educational research: Competencies for analysis and applications (12th ed.). Merrill Prentice Hall.
Grover, S. & Pea, R. (2013a). Computational thinking in K-12: A review of the state of the field. Educational Researcher, 42(1), 38–43.
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2013). Multivariate Data Analysis. Vectors (7th ed.). Pearson Education Ltd. https://doi.org/10.1016/j.ijpharm.2011.02.019
Hamid, S., Ijab, M. T., Sulaiman, H., Md. Anwar, R., & Norman, A. A. (2017). Social media for environmental sustainability awareness in higher education. In International Journal of Sustainability in Higher Education (Vol. 18, Issue 4, pp. 474–491).
Hinkin, T. R. (1995). A review of scale development practices in the study of organizations. Journal of Management, 21(5), 967–988.
Holme T.A, Hutchison J.E (2018). A central learning outcome for the central science. J Chem Educ, 95:499–501.
Hurst G.A (2013). Green and smart: hydrogels to facilitate independent practical learning. J Chem Educ 94:1766–1771.
Hurst G.A (2015). The rheological properties of poly (vinyl alcohol) gels from rotational viscometry. J Chem Educ, 92:940–945.
Hurst G.A, Ludwig J.K (2017). The sustainability thinking in rheological properties gels from rotational viscometry. J Chem Educ, 92:940–945.
Hurst G. A (2019). The green formula for international chemistry education. In Dicks AP, Bastin L, Eds., Integrating green and sustainable chemistry principles into education. Elsevier: 205–228.
Jin, G., & Bierma, T. (2013). STEM for non-STEM Majors: Enhancing Science Literacy in Large Classes. Journal of College Science Teaching. https://doi.org/10.2505/4/jcst13_042_06_20
Jonassen, D. (2000). Toward a design theory of problem solving. Educational Technology Research and Development, 48(4), 63–85.
Kashdan, T. B., Rose, P., & Fincham, F. D. (2004). Curiosity and Exploration: Facilitating Positive Subjective Experiences and Personal Growth Opportunities. Journal of Personality Assessment, 82(3), 291–305.
Kashdan, T. B., Gallagher, M. W., Silvia, P. J., Winterstein, B. P., Breen, W. E., Terhar, D., & Steger, M. F. (2009). The curiosity and exploration inventory-II: Development, factor structure, and psychometrics. Journal of Research in Personality, 43(6), 987–998. https://doi.org/10.1016/j.jrp.2009.04.011
Kennedy, T. J., & Odell, M. R. L. (2014). Engaging Students in STEM Education. Science Education International, 25(3), 246–258.
Lai, J. S., & Eton, D. T. (2002). Clinically meaningful gaps. Rasch Measurement Transactions, 15(4), 850.
Linacre, J. M. (1994). Sample size and item calibration (or person measure) stability. Rasch Measurement Transactions, 7(4), 328.
Linacre, J. M. (2002). What do infit and outfit, mean-square and standardized mean? Rasch Measurement Transactions, 16(2), 878.
Linacre, J. M. (2005). Winstep Rasch measurement computer program. MESA Press.
Linacre, J. M. (2005a). A user’s guide to WINSTEPS: Rasch Model Computer Programs. Chicago: MESA Press.
Linacre, J. M. (2010). When to stop removing items and persons in Rasch misfit analysis? Rasch Measurement Transactions, 23(4), 1241.
Linacre, J.M. (2012). A user’s guide to WINSTEPS: Rasch model computer programs. MESA Press.
Linacre, J. M. (2017). Winsteps rasch measurement computer program user’s guide. Winsteps.com.
Linacre, J. M. (2018). A user’s guide to WINSTEPS: Rasch Model Computer Programs.
Loewenstein, G. (1994). The psychology of curiosity: A review and reinterpretation. Psychological Bulletin, 116(1), 75–98. https://doi.org/https://doi.org/10.1037/0033-2909.116.1.75
Ludwig, J. K. (2017). Green Chemistry: An Introductory Text. Green Chemistry Letters and Reviews, 10(1), 30–31.
Ludwig, J.K, Hurst G.A, Orgill M.K (2019). Introduction to systems thinking for the chemistry education community. J Chem Educ, 96:2720–2729.
Mahaffy P.G (2019). Systems thinking for education about the molecular basis of sustain- ability. Nat Sustain 2019, 2:362–370
Matore, M. E. E. M, Zainal, M. A., Noh, M. F. M., Khairani, A. Z., Rahman, N. A., & Idris, H. (2020). Pengujian Psikometrik Item Kecerdasan Menghadapi Cabaran untuk Pelajar Lelaki Kejuruteraan Mekanikal Menggunakan Model Pengukuran Rasch [Psychometric Properties of an Adversity Quotient Items for Mechanical Engineering Male Students using Rasch Measurement Model]. Malaysia Education Journal, 45(1), 87-100. https://doi.org/10.17576/jpen-2020-45.01si-11
Mellahi, K., & Harris, L. C. (2016). Response Rates in business and management research: an overview of current practice and suggestions for future direction. British Journal of Management, 27(2), 426–437. https://doi.org/10.1111/1467-8551.12154
McDonald, C. (2016). STEM Education: A review of the contribution of the disciplines of Science, Technology, Engineering and Mathematics. Science Education International, 27(4), 530–569.
Moeini, S., V. Rasmussen, J., Wirenfelt Klausen, T., & Brorson, S. (2016). Rasch analysis of the Western Ontario Osteoarthritis of the Shoulder index – the Danish version. Patient Related Outcome Measures, Volume 7, 173–181. https://doi.org/10.2147/prom.s87048
National Research Council. (2011). Successful K-12 STEM Education: Identifying Effective Approaches in Science, Technology, Engineering, and Mathematics. National Academies Press.
Nazlinda Abdullah, Shereen Noranee, & Mohd Rahim Khamis. (2017). The Use of Rasch Wright Map in Assessing Conceptual Understanding of Electricity. Pertanika Journal of Social Sciences & Humanities, 25, 81–92.
Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw Hill.
Othman, N., Salleh, S., Hussein, H., & Wahid, H. A. (2014). Assessing construct validity and reliability of competitiveness scale using Rasch model approach. In WEI International Academic Conference Proceedings (pp. 113–120). Indonesia.
Pallant, J. F., & Tennant, A. (2007). An introduction to the Rasch measurement model: An example using the Hospital Anxiety and Depression Scale (HADS). British Journal of Clinical Psychology, 46(1), 1–18. https://doi.org/10.1348/014466506x96931
Raharja, S., Wibhawa, M. R., & Lukas, S. (2018). Mengukur rasa ingin tahu siswa. Polyglot: Jurnal Ilmiah, 14(2), 151. https://doi.org/10.19166/pji.v14i2.832
Reio Jr, T. G., & Petrosko, J. M. (2013). The measurement and conceptualization of curiosity. The Journal of Genetic Psychology: Research and Theory on Human Development, 167(2), 117–135.
Schleicher, A. (2019). PISA (2020). insights and interpretations. In OECD. https://www.oecd.org/pisa/PISA (2020) Insights and Interpretations FINAL PDF.pdf
Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53-55. https://doi.org/10.5116/ijme.4dfb.8dfd
Tseng, K.H., Chang, C.C., Lou, S.J., & Chen, W.P. (2013). Attitudes towards science, technology, engineering, and mathematics (STEM) in a project-based learning (PjBL) environment. International Journal of Technology and Design Education, 23(1), 87– 102.
United Nations. https:// sustainabledevelopment.un.org/sdgs (accessed 23.01.2020).
Wright, B. D., & Master, G. N. (1982). Rating scale analysis. Cesa Press.
Wright, Benjamin D., & Panchapakesan, N. (1969). A Procedure for sample-free item analysis. Educational and psychological measurement. https//doi.org/10.1177/001316446902000102.
Wu, M., & Adams, R. (2007). Applying the Rasch model to psycho-social measurement: A practical approach. Educational Measurement Solutions.
Vaughan, F. (2002). What is spiritual intelligence? Journal of Humanistic Psychology, 42(2), 16–33.
Young, B. J. (2000). Gender differences in student attitudes toward computers. Journal of Research on Computing in Education, 33(2), 204–216.
Zohar, Danah; Marshall, Ian (2000). SQ: Connecting with Our Spiritual Intelligence. New York: Bloomsbury Publishing. ISBN 0-7475-4676-2
Zollman, A. (2012). Learning for STEM literacy: STEM literacy for learning. School Science and Mathematics, 112(1), 12–19. https://doi.org/10.1111/j.1949-8594.2012.00101.x
_[eISSN___2504-8562]_-_Google_Scholar_-_Google_Chrome_30_11_2023_8_56_06_AM.png)
.png)
