How to Cite
Abstract
The systems thinking approach in education requires analytical skills to examine complex problems and systems across multidisciplinary subjects. This approach focuses on how students analyze the components within systems and the interactions between subsystems that shape dynamic behavior. In education, systems thinking can engage multiple disciplines including science, social studies and religious studies. In chemistry education, however, this approach is recommended at the molecular level, reflecting the particulate nature of matter. While there are various systems thinking research reports in chemistry education, assessment tools to analyze the molecular basis of sustainability using this approach remain limited. This paper is aimed to design a chemistry test framework aligned with the systems thinking strands. Accordingly, this paper explains how to develop a construct map and design items, following the cyclical assessment development from Wilson’s four building blocks models. This resulted in a construct map assessment design that follows the four stages of systems thinking—identifying components, understanding their interactions within a dynamic system, calculating the involvement of these components based on the molecular basis of sustainability, and encouraging students’ mechanistic reasoning. According to the item design process, this paper merely reports the results of a pilot project and calculates content validity index using Aiken’s V. Here, we involved two experts, two teachers and 102 students who completed the test draft. The results show that the pattern of students’ answers follows the rubrics, and the test design is good. This study highlights the novel framework and its rubrics, but they need to be extended in the subsequent cycle of constructing measurement.References
Aiken, L. R. (1980). Content validity and reliability of single items or questionnaires. Educational and Psychological Measurement, 40(4), 955–959. https://doi.org/10.1177/001316448004000419
Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131–142. https://doi.org/10.1177/0013164485451012
An, J., Loppnow, G. R., & Holme, T. A. (2021). Measuring the impact of incorporating systems thinking into general chemistry on affective components of student learning. Canadian Journal of Chemistry, 99(8), 698–705. https://doi.org/10.1139/cjc-2020-0218
An Nabil, N. R., Wulandari, I., Yamtinah, S., Ariani, S. R. D., & Ulfa, M. (2022). Analisis Indeks Aiken untuk mengetahui validitas isi instrumen asesmen kompetensi minimum berbasis konteks sains kimia. PAEDAGOGIA, 25(2), 184. https://doi.org/10.20961/paedagogia.v25i2.64566
Arnold, R. D., & Wade, J. P. (2015). A definition of systems thinking: A systems approach. Procedia Computer Science, 44, 669–678. https://doi.org/10.1016/j.procs.2015.03.050
Aubrecht, K. B., Dori, Y. J., Holme, T. A., Lavi, R., Matlin, S. A., Orgill, M., & Skaza-Acosta, H. (2019). Graphical tools for conceptualizing systems thinking in chemistry education. Journal of Chemical Education, 96(12), 2888–2900. https://doi.org/10.1021/acs.jchemed.9b00314
Beck, C. T., & Gable, R. K. (2001). Ensuring content validity: An illustration of the process. Journal of Nursing Measurement, 9(2), 201–215. https://doi.org/10.1891/1061-3749.9.2.201
Bloom, Benjamin S. (1986). Taxonomy of educational objectives. 1: Cognitive domain (29. print). Longman.
Chen, A. Z., Peeks, M. D., & Kyne, S. H. (2025). Design, implementation, and evaluation of authentic learning activities to introduce chemistry students to systems thinking through green chemistry. Journal of Chemical Education, 102(6), 2283–2293. https://doi.org/10.1021/acs.jchemed.4c01326
Creswell, J. W. (2014). Research design: Qualitative, quantitative, and mixed methods approaches (4th ed). SAGE Publications.
Crocker, Linda. (2015). In L. Crocker, International Encyclopedia of the Social & Behavioral Sciences (pp. 774–777). Elsevier. https://doi.org/10.1016/b978-0-08-097086-8.44011-0
Delaney, S., Fehervari, A., Moon, V., & Schultz, M. (2022). Building more sustainably with concrete: A guided inquiry investigation. Journal of Chemical Education, 99(12), 4169–4174. https://doi.org/10.1021/acs.jchemed.2c00344
D’eon, J., & Silverman, J. R. (2023). Using systems thinking to connect green principles and United Nations Sustainable Development Goals in a reaction stoichiometry module. Green Chemistry Letters and Reviews, 16(1), 2185109. https://doi.org/10.1080/17518253.2023.2185109
Eskin, Mehmet. (2013). In M. Eskin, Problem solving therapy in the clinical practice (pp. 17–27). Elsevier. https://doi.org/10.1016/b978-0-12-398455-5.00003-6
Fitriyana, N., Marfuatun, M., & Priyambodo, E. (2019). The profile of students’ analytical thinking skills on chemistry systemic learning approach. Scientiae Educatia, 8(2), 207. https://doi.org/10.24235/sc.educatia.v8i2.5272
Johnstone, A. H. (2000). Teaching of chemistry: Logical or psychological? Chem. Educ. Res. Pract., 1(1), 9–15. https://doi.org/10.1039/A9RP90001B
Jumilah, J., & Wasis, W. (2023). Development of four-tier diagnostic test instrument to introduce misconceptions and identify causes of student misconceptions in the sub-topic of Bernoulli’s principle. Jurnal Penelitian Pendidikan IPA, 9(7), 5773–5781. https://doi.org/10.29303/jppipa.v9i7.4588
MacDonald, R., Elgersma, A., Holme, T., Snyder, J., Reynders, M., & Mahaffy, P. (2025). SOCKit: An online tool for systems thinking. Journal of Chemical Education, acs.jchemed.5c00310. https://doi.org/10.1021/acs.jchemed.5c00310
MacDonald, R. P., Pattison, A. N., Cornell, S. E., Elgersma, A. K., Greidanus, S. N., Visser, S. N., Hoffman, M., & Mahaffy, P. G. (2022). An interactive planetary boundaries systems thinking learning tool to integrate sustainability into the chemistry curriculum. Journal of Chemical Education, 99(10), 3530–3539. https://doi.org/10.1021/acs.jchemed.2c00659
Mahaffy, P. G. (n.d.). Systems thinking in chemistry for sustainability: Toward 2030 and beyond (STCS 2030+). Retrieved https://iupac.org/project/2020-014-3-050/
Mahaffy, P. G., Matlin, S. A., Holme, T. A., & MacKellar, J. (2019). Systems thinking for education about the molecular basis of sustainability. Nature Sustainability, 2(5), 362–370. https://doi.org/10.1038/s41893-019-0285-3
Meadows, D. H. (2008). Thinking in Systems. Earthscan
Mulyani, S., Krismonita, M., & Yamtinah, S. (2022). Analisis butir soal dan kecukupan HOTS soal ujian akhir semester mata pelajaran kimia SMK Kelas X. PAEDAGOGIA, 25(2), 162. https://doi.org/10.20961/paedagogia.v25i2.60913
Orgill, M., York, S., & MacKellar, J. (2019). Introduction to systems thinking for the chemistry education community. Journal of Chemical Education, 96(12), 2720–2729. https://doi.org/10.1021/acs.jchemed.9b00169
Prodjosantoso, Anti Kolonial, Hertina, A. M., Department of Chemistry Education, Yogyakarta State University, Yogyakarta, Indonesia, Irwanto, I., & M.Pd., Department of Chemistry Education, Yogyakarta State University, Yogyakarta, Indonesia. (2019). The misconception diagnosis on ionic and covalent bonds concepts with three tier diagnostic test. International Journal of Instruction, 12(1), 1477–1488. https://doi.org/10.29333/iji.2019.12194a
Resnik, D. B. (2024). The ethics of research with human subjects: Protecting people, advancing science, promoting trust (Vol. 111). Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-82757-0
Reynders, M., Pilcher, L. A., & Potgieter, M. (2023). Teaching and assessing systems thinking in first-year chemistry. Journal of Chemical Education, acs.jchemed.2c00891. https://doi.org/10.1021/acs.jchemed.2c00891
Reynders, M., Pilcher, L., & Potgieter, M. (2025). Development of systems thinking in a large first-year chemistry course using a group activity on detergents. Journal of Chemical Education, 102(4), 1352–1366. https://doi.org/10.1021/acs.jchemed.4c01048
Sarita, M. R., & Wisudawati, A. W. (2024). Enhancing 21st Century Skills in Students with Special Needs Through STEM Learning. JTK (Jurnal Tadris Kimiya), 9(2), 209–219. https://doi.org/10.15575/jtk.v9i2.38883
Schultz, M., Lai, J., Ferguson, J. P., & Delaney, S. (2021). Topics amenable to a systems thinking approach: Secondary and tertiary perspectives. Journal of Chemical Education, 98(10), 3100–3109. https://doi.org/10.1021/acs.jchemed.1c00203
Shekh-Abed, A., & Barakat, N. (2022). Exploring the correlation between systems thinking and soft skills for improved effectiveness of project based learning. 2022 IEEE Frontiers in Education Conference (FIE), 1–4. https://doi.org/10.1109/FIE56618.2022.9962414
Szozda, A. R., Mahaffy, P. G., & Flynn, A. B. (2023). Identifying chemistry students’ baseline systems thinking skills when constructing system maps for a topic on climate change. Journal of Chemical Education, 100(5), 1763–1776. https://doi.org/10.1021/acs.jchemed.2c00955
Talanquer, V., & Szozda, A. R. (2024). An educational framework for teaching chemistry using a systems thinking approach. Journal of Chemical Education, 101(5), 1785–1792. https://doi.org/10.1021/acs.jchemed.4c00216
Wilson, M. (2005). Constructing measures: An item response modeling approach. Lawrence Erlbaum Associates.
Wilson, M. (2023). Constructing measures: An item response modeling approach (2nd ed.). Routledge. https://doi.org/10.4324/9781003286929
Wisudawati, A. W., & Barke, H.-D. (2024). Systems thinking approach to understand Indonesia’s ocean acidification. Sustainable Chemistry and Pharmacy, 37, 101384. https://doi.org/10.1016/j.scp.2023.101384
York, S., Lavi, R., Dori, Y. J., & Orgill, M. K. (2019). Applications of Systems Thinking in STEM Education. Journal of Chemical Education, 96(12), 2742–2751. https://doi.org/10.1021/acs.jchemed.9b00261
York, S., & Orgill, M. (2020). ChEMIST Table: A Tool for Designing or Modifying Instruction for a Systems Thinking Approach in Chemistry Education. Journal of Chemical Education, 97(8), 2114–2129. https://doi.org/10.1021/acs.jchemed.0c00382
Yu, L., Wong, G. K. W., Zhang, B., & Wang, F. (2026). Educational Measurement with Emerging Technologies: A Systematic Review Through Evidentiary Lens on Granularity and Constructing Measures Theory. Education Sciences, 16(4), 661. https://doi.org/10.3390/educsci16040661
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Copyright (c) 2026 Asih Widi Wisudawati, Septy Nur Fadhilah