Exploring the Construct Validity of Information and Communication Technologies Questionnaire in Indonesia based on PISA 2022 Dataset

Wawan Kurniawan

Abstract


This study investigates the construct validity of Information and Communication Technologies (ICT) questionnaire in Indonesia based on Programme for International Students Assessments (PISA) 2022 (N=13,439). There are nine items that are selected from ICT resources based on the same items from prior dataset in 2018. A confirmatory factor analysis (CFA) was employed to analyze the reliability and validity of ICT resources questionnaire by generating four model-data fit in AMOS. The results showed that 3-factor correlated model provides good model-data fit among other models, in which laptop or notebooks become the most significant devices that are used by Indonesian students. However, three items may be considered invalid to form ICT resources as their factor loadings were less than 0.3. This infers that the implementation of technology at Indonesian school still limited by using laptop in science and mathematics learning. Further study is recommended to analyze the correlation between ICT resources towards science performance in Indonesia context. 

Keywords: ICT, PISA, Science, Indonesia


Full Text:

PDF

References


Agasisti, T., Antequera, G., & Delprato, M. (2023). Technological resources, ICT use and schools efficiency in Latin America – Insights from OECD PISA 2018. International Journal of Educational Development, 99. https://doi.org/10.1016/j.ijedudev.2023.102757

Baydas, O., & Goktas, Y. (2016). Influential factors on preservice teachers’ intentions to use ICT in future lessons. Computers in Human Behavior, 56, 170–178. https://doi.org/10.1016/j.chb.2015.11.030

Bhang, K. J., & Huh, J. R. (2023). Effectiveness of Fine Dust Environmental Education on Students’ Awareness and Attitudes in Korea and Australia Using AR Technology. Sustainability, 15(22), 16039. https://doi.org/10.3390/su152216039

Erdogdu, F. (2022). ICT, learning environment and student characteristics as potential cross-country predictors of academic achievement. Education and Information Technologies, 27(5), 7135–7159. https://doi.org/10.1007/s10639-021-10848-x

Guo, Q., Qiao, C. L., & Ibrahim, B. (2022). The Mechanism of Influence Between ICT and Students’ Science Literacy: a Hierarchical and Structural Equation Modelling Study. Journal of Science Education and Technology, 31(2), 272–288. https://doi.org/10.1007/s10956-021-09954-9

Hair, J. F., Babin, B. J., Anderson, R., & Black, W. C. (2018). Multivariate Data Analysis (pp. 95–120). https://doi.org/10.1002/9781119409137.ch4

Kardipah, S., & Wibawa, B. (2020). A Flipped-Blended Learning Model with Augmented Problem Based Learning to Enhance Students’ Computer Skills. TechTrends, 64(3), 507–513. https://doi.org/10.1007/s11528-020-00506-3

Liong, M., Yeung, D. Y., Cheng, G. H. L., & Cheung, R. Y. H. (2023). Profiles of ICT identity and their associations with female high school students’ intention to study and work in ICT: A mixed-methods approach. Computers and Education, 195. https://doi.org/10.1016/j.compedu.2022.104722

Li, S. C., & Petersen, K. B. (2022). Does ICT Matter? Unfolding the Complex Multilevel Structural Relationship between Technology Use and Academic Achievements in PISA 2015. Technology & Society, 25(4), 43–55. https://doi.org/10.2307/48695980

Agasisti, T., Antequera, G., & Delprato, M. (2023). Technological resources, ICT use and schools efficiency in Latin America – Insights from OECD PISA 2018. International Journal of Educational Development, 99. https://doi.org/10.1016/j.ijedudev.2023.102757

Baydas, O., & Goktas, Y. (2016). Influential factors on preservice teachers’ intentions to use ICT in future lessons. Computers in Human Behavior, 56, 170–178. https://doi.org/10.1016/j.chb.2015.11.030

Bhang, K. J., & Huh, J. R. (2023). Effectiveness of Fine Dust Environmental Education on Students’ Awareness and Attitudes in Korea and Australia Using AR Technology. Sustainability, 15(22), 16039. https://doi.org/10.3390/su152216039

Erdogdu, F. (2022). ICT, learning environment and student characteristics as potential cross-country predictors of academic achievement. Education and Information Technologies, 27(5), 7135–7159. https://doi.org/10.1007/s10639-021-10848-x

Guo, Q., Qiao, C. L., & Ibrahim, B. (2022). The Mechanism of Influence Between ICT and Students’ Science Literacy: a Hierarchical and Structural Equation Modelling Study. Journal of Science Education and Technology, 31(2), 272–288. https://doi.org/10.1007/s10956-021-09954-9

Hair, J. F., Babin, B. J., Anderson, R., & Black, W. C. (2018). Multivariate Data Analysis (pp. 95–120). https://doi.org/10.1002/9781119409137.ch4

Kardipah, S., & Wibawa, B. (2020). A Flipped-Blended Learning Model with Augmented Problem Based Learning to Enhance Students’ Computer Skills. TechTrends, 64(3), 507–513. https://doi.org/10.1007/s11528-020-00506-3

Liong, M., Yeung, D. Y., Cheng, G. H. L., & Cheung, R. Y. H. (2023). Profiles of ICT identity and their associations with female high school students’ intention to study and work in ICT: A mixed-methods approach. Computers and Education, 195. https://doi.org/10.1016/j.compedu.2022.104722

Li, S. C., & Petersen, K. B. (2022). Does ICT Matter? Unfolding the Complex Multilevel Structural Relationship between Technology Use and Academic Achievements in PISA 2015. Technology & Society, 25(4), 43–55. https://doi.org/10.2307/48695980

Martínez-Gautier, D., Garrido-Yserte, R., & Gallo-Rivera, M. T. (2021). Educational performance and ICTs: Availability, use, misuse and context. Journal of Business Research, 135, 173–182. https://doi.org/10.1016/j.jbusres.2021.06.027

OECD. (2016). PISA 2018 Integrated Design.

OECD. (2023). PISA 2022 Assessment and Analytical Framework. OECD Publishing. https://doi.org/10.1787/dfe0bf9c-en

Petko, D., Cantieni, A., & Prasse, D. (2017). Perceived Quality of Educational Technology Matters: A Secondary Analysis of Students ICT Use, ICT-Related Attitudes, and PISA 2012 Test Scores. Journal of Educational Computing Research, 54(8), 1070–1091. https://doi.org/10.1177/0735633116649373

Ukut, I. I. T., & Krairit, D. (2019). Justifying students’ performance: A comparative study of both ICT students’ and instructors’ perspective. Interactive Technology and Smart Education, 16(1), 18–35. https://doi.org/10.1108/ITSE-05-2018-0028

van Leuven, L., Lalouni, M., & Forster, M. (2023). “Will it Work as Well on Zoom?” A Natural Experiment During the Covid-19 Pandemic of Delivering Parenting Groups Via Video Conferencing or in Person. Journal of Child and Family Studies, 32(1), 67–80. https://doi.org/10.1007/s10826-022-02398-8

Wang, Y., & Wang, Y. (2023). Exploring the relationship between educational ICT resources, student engagement, and academic performance: A multilevel structural equation analysis based on PISA 2018 data. Studies in Educational Evaluation, 79. https://doi.org/10.1016/j.stueduc.2023.101308

Yang, T. (2022). ‘I can’t teach without ICT’: unpacking and problematising teachers’ perceptions of the use of ICT in kindergartens in China. Early Years. https://doi.org/10.1080/09575146.2022.2090517

Yosita Ratri, S. (2023). Exploring the Predictors of Indonesian Reading Literacy based on PISA Data.


Refbacks

  • There are currently no refbacks.