Skip to main content
Top
Published in: Learning Environments Research 1/2022

04-03-2021 | Original Paper

Development and validation of Online Classroom Learning Environment Inventory (OCLEI): The case of Indonesia during the COVID-19 pandemic

Authors: Wardani Rahayu, Muhammad Dwirifqi Kharisma Putra, Faturochman, Meiliasari, Erwin Sulaeman, Rekha B. Koul

Published in: Learning Environments Research | Issue 1/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper reports the development and validation of a new questionnaire to assess students' perceptions of the online learning environment in Indonesia during the COVID-19 pandemic. In total, 669 participants (454 women, 215 men) from various universities were recruited online to complete a 25-item questionnaire. Item factor analysis verified a five-factor model, while multidimensional Rasch analysis showed that all items fit this model and have good reliability. The factors of Access, Interaction, Lecturer Support, Equity, and Investigation formed the valid and reliable Online Classroom Learning Environment Inventory (OCLEI). All aspects of online learning readiness were related to the five factors of the OCLEI, therefore supporting convergent validity. With these results, we concluded that the OCLEI is a novel measure that can be used in future educational research in Indonesia. Limitations and implications are noted.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Adams, R. J., Wilson, M., & Wang, W. (1997). The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement, 21(1), 1–23.CrossRef Adams, R. J., Wilson, M., & Wang, W. (1997). The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement, 21(1), 1–23.CrossRef
go back to reference Aldridge, J. M., Dorman, J. P., & Fraser, B. J. (2004). Use of multitrait-multimethod modelling to validate actual and preferred forms of the technology-rich outcomes-focused learning environment inventory (TROFLEI). Australian Journal of Educational & Developmental Psychology, 4, 110–125. Aldridge, J. M., Dorman, J. P., & Fraser, B. J. (2004). Use of multitrait-multimethod modelling to validate actual and preferred forms of the technology-rich outcomes-focused learning environment inventory (TROFLEI). Australian Journal of Educational & Developmental Psychology, 4, 110–125.
go back to reference Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43(4), 561–573.CrossRef Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43(4), 561–573.CrossRef
go back to reference Cai, L. (2010a). High dimensional exploratory item factor analysis by a Metropolis-Hastings Robbins-Monro algorithm. Psychometrika, 75(1), 33–57.CrossRef Cai, L. (2010a). High dimensional exploratory item factor analysis by a Metropolis-Hastings Robbins-Monro algorithm. Psychometrika, 75(1), 33–57.CrossRef
go back to reference Cai, L. (2010b). Metropolis-Hastings Robbins-Monro algorithm for confirmatory item factor analysis. Journal of Educational and Behavioral Statistics, 35(3), 307–335.CrossRef Cai, L. (2010b). Metropolis-Hastings Robbins-Monro algorithm for confirmatory item factor analysis. Journal of Educational and Behavioral Statistics, 35(3), 307–335.CrossRef
go back to reference Chionh, Y. H., & Fraser, B. J. (2009). Classroom environment, achievement, attitudes and self-esteem in geography and mathematics in Singapore. International Research in Geographical and Environmental Education, 18(1), 29–44.CrossRef Chionh, Y. H., & Fraser, B. J. (2009). Classroom environment, achievement, attitudes and self-esteem in geography and mathematics in Singapore. International Research in Geographical and Environmental Education, 18(1), 29–44.CrossRef
go back to reference Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78(1), 98–104.CrossRef Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78(1), 98–104.CrossRef
go back to reference Darabi, A. A., Sikorski, E. G., & Harvey, R. B. (2006). Validated competencies for distance teaching. Distance Education, 27(1), 105–122.CrossRef Darabi, A. A., Sikorski, E. G., & Harvey, R. B. (2006). Validated competencies for distance teaching. Distance Education, 27(1), 105–122.CrossRef
go back to reference Demian, P., & Morrice, J. (2012). The use of virtual learning environments and their impact on academic performance. Engineering Education, 7(1), 11–19.CrossRef Demian, P., & Morrice, J. (2012). The use of virtual learning environments and their impact on academic performance. Engineering Education, 7(1), 11–19.CrossRef
go back to reference Diki, D. (2013). International collaboration of distance learning universities for online learning in indonesia. LUX: A Journal of Transdisciplinary Writing and Research from Claremont Graduate University, 2(1), 1–8.CrossRef Diki, D. (2013). International collaboration of distance learning universities for online learning in indonesia. LUX: A Journal of Transdisciplinary Writing and Research from Claremont Graduate University, 2(1), 1–8.CrossRef
go back to reference Easton, S. S. (2003). Clarifying the instructor’s role in online distance learning. Communication Education, 52(2), 87–105.CrossRef Easton, S. S. (2003). Clarifying the instructor’s role in online distance learning. Communication Education, 52(2), 87–105.CrossRef
go back to reference Fauth, B., Decristan, J., Decker, A.-T., Buttner, G., Hardy, I., Klieme, E., & Kunter, M. (2019). The effects of teacher competence on student outcomes in elementary science education: The mediating role of teaching quality. Teaching and Teacher Education, 86, Article 102882. Fauth, B., Decristan, J., Decker, A.-T., Buttner, G., Hardy, I., Klieme, E., & Kunter, M. (2019). The effects of teacher competence on student outcomes in elementary science education: The mediating role of teaching quality. Teaching and Teacher Education, 86, Article 102882.
go back to reference Forero, C. G., Maydeu-Olivares, A., & Gallardo-Pujol, D. (2009). Factor analysis with ordinal indicators: A monte carlo study comparing DWLS and ULS estimation. Structural Equation Modeling: A Multidisciplinary Journal, 16(4), 625–641.CrossRef Forero, C. G., Maydeu-Olivares, A., & Gallardo-Pujol, D. (2009). Factor analysis with ordinal indicators: A monte carlo study comparing DWLS and ULS estimation. Structural Equation Modeling: A Multidisciplinary Journal, 16(4), 625–641.CrossRef
go back to reference Fraser, B. J., Fisher, D., & McRobbie, C. (1996, April). Development, validation and use of personal and class forms of a new classroom environment instrument. Paper presented at the annual meeting of the American Educational Research Association, New York Fraser, B. J., Fisher, D., & McRobbie, C. (1996, April). Development, validation and use of personal and class forms of a new classroom environment instrument. Paper presented at the annual meeting of the American Educational Research Association, New York
go back to reference Fulmer, G. W., Chu, H.-E., Treagust, D. F., & Neumann, K. (2015). Is it harder to know or to reason? Analyzing two-tier science assessment items using the Rasch measurement model. Asia-Pacific Science Education, 1(1), 1–16.CrossRef Fulmer, G. W., Chu, H.-E., Treagust, D. F., & Neumann, K. (2015). Is it harder to know or to reason? Analyzing two-tier science assessment items using the Rasch measurement model. Asia-Pacific Science Education, 1(1), 1–16.CrossRef
go back to reference Gregory, M.S.-J., & Lodge, J. M. (2015). Academic workload: The silent barrier to the implementation of technology-enhanced learning strategies in higher education. Distance Education, 36(2), 210–230.CrossRef Gregory, M.S.-J., & Lodge, J. M. (2015). Academic workload: The silent barrier to the implementation of technology-enhanced learning strategies in higher education. Distance Education, 36(2), 210–230.CrossRef
go back to reference Haro, A. V., Noroozi, O., Biemans, H. J. A., & Mulder, M. (2019). The effects of an online learning environment with worked examples and peer feedback on students’ argumentative essay writing and domain-specific knowledge acquisition in the field of biotechnology. Journal of Biological Education, 53(4), 390–398.CrossRef Haro, A. V., Noroozi, O., Biemans, H. J. A., & Mulder, M. (2019). The effects of an online learning environment with worked examples and peer feedback on students’ argumentative essay writing and domain-specific knowledge acquisition in the field of biotechnology. Journal of Biological Education, 53(4), 390–398.CrossRef
go back to reference Harrell-Williams, L. M., & Wolfe, E. W. (2013). The influence of between-dimension correlation, misfit, and test length on multidimensional Rasch model information-based fit index accuracy. Educational and Psychological Measurement, 73(4), 672–689.CrossRef Harrell-Williams, L. M., & Wolfe, E. W. (2013). The influence of between-dimension correlation, misfit, and test length on multidimensional Rasch model information-based fit index accuracy. Educational and Psychological Measurement, 73(4), 672–689.CrossRef
go back to reference Huang, C.-J., Liu, M.-C., Chang, K.-E., Sung, Y.-T., Huang, T.-H., Chen, C.-H., et al. (2010). A learning assistance tool for enhancing ICT literacy of elementary school students. Education Technology & Society, 13(3), 126–138. Huang, C.-J., Liu, M.-C., Chang, K.-E., Sung, Y.-T., Huang, T.-H., Chen, C.-H., et al. (2010). A learning assistance tool for enhancing ICT literacy of elementary school students. Education Technology & Society, 13(3), 126–138.
go back to reference Hung, M.-L., Chou, C., Chen, C.-H., & Own, Z.-Y. (2010). Learner readiness for online learning: scale development and student perceptions. Computers & Education, 55(3), 1080–1090.CrossRef Hung, M.-L., Chou, C., Chen, C.-H., & Own, Z.-Y. (2010). Learner readiness for online learning: scale development and student perceptions. Computers & Education, 55(3), 1080–1090.CrossRef
go back to reference Kelly, P. A., Kallen, M. A., & Suarez-Almazor, M. E. (2007). A combined-method psychometric analysis recommended modification of the multidimensional health locus of control scales. Journal of Clinical Epidemiology, 60(5), 440–447.CrossRef Kelly, P. A., Kallen, M. A., & Suarez-Almazor, M. E. (2007). A combined-method psychometric analysis recommended modification of the multidimensional health locus of control scales. Journal of Clinical Epidemiology, 60(5), 440–447.CrossRef
go back to reference Knekta, E., Runyon, C., & Eddy, S. (2019). One size doesn’t fit all: Using factor analysis to gather validity evidence when using surveys in your research. CBE—Life Sciences Education, 18(1), rm1.CrossRef Knekta, E., Runyon, C., & Eddy, S. (2019). One size doesn’t fit all: Using factor analysis to gather validity evidence when using surveys in your research. CBE—Life Sciences Education, 18(1), rm1.CrossRef
go back to reference Li, L.-Y., & Tsai, C.-C. (2017). Accessing online learning material: Quantitative behavior patterns and their effects on motivation and learning performance. Computers & Education, 114, 286–297.CrossRef Li, L.-Y., & Tsai, C.-C. (2017). Accessing online learning material: Quantitative behavior patterns and their effects on motivation and learning performance. Computers & Education, 114, 286–297.CrossRef
go back to reference Li, B., Kong, S. C., & Chen, G. (2015). Development and validation of the smart classroom inventory. Smart Learning Environments, 2, Article 3. Li, B., Kong, S. C., & Chen, G. (2015). Development and validation of the smart classroom inventory. Smart Learning Environments, 2, Article 3.
go back to reference Li, F., Qi, J., Wang, G., & Wang, X. (2014). Traditional classroom vs e-learning in higher education: Difference between students’ behavioral engagement. International Journal of Emerging Technologies in Learning, 9(2), 48–51.CrossRef Li, F., Qi, J., Wang, G., & Wang, X. (2014). Traditional classroom vs e-learning in higher education: Difference between students’ behavioral engagement. International Journal of Emerging Technologies in Learning, 9(2), 48–51.CrossRef
go back to reference Linacre, J. M. (1999). Investigating rating scale category utility. Journal of Outcome Measurement, 3(2), 103–122. Linacre, J. M. (1999). Investigating rating scale category utility. Journal of Outcome Measurement, 3(2), 103–122.
go back to reference Margianti, E. S. (2002). Learning environment research in Indonesia. In S. C. Goh & M. S. Khine (Eds.), Studies in educational learning environments: An international perspective (pp. 153–167). Singapore: World Scientific.CrossRef Margianti, E. S. (2002). Learning environment research in Indonesia. In S. C. Goh & M. S. Khine (Eds.), Studies in educational learning environments: An international perspective (pp. 153–167). Singapore: World Scientific.CrossRef
go back to reference Marks, R. B., Sibley, S. D., & Arbaugh, J. B. (2005). A structural equation model of predictors for effective online learning. Journal of Management Education, 29(4), 531–563. Marks, R. B., Sibley, S. D., & Arbaugh, J. B. (2005). A structural equation model of predictors for effective online learning. Journal of Management Education, 29(4), 531–563.
go back to reference McPhee, I., & Söderström, T. (2012). Distance, online and campus higher education: Reflections on learning outcomes. Campus-Wide Information Systems, 29(3), 144–155.CrossRef McPhee, I., & Söderström, T. (2012). Distance, online and campus higher education: Reflections on learning outcomes. Campus-Wide Information Systems, 29(3), 144–155.CrossRef
go back to reference Pichardo, M. C., Cano, F., Garzon-Umerenkova, A., de la Fuente, J., Peralta-Sanchez, F. J., & Amate-Romera, J. (2018). Self-regulation questionnaire (SRQ) in Spanish adolescents: factor structure and Rasch analysis. Frontiers in Psychology, 9, Article1370. Pichardo, M. C., Cano, F., Garzon-Umerenkova, A., de la Fuente, J., Peralta-Sanchez, F. J., & Amate-Romera, J. (2018). Self-regulation questionnaire (SRQ) in Spanish adolescents: factor structure and Rasch analysis. Frontiers in Psychology, 9, Article1370.
go back to reference Rahayu, W., Putra, M. D. K., Rahmawati, Y., Hayat, B., & Koul, R. B. (in press.). Validating an Indonesian version of the What Is Happening In this Class? (WIHIC) questionnaire using a multidimensional Rasch model. International Journal of Instruction. Rahayu, W., Putra, M. D. K., Rahmawati, Y., Hayat, B., & Koul, R. B. (in press.). Validating an Indonesian version of the What Is Happening In this Class? (WIHIC) questionnaire using a multidimensional Rasch model. International Journal of Instruction.
go back to reference Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen, Denmark: Danish Institute for Educational Research. Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen, Denmark: Danish Institute for Educational Research.
go back to reference Reimers, F., Schleicher, A., Saavedra, J., & Tuominen, S. (2020). Supporting the continuation of teaching and learning during the Covid-19 pandemic: Annotated resources for online learning. Paris, France: OECD Publishing. Reimers, F., Schleicher, A., Saavedra, J., & Tuominen, S. (2020). Supporting the continuation of teaching and learning during the Covid-19 pandemic: Annotated resources for online learning. Paris, France: OECD Publishing.
go back to reference Rhemtulla, M., Brosseau-Liard, P. E., & Savalei, V. (2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17(3), 354–373.CrossRef Rhemtulla, M., Brosseau-Liard, P. E., & Savalei, V. (2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17(3), 354–373.CrossRef
go back to reference Roddy, C., Amiet, D. L., Chung, J., Holt, C., Shaw, L., McKenzie, S., Garivaldis, F., Lodge, J. M., & Mundy, M. E. (2017). Applying best practice online learning, teaching, and support to intensive online environments: An integrative review. Frontiers in Education, 2, Article 59. Roddy, C., Amiet, D. L., Chung, J., Holt, C., Shaw, L., McKenzie, S., Garivaldis, F., Lodge, J. M., & Mundy, M. E. (2017). Applying best practice online learning, teaching, and support to intensive online environments: An integrative review. Frontiers in Education, 2, Article 59.
go back to reference Shih, C.-L., Chen, C.-H., Sheu, C.-F., Lang, H.-C., & Hsieh, C.-L. (2013). Validating and improving the reliability of the EORTC QLQ-C30 using a multidimensional rasch model. Value in Health, 16(5), 848–854.CrossRef Shih, C.-L., Chen, C.-H., Sheu, C.-F., Lang, H.-C., & Hsieh, C.-L. (2013). Validating and improving the reliability of the EORTC QLQ-C30 using a multidimensional rasch model. Value in Health, 16(5), 848–854.CrossRef
go back to reference Spinner, H., & Fraser, B. J. (2005). Evaluation of an innovative mathematics program in terms of classroom environment, student attitudes, and conceptual development. International Journal of Science and Mathematics Education, 3(2), 267–293.CrossRef Spinner, H., & Fraser, B. J. (2005). Evaluation of an innovative mathematics program in terms of classroom environment, student attitudes, and conceptual development. International Journal of Science and Mathematics Education, 3(2), 267–293.CrossRef
go back to reference Tobin, K., & Fraser, B. (1998). Qualitative and quantitative landscapes of classroom learning environments. In B. J. Fraser & K. G. Tobin (Eds.), The international handbook of science education (pp. 623–640). Dordrecht: Kluwer.CrossRef Tobin, K., & Fraser, B. (1998). Qualitative and quantitative landscapes of classroom learning environments. In B. J. Fraser & K. G. Tobin (Eds.), The international handbook of science education (pp. 623–640). Dordrecht: Kluwer.CrossRef
go back to reference Trinidad, S., Aldridge, J., & Fraser, B. (2005). Development, validation and use of the online learning environment survey. Australasian Journal of Educational Technology, 21(1), 60–81.CrossRef Trinidad, S., Aldridge, J., & Fraser, B. (2005). Development, validation and use of the online learning environment survey. Australasian Journal of Educational Technology, 21(1), 60–81.CrossRef
go back to reference van Seters, J. R., Wellink, J., Tramper, J., Goedhart, M. J., & Ossevoort, M. A. (2012). A web-based adaptive tutor to teach PCR primer design. Biochemistry and Molecural Biology Education, 40(1), 8–13.CrossRef van Seters, J. R., Wellink, J., Tramper, J., Goedhart, M. J., & Ossevoort, M. A. (2012). A web-based adaptive tutor to teach PCR primer design. Biochemistry and Molecural Biology Education, 40(1), 8–13.CrossRef
go back to reference Wang, J., & Wang, X. (2020). Structural equation modeling: Applications using mplus (2nd ed.). Hoboken, NJ: Wiley. Wang, J., & Wang, X. (2020). Structural equation modeling: Applications using mplus (2nd ed.). Hoboken, NJ: Wiley.
go back to reference Wang, W.-C., Chen, P.-H., & Cheng, Y.-Y. (2004). Improving measurement precision of test batteries using multidimensional item response models. Psychological Methods, 9(1), 116–136.CrossRef Wang, W.-C., Chen, P.-H., & Cheng, Y.-Y. (2004). Improving measurement precision of test batteries using multidimensional item response models. Psychological Methods, 9(1), 116–136.CrossRef
go back to reference Wang, W.-C., Yao, G., Tsai, Y.-J., Wang, J.-D., & Hsieh, C.-L. (2006). Validating, improving reliability, and estimating correlation of the four subscales in the WHOQOL-BREF using multidimensional Rasch analysis. Quality of Life Research, 15(4), 607–620.CrossRef Wang, W.-C., Yao, G., Tsai, Y.-J., Wang, J.-D., & Hsieh, C.-L. (2006). Validating, improving reliability, and estimating correlation of the four subscales in the WHOQOL-BREF using multidimensional Rasch analysis. Quality of Life Research, 15(4), 607–620.CrossRef
go back to reference Wei, H.-C., & Chou, C. (2020). Online learning performance and satisfaction: Do perceptions and readiness matter? Distance Education, 41(1), 48–69.CrossRef Wei, H.-C., & Chou, C. (2020). Online learning performance and satisfaction: Do perceptions and readiness matter? Distance Education, 41(1), 48–69.CrossRef
go back to reference Wirth, R. J., & Edwards, M. C. (2007). Item factor analysis: Current approaches and future directions. Psychological Methods, 12(1), 58–79.CrossRef Wirth, R. J., & Edwards, M. C. (2007). Item factor analysis: Current approaches and future directions. Psychological Methods, 12(1), 58–79.CrossRef
go back to reference Wright, R. D. (2015). Student-teacher interaction in online learning environments. Hershey, PA: Information Science Reference.CrossRef Wright, R. D. (2015). Student-teacher interaction in online learning environments. Hershey, PA: Information Science Reference.CrossRef
go back to reference Wright, B. D., & Linacre, J. M. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8(3), 370. Wright, B. D., & Linacre, J. M. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8(3), 370.
go back to reference Yang, J., & Huang, R. (2015). Development and validation of a scale for evaluating technology-rich classroom environment. Journal of Computers in Education, 2(2), 145–162.CrossRef Yang, J., & Huang, R. (2015). Development and validation of a scale for evaluating technology-rich classroom environment. Journal of Computers in Education, 2(2), 145–162.CrossRef
go back to reference Yang, J., Pan, H., Zhou, W., & Huang, R. (2018). Evaluation of smart classroom from the perspective of infusing technology into pedagogy. Smart Learning Environments, 5, Article 20. Yang, J., Pan, H., Zhou, W., & Huang, R. (2018). Evaluation of smart classroom from the perspective of infusing technology into pedagogy. Smart Learning Environments, 5, Article 20.
Metadata
Title
Development and validation of Online Classroom Learning Environment Inventory (OCLEI): The case of Indonesia during the COVID-19 pandemic
Authors
Wardani Rahayu
Muhammad Dwirifqi Kharisma Putra
Faturochman
Meiliasari
Erwin Sulaeman
Rekha B. Koul
Publication date
04-03-2021
Publisher
Springer Netherlands
Published in
Learning Environments Research / Issue 1/2022
Print ISSN: 1387-1579
Electronic ISSN: 1573-1855
DOI
https://doi.org/10.1007/s10984-021-09352-3

Other articles of this Issue 1/2022

Learning Environments Research 1/2022 Go to the issue