Top

Learning Environments Research

Published in:

21-11-2022

Socio-educational environment questionnaire: factor validity and measurement invariance in a longitudinal study of high school students

Authors: Julie Goulet, Julien Morizot

Published in: Learning Environments Research | Issue 2/2023

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

School climate is an essential ingredient of student well-being and academic success. Although it has been studied extensively, only a few well-validated instruments are available for the assessment of school climate. The aim of this study was to assess the factor validity and measurement invariance of the Socio-educational Environment Questionnaire (SEQ) using data from a longitudinal cohort of 1036 French-Canadian high school students who were assessed on three occasions. Exploratory structural equation modeling was used to empirically test the factor structure and measurement invariance across time and gender. The results supported the proposed SEQ five-factor model (teacher–student relationship, student relationships, justice climate, academic climate, and safety climate) and its longitudinal invariance across high school years. Gender invariance was also established. Finally, predictive validity was assessed. Among the five school climate dimensions, teacher–student relationships, academic and safety climate were related to subsequent school engagement. School climate was not associated with either boys’ or girls’ academic achievement. Overall, this study suggests that the SEQ is a valid and reliable short tool for the assessment of school climate in high school.

previous article Course characteristics influencing students’ oral participation in higher education

next article Tracing teachers’ perceptions of entanglement of digitally-mediated educational activities and learning environments: a practice-oriented method

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Available only for authorised users

Aldridge, J. M., & Fraser, B. J. (2016). Teachers’ views of their school climate and its relationship with teacher self-efficacy and job satisfaction. Learning Environments Research, 19(2), 291–307. https://doi.org/10.1007/s10984-015-9198-xCrossRef

Aldridge, J. M., & McChesney, K. (2018). The relationships between school climate and adolescent mental health and wellbeing: A systematic literature review. International Journal of Educational Research, 88, 121–145. https://doi.org/10.1016/j.ijer.2018.01.012CrossRef

Aldridge, J. M., McChesney, K., & Afari, E. (2020). Associations between school climate and student life satisfaction: Resilience and bullying as mediating factors. Learning Environments Research, 23(1), 129–150. https://doi.org/10.1007/s10984-019-09296-9CrossRef

Archambault, I., Pascal, S., Tardif-Grenier, K., Dupéré, V., Janosz, M., Parent, S., & Pagani, L. S. (2020). The contribution of teacher structure, involvement, and autonomy support on student engagement in low-income elementary schools. Teachers and Teaching, 26(5–6), 428–445. https://doi.org/10.1080/13540602.2020.1863208CrossRef

Asparouhov, T., & Muthén, B. (2010). Computing the strictly positive Satorra-Bentler chi-square test in Mplus. Mplus Web Notes: No. 12. https://www.statmodel.com/examples/webnotes/SB5.pdf

Asparouhov, T., & Muthén, B. (2009). Exploratory structural equation modeling. Structural Equation Modeling: A Multidisciplinary Journal, 16(3), 397–438. https://doi.org/10.1080/10705510903008204CrossRef

Le Blanc, M. (1996). MASPAQ, manuel sur des mesures de l'adaptation sociale et personnelle pour les adolescents Québécois (3e éd) [Handbook on measures of social and personal adjustment for adolescents]. Groupe de recherche sur les adolescents en difficulté, Université de Montréal.

Borofsky, L. A., Kellerman, I., Baucom, B., Oliver, P. H., & Margolin, G. (2013). Community violence exposure and adolescents’ school engagement and academic achievement over time. Psychology of Violence, 3(4), 381–395. https://doi.org/10.1037/a0034121CrossRef

Brookhart, S. M. (2015). Graded achievement, tested achievement, and validity. Educational Assessment, 20(4), 268–296. https://doi.org/10.1080/10627197.2015.1093928CrossRef

Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504. https://doi.org/10.1080/10705510701301834CrossRef

Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5CrossRef

Coelho, V. A., Romão, A. M., Brás, P., Bear, G., & Prioste, A. (2020). Trajectories of students’ school climate dimensions throughout middle school transition: A longitudinal study. Child Indicators Research, 13(1), 175–192. https://doi.org/10.1007/s12187-019-09674-yCrossRef

Cohen, J., McCabe, E. M., Michelli, N. M., & Pickeral, T. (2009). School climate: Research, policy, practice, and teacher education. Teachers College Record, 111(1), 180–213. https://doi.org/10.1177/016146810911100108CrossRef

de Boer, H., Timmermans, A. C., & van der Werf, M. P. C. (2018). The effects of teacher expectation interventions on teachers’ expectations and student achievement: Narrative review and meta-analysis. Educational Research and Evaluation, 24(3–5), 180–200. https://doi.org/10.1080/13803611.2018.1550834CrossRef

Demirtas-Zorbaz, S., Akin-Arikan, C., & Terzi, R. (2021). Does school climate that includes students’ views deliver academic achievement? A multilevel meta-analysis. School Effectiveness and School Improvement, 32(4), 543–563. https://doi.org/10.1080/09243453.2021.1920432CrossRef

Engels, M. C., Colpin, H., Van Leeuwen, K., Bijttebier, P., Den Noortgate, W. V., Claes, S., Goossens, L., & Verschueren, K. (2017). School engagement trajectories in adolescence: The role of peer likeability and popularity. Journal of School Psychology, 64, 61–75. https://doi.org/10.1016/j.jsp.2017.04.006CrossRef

Fatou, N., & Kubiszewski, V. (2018). Are perceived school climate dimensions predictive of students’ engagement? Social Psychology of Education, 21(2), 427–446. https://doi.org/10.1007/s11218-017-9422-xCrossRef

Fraser, B. J., McLure, F. I., & Koul, R. B. (2021). Assessing classroom emotional climate in STEM classrooms: Developing and validating a questionnaire. Learning Environments Research, 24(1), 1–21. https://doi.org/10.1007/s10984-020-09316-zCrossRef

Gálvez-Nieto, J. L., Polanco-Levican, K., & Beltrán-Véliz, J. C. (2021). Psychometric examination of the abbreviated version of the dual school climate and school identification measure-student (SCASIM-ST15) in a sample of Chilean adolescents. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2021.576051CrossRef

Ganzeboom, H. B. G., & Treiman, D. J. (2003). Three internationally standardised measures for comparative research on occupational status. In J. H. P. Hoffmeyer-Zlotnik & C. Wolf (Eds.), Advances in cross-national comparison: A European working book for demographic and socio-economic variables (pp. 159–193). Springer. https://doi.org/10.1007/978-1-4419-9186-7_9CrossRef

Grazia, V., & Molinari, L. (2020). School climate research: Italian adaptation and validation of a multidimensional school climate questionnaire. Journal of Psychoeducational Assessment, 39(3), 286–300. https://doi.org/10.1177/0734282920967141CrossRef

Grazia, V., & Molinari, L. (2021). School climate multidimensionality and measurement: A systematic literature review. Research Papers in Education, 36(5), 561–587. https://doi.org/10.1080/02671522.2019.1697735CrossRef

Hafen, C. A., Allen, J. P., Mikami, A. Y., Gregory, A., Hamre, B., & Pianta, R. C. (2012). The pivotal role of adolescent autonomy in secondary school classrooms. Journal of Youth and Adolescence, 41(3), 245–255. https://doi.org/10.1007/s10964-011-9739-2CrossRef

Hu, L.-T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118CrossRef

Ioverno, S., & Russell, S. T. (2022). School climate perceptions at the intersection of sex, grade, sexual, and gender identity. Journal of Research on Adolescence, 32(1), 325–336. https://doi.org/10.1111/jora.12607CrossRef

Janosz, M., & C. Bouthillier. 2007. Rapport de validation du Questionnaire sur l’Environnement Socioéducatif des écoles secondaires (QES-secondaire) [Validation report of the Socio-Educational Environment Questionnaire of secondary schools (SEQ-secondary)]. Groupe de Recherche sur les Environnements Scolaires.

Jelas, Z. M., Azman, N., Zulnaidi, H., & Ahmad, N. A. (2016). Learning support and academic achievement among Malaysian adolescents: The mediating role of student engagement. Learning Environments Research, 19(2), 221–240. https://doi.org/10.1007/s10984-015-9202-5CrossRef

Johnson, B., & Stevens, J. J. (2001). Exploratory and confirmatory factor analysis of the School Level Environment Questionnaire (SLEQ). Learning Environments Research, 4(3), 325. https://doi.org/10.1023/A:1014486821714CrossRef

Johnson, B., Stevens, J. J., & Zvoch, K. (2007). Teachers’ perceptions of school climate: A validity study of scores from the revised School Level Environment Questionnaire. Educational and Psychological Measurement, 67(5), 833–844. https://doi.org/10.1177/0013164406299102CrossRef

Katz, I., Assor, A., Kanat-Maymon, Y., & Bereby-Meyer, Y. (2006). Interest as a motivational resource: Feedback and gender matter, but interest makes the difference. Social Psychology of Education, 9(1), 27–42. https://doi.org/10.1007/s11218-005-2863-7CrossRef

Kiefer, S. M., Alley, K. M., & Ellerbrock, C. R. (2015). Teacher and peer support for young adolescents’ motivation, engagement, and school belonging. RMLE Online, 38(8), 1–18. https://doi.org/10.1080/19404476.2015.11641184CrossRef

Kline, R. B. (2016). Principles and practice of structural equation modeling (4th ed.). The Guilford Press.

Kohl, D., Recchia, S., & Steffgen, G. (2013). Measuring school climate: An overview of measurement scales. Educational Research, 55(4), 411–426. https://doi.org/10.1080/00131881.2013.844944CrossRef

Konold, T. R., Edwards, K. D., & Cornell, D. G. (2021). Longitudinal measurement invariance of the authoritative school climate survey. Journal of Psychoeducational Assessment, 39(6), 651–664. https://doi.org/10.1177/07342829211011332CrossRef

Koth, C. W., Bradshaw, C. P., & Leaf, P. J. (2008). A multilevel study of predictors of student perceptions of school climate: The effect of classroom-level factors. Journal of Educational Psychology, 100(1), 96–104. https://doi.org/10.1037/0022-0663.100.1.96CrossRef

La Salle, T. P., McCoach, D. B., & Meyers, J. (2021). Examining measurement invariance and perceptions of school climate across gender and race and ethnicity. Journal of Psychoeducational Assessment, 39(7), 800–815. https://doi.org/10.1177/07342829211023717CrossRef

La Salle, T. P., Zabek, F., & Meyers, J. (2016). Elementary student perceptions of school climate and associations with individual and school factors. School Psychology Forum: Research in Practice, 10(1), 55–65.

Lewno-Dumdie, B. M., Mason, B. A., Hajovsky, D. B., & Villeneuve, E. F. (2020). Student-report measures of school climate: A dimensional review. School Mental Health, 12(1), 1–21. https://doi.org/10.1007/s12310-019-09340-2CrossRef

Li, Y., Doyle Lynch, A., Kalvin, C., Jianjun, L., & Lerner, R. M. (2011). Peer relationships as a context for the development of school engagement during early adolescence. International Journal of Behavioral Development, 35(4), 329–342. https://doi.org/10.1177/0165025411402578CrossRef

Lietaert, S., Roorda, D., Laevers, F., Verschueren, K., & De Fraine, B. (2015). The gender gap in student engagement: The role of teachers’ autonomy support, structure, and involvement. British Journal of Educational Psychology, 85(4), 498–518. https://doi.org/10.1111/bjep.12095CrossRef

Lüdtke, O., Robitzsch, A., Trautwein, U., & Kunter, M. (2009). Assessing the impact of learning environments: How to use student ratings of classroom or school characteristics in multilevel modeling. Contemporary Educational Psychology, 34(2), 120–131. https://doi.org/10.1016/j.cedpsych.2008.12.001CrossRef

Marsh, H. W., Hau, K.-T., & Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling: A Multidisciplinary Journal, 11(3), 320–341. https://doi.org/10.1207/s15328007sem1103_2CrossRef

Marsh, H. W., Muthén, B., Asparouhov, T., Lüdtke, O., Robitzsch, A., Morin, A. J. S., & Trautwein, U. (2009). Exploratory structural equation modeling, integrating CFA and EFA: Application to students’ evaluations of university teaching. Structural Equation Modeling: A Multidisciplinary Journal, 16(3), 439–476. https://doi.org/10.1080/10705510903008220CrossRef

Mathys, C., Véronneau, M.-H., & Lecocq, A. (2019). Grade retention at the transition to secondary school: Using propensity score matching to identify consequences on psychosocial adjustment. The Journal of Early Adolescence, 39(1), 97–133. https://doi.org/10.1177/0272431617735651CrossRef

McNeish, D. (2018). Thanks coefficient alpha, we’ll take it from here. Psychological Methods, 23(3), 412–433. https://doi.org/10.1037/met0000144CrossRef

Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58(4), 525–543. https://doi.org/10.1007/BF02294825CrossRef

Molinari, L., & Grazia, V. (2021). Students’ school climate perceptions: Do engagement and burnout matter? Learning Environments Research. https://doi.org/10.1007/s10984-021-09384-9CrossRef

Morin, A. J. S., Marsh, H. W., & Nagengast, B. (2013). Exploratory structural equation modeling. In Hancock, G. R. & Mueller, R. O. (Eds.), Structural equation modeling: A second course (2nd ed., pp. 395–436). Information Age.

Muthén, L. K., & Muthén, B. O. (2017). Mplus user’s guide (8th edn). Muthén & Muthén.

Putnick, D. L., & Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90. https://doi.org/10.1016/j.dr.2016.06.004CrossRef

Quin, D. (2017). Longitudinal and contextual associations between teacher–student relationships and student engagement: A systematic review. Review of Educational Research, 87(2), 345–387. https://doi.org/10.3102/0034654316669434CrossRef

Ramelow, D., Currie, D., & Felder-Puig, R. (2015). The assessment of school climate: Review and appraisal of published student-report measures. Journal of Psychoeducational Assessment, 33(8), 731–743. https://doi.org/10.1177/0734282915584852CrossRef

Reaves, S., McMahon, S. D., Duffy, S. N., & Ruiz, L. (2018). The test of time: A meta-analytic review of the relation between school climate and problem behavior. Aggression and Violent Behavior, 39, 100–108. https://doi.org/10.1016/j.avb.2018.01.006CrossRef

Rentoul, A. J., & Fraser, B. J. (1983). Development of a school-level environment questionnaire. Journal of Educational Administration, 21(1), 21–39. https://doi.org/10.1108/eb009866CrossRef

Rifenbark, G., Lombardi, A., & Freeman, J. (2021). A confirmatory item factor analysis of a school climate measure for adolescents with and without disabilities. Educational Assessment, 26(1), 52–68. https://doi.org/10.1080/10627197.2020.1841625CrossRef

Roorda, D. L., Koomen, H. M. Y., Spilt, J. L., & Oort, F. J. (2011). The influence of affective teacher–student relationships on students’ school engagement and achievement: A meta-analytic approach. Review of Educational Research, 81(4), 493–529.CrossRef

Sangsue, J., & Vorpe, G. (2004). Influences professionnelles et personnelles du climat scolaire chez les enseignants et les élèves [Professional and personal influences on school climate in teachers and pupils]. Psychologie Du Travail Et Des Organisations, 10(4), 341–354. https://doi.org/10.1016/j.pto.2004.10.004CrossRef

Schweig, J. D., & Yuan, K. (2019). Getting better all the time? An illustrative investigation of multilevel longitudinal measurement invariance based on school climate surveys. Educational Measurement: Issues and Practice, 38(3), 65–74. https://doi.org/10.1111/emip.12281CrossRef

Suldo, S. M., McMahan, M. M., Chappel, A. M., & Loker, T. (2012). Relationships between perceived school climate and adolescent mental health across genders. School Mental Health, 4(2), 69–80. https://doi.org/10.1007/s12310-012-9073-1CrossRef

Thapa, A., Cohen, J., Guffey, S., & Higgins-D’ Alessandro, A. (2013). A review of school climate research. Review of Educational Research, 83(3), 357–385. https://doi.org/10.3102/0034654313483907CrossRef

Thijs, J., & Verkuyten, M. (2009). Students’ anticipated situational engagement: The roles of teacher behavior, personal engagement, and gender. The Journal of Genetic Psychology, 170(3), 268–286. https://doi.org/10.1080/00221320903218323CrossRef

Waasdorp, T. E., Lindstrom Johnson, S., Shukla, K. D., & Bradshaw, C. P. (2020). Measuring school climate: Invariance across middle and high school students. Children & Schools, 42(1), 53–62. https://doi.org/10.1093/cs/cdz026CrossRef

Wang, M.-T., & Degol, J. L. (2016). School climate: A review of the construct, measurement, and impact on student outcomes. Educational Psychology Review, 28(2), 315–352. https://doi.org/10.1007/s10648-015-9319-1CrossRef

Wang, M.-T., & Eccles, J. S. (2013). School context, achievement motivation, and academic engagement: A longitudinal study of school engagement using a multidimensional perspective. Learning and Instruction, 28, 12–23. https://doi.org/10.1016/j.learninstruc.2013.04.002CrossRef

Wang, M.-T., & Holcombe, R. (2010). Adolescents’ perceptions of school environment, engagement, and academic achievement in middle school. American Educational Research Journal, 47(3), 633–662. https://doi.org/10.3102/0002831209361209CrossRef

Yang, C., Bear, G. G., Chen, F. F., Zhang, W., Blank, J. C., & Huang, X. (2013). Students’ perceptions of school climate in the U.S. and China. School Psychology Quarterly, 28, 7–24. https://doi.org/10.1037/spq0000002CrossRef

Yang, C., Sharkey, J. D., Reed, L. A., Chen, C., & Dowdy, E. (2018). Bullying victimization and student engagement in elementary, middle, and high schools: Moderating role of school climate. School Psychology Quarterly, 33(1), 54–64. https://doi.org/10.1037/spq0000250CrossRef

You, S., O’Malley, M. D., & Furlong, M. J. (2014). Preliminary development of the Brief-California school climate survey: Dimensionality and measurement invariance across teachers and administrators. School Effectiveness and School Improvement, 25(1), 153–173. https://doi.org/10.1080/09243453.2013.784199CrossRef

Zullig, K. J., Koopman, T. M., Patton, J. M., & Ubbes, V. A. (2010). School climate: Historical review, instrument development, and school assessment. Journal of Psychoeducational Assessment, 28(2), 139–152. https://doi.org/10.1177/0734282909344205CrossRef

Title: Socio-educational environment questionnaire: factor validity and measurement invariance in a longitudinal study of high school students
Authors: Julie Goulet
Julien Morizot
Publication date: 21-11-2022
Publisher: Springer Netherlands
Published in: Learning Environments Research / Issue 2/2023
Print ISSN: 1387-1579
Electronic ISSN: 1573-1855
DOI: https://doi.org/10.1007/s10984-022-09441-x

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Other articles of this Issue 2/2023

Distance learning environment: perspective of Italian primary and secondary teachers during COVID-19 pandemic

Course characteristics influencing students’ oral participation in higher education

A comparison of the university mathematics learning environment with its high school equivalent

Tracing teachers’ perceptions of entanglement of digitally-mediated educational activities and learning environments: a practice-oriented method

Mathematically productive relationships (MPRs): a potentially effective classroom management approach

Physical learning environments’ supportiveness to innovative pedagogies: students’ and teachers’ experiences

Premium Partner