Skip to main content

Extending the ILSA Study Design to a Longitudinal Design

TIMSS & PIRLS Extension in the Czech Republic: CLoSE Study

  • Living reference work entry
  • First Online:
International Handbook of Comparative Large-Scale Studies in Education

Abstract

This chapter describes the utilization of a longitudinal extension of the international large-scale assessments (ILSA) TIMSS (Trends In International Mathematics And Science Study) & PIRLS (Progress in International Reading Literacy Study) in the Czech Republic carried out within the Czech Longitudinal Study in Education (CLoSE) with the aim of studying the transition from primary school to the long academic track (called “multi-year gymnasium”). The Czech educational system is characterized by high differentiation, with one of its most controversial elements being a long academic track, which some children transition to after the fifth grade. The process of transition and added value of tracking are therefore important topics for the Czech educational policy. As part of the CLoSE study, the students participating in TIMSS & PIRLS 2011 as fourth-graders were approached again at the end of the fifth grade with a questionnaire exploring their motivation for transition to the long academic track. In grade 6 the TIMSS & PIRLS sample was supplemented by a sample of multiyear gymnasia. Tests in mathematics, reading, Czech grammar, and learning to learn and students’ questionnaires were administered to the students at the beginning of grade 6 and at the end of grade 9. The chapter provides a description of the CLoSE study and its sampling and the instruments used and presents an analysis of the factors affecting a successful transition to the long academic track and an analysis of the effects of tracks on gains in student achievement. The first analysis was carried out on the data from 3679 students who participated in TIMSS 2011 and a questionnaire survey in grade 5 and employed binary logistic regression. The second analysis was carried out on a data set obtained from 5229 students participating in data collections in grades 6 and 9 and employed regression models used on parallel samples created with the propensity score matching (PSM) technique. The results of the first analysis show that the strongest predictor of entering the long academic track is school marks, while the education of parents remains significant even after accounting for school marks and test results. In the second analysis, when prior achievement and student characteristics are accounted for, the long academic track does not show added value in terms of achievement gains in any subject. The chapter closes with a discussion of the benefits and pitfalls of extending the ILSA studies with national follow-up research, and with a discussion of how the results of the CLoSE study may be used in the wider international context.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Similar content being viewed by others

References

  • Alpert, B., & Bechar, S. (2008). School organisational efforts in search for alternatives to ability grouping. Teaching and Teacher Education, 24, 1599–1612.

    Article  Google Scholar 

  • Becker, M., Lüdtke, O., Trautwein, U., Köller, O., & Baumert, J. (2012). The differential effects of school tracking on psychometric intelligence: Do academic-track schools make students smarter? Journal of Educational Psychology, 104(3), 682–699. https://doi.org/10.1037/a0027608

    Article  Google Scholar 

  • Bol, T., & Van de Werfhorst, H. G. (2013). Educational systems and the trade-off between labour market allocation and equality of educational opportunity. The University of Chicago Press.

    Google Scholar 

  • Brož, F., & Voňková, H. (2015). Testing of the language skills of 6th-graders in the CLoSE project. [K testu jazykových dovedností žáků 6. ročníku v projektu CLoSE]. Český jazyka a literatura, 66(1), 27–33.

    Google Scholar 

  • Chvál, M., & Straková, J. (2014). Possibilities of measuring learning competence – Application of a Finnish tool in the Czech environment [Možnosti měření kompetencí k učení – aplikace finského nástroje v českém prostředí]. Pedagogika, 64(3), 307–326.

    Google Scholar 

  • Chvál, M., Vondrová, N., & Novotná, J. (2020). Using large-scale data to determine pupils’ strategies and errors in arithmetic problems. Preprint.

    Google Scholar 

  • Gamoran, A. (2001). American schooling and educational inequity: A forecast for the 21st century. Sociology of Education, 74, 135–153.

    Article  Google Scholar 

  • Greger, D. (2015). Educational policy in the Czech Republic: 25 years of educational transformation and growing inequalities. In T. Corner (Ed.), Education in the European Union: Post-2003 member states (pp. 75–92). Bloomsbury Academic.

    Chapter  Google Scholar 

  • Greger, D., & Holubová, M. (2011). Přechod žáků do víceletých gymnázií v selektivních systémech – srovnávací analýza [The transition of students to eight-year gymnasia in selective systems – A comparative analysis]. In E. Walterová (Ed.), Dva světy základní školy? Úskalí přechodu z 1. na 2. stupeň [Two worlds of basic school? Pitfalls of the transition from the first to the second stage of basic education] (pp. 67–81). Karolinum.

    Google Scholar 

  • Greger, D., Martinková, P., Hladká, A., & Potužníková, E. (2020). A propensity score matching analysis of the effects of the long academic track on student achievement over four years: Findings from the Czech Longitudinal Study in Education. Preprint.

    Google Scholar 

  • Guill, K., Lüdtke, O., & Köller, O. (2017). Academic tracking is related to gains in students’ intelligence over four years: Evidence from a propensity score matching study. Learning and Instruction, 47, 43–52. https://doi.org/10.1016/j.learninstruc.2016.10.001

    Article  Google Scholar 

  • Hanushek, E. A., & Wößmann, L. (2008). Does educational tracking affect performance and inequality? Differences-in-differences evidence across countries. Economic Journal, 116(510), C63–C76.

    Article  Google Scholar 

  • Hautamäki, J., & Kupiainen, S. (2014). Learning to learn in Finland: Theory and policy, research and practice. In R. Deakin Crick, C. Stringher, & K. Ren (Eds.), Learning to learn: International perspectives from theory and practice (pp. 170–195). Routledge.

    Chapter  Google Scholar 

  • Hautamäki, J., Arinen, P., Eronen, S., Hautamaki, A., Kupianien, S., Lindblom, B., et al. (2002). Assessing learning-to-learn: A framework. Centre for Educational Assessment, Helsinki University/National Board of Education. https://www.oph.fi/download/47716_learning.pdf

    Google Scholar 

  • Hladká, A., & Martinková, P. (2020). difNLR: Generalized logistic regression models for DIF and DDF detection. The R Journal, 12(1), 300–323. https://doi.org/10.32614/rj-2020-014

  • Ho, D. E., Imai, K., King, G., & Stuart, E. A. (2007). Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference. Political Analysis, 15(3), 199–236. https://doi.org/10.1093/pan/mpl013

  • Ho, D. E., Imai, K., King, G., & Stuart, E. A. (2011). MatchIt: Nonparametric preprocessing for parametric causal inference. Journal of Statistical Software, 42(8), 1–28. http://www.jstatsoft.org/v42/i08/

    Article  Google Scholar 

  • Ireson, J., Clark, H., & Hallam, S. (2002). Constructing ability groups in the secondary school: Issues in practice. School Leadership and Management, 22(2), 163–176.

    Article  Google Scholar 

  • Kelly, S., & Carbonaro, W. (2012). Curriculum tracking and teacher expectations: Evidence from discrepant course taking models. Social Psychology of Education, 15(3), 271–294.

    Article  Google Scholar 

  • Maaz, K., Trautwein, U., Lüdtke, O., & Baumert, J. (2008). Educational transitions and differential learning environments: How explicit between-school tracking contributes to social inequality in educational outcomes. Child Development Perspectives, 2(2), 99–106. https://doi.org/10.1111/j.1750-8606.2008.00048.x

    Article  Google Scholar 

  • Marsh, H. W., Hau, K.-T., Artelt, C., Baumert, J., & Peschar, J. L. (2006). OECD’s brief self-report measure of educational psychology’s most useful affective constructs: cross-cultural, psychometric comparisons across 25 countries. International Journal of Testing, 6, 311–360. https://doi.org/10.1207/s15327574ijt0604_1

  • Martin, M. O., & Mullis, I. V. S. (Eds.). (2013). Methods and procedures in TIMSS & PIRLS 2011. TIMSS & PIRLS International Study Center, Lynch School of Education, Boston College and International Association for the Evaluation of Educational Achievement.

    Google Scholar 

  • Martinková, P., & Drabinová, A. (2018). ShinyItemAnalysis for teaching psychometrics and to enforce routine analysis of educational tests. The R Journal, 10(2), 503–515. https://doi.org/10.32614/RJ-2018-074

  • Martinková, P., Drabinová, A., Liaw, Y. L., Sanders, E. A., McFarland, J. L., & Price, R. M. (2017). Checking equity: Why differential item functioning analysis should be a routine part of developing conceptual assessments. CBE—Life Sciences Education, 16(2), rm2.

    Article  Google Scholar 

  • Martinková, P., Hladká, A., & Potužníková, E. (2020). Is academic tracking related to gains in learning competence? Using propensity score matching and differential item change functioning analysis for better understanding of tracking implications. Learning and Instruction, 66. https://doi.org/10.1016/j.learninstruc.2019.101286

  • Matějů, P., & Straková, J. (2005). The role of the family and the school in the reproduction of educational inequalities in the post-Communist Czech Republic. British Journal of Sociology of Education, 26(1), 17–37.

    Article  Google Scholar 

  • Oakes, J. (2005). Keeping track: How schools structure inequality (2nd ed.). Yale University Press.

    Google Scholar 

  • OECD. (2002). Education policy analysis 2002. OECD.

    Book  Google Scholar 

  • OECD. (2013). PISA 2012 results: Excellence through equity: Giving every student the chance to succeed (volume II). PISA, OECD Publishing. https://doi.org/10.1787/9789264201132-en

    Book  Google Scholar 

  • OECD. (2016). PISA 2015 results (Volume I): Excellence and equity in education. PISA, OECD Publishing. https://doi.org/10.1787/9789264266490-en

    Book  Google Scholar 

  • Page, R. N. (1991). Lower-track classrooms: A curricular and cultural perspective. Teachers College Press.

    Google Scholar 

  • Palečková, J., Tomášek, V., & Basl, J. (2010). Hlavní zjištění výzkumu PISA 2009. Umíme ještě číst? [The main findings of PISA 2009. Can we still read?]. ÚIV.

    Google Scholar 

  • Peschar, J. L., Veenstra, R., & Molenaar, I. W. (1999). Self-regulated learning as a cross-curricular competency. The construction of instruments in 22 countries for the PISA main study 2000. Paris: OECD.

    Google Scholar 

  • R Core Team. (2020). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/

  • Retelsdorf, J., Becker, M., Köller, O., & Möller, J. (2012). Reading development in a tracked school system: A longitudinal study over 3 years using propensity score matching. British Journal of Educational Psychology, 82(4), 647–671.

    Article  Google Scholar 

  • Ropovik, I., & Greger, D. (2019, December 26). The measurement of motivation and self-concept within the framework of students’ approaches to learning. https://doi.org/10.31234/osf.io/ymzwc.

  • Rubin, B., & Noguera, P. (2004). Tracking detracking: Sorting through the dilemmas and possibilities of detracking in practice. Equity and Excellence in Education, 37, 92–101.

    Article  Google Scholar 

  • Starý, K., & Laufková, V. (2015). Kde žáci v polovině základního vzdělávání selhávají při porozumění čtenému polemickému textu.[ Where do sixth-graders fail in comprehending polemical texts?]. Pedagogika, 65(4), 392–412.

    Google Scholar 

  • Straková, J. (2010). Přidaná hodnota studia na víceletých gymnáziích ve světle dostupných datových zdrojů [The added value of education at eight-year gymnasia in the light of available data sources]. Sociologický časopis/Czech Sociological Review, 2, 187–210.

    Google Scholar 

  • Straková, J., Greger, D., & Soukup, P. (2017). Factors affecting the transition of fifth-graders to the academic track in the Czech Republic. International Studies in Sociology of Education, 26(2), 288–309.

    Article  Google Scholar 

  • Straková, J., Simonová, J., & Greger, D. (2018). Improving mathematics results: Does teachers’ academic optimism matter? A study of lower secondary schools. School Effectiveness and School Improvement, 29(3), 446–463.

    Article  Google Scholar 

  • Strand, S. (2014). Ethnicity, gender, social class and achievement gaps at age 16: Intersectionality and ‘Getting it’ for the white working class. Research Papers in Education, 29(2), 131–171. https://doi.org/10.1080/02671522.2013.767370

    Article  Google Scholar 

  • Tomášek, V. (Ed.). (2008). Výzkum TIMSS 2007. Obstojí čeští žáci v mezinárodní konkurenci? [TIMSS 2007. Are Czech students going to stack up to international competition?]. ÚIV.

    Google Scholar 

Download references

Acknowledgements

This work is based on data from the CLoSE study collected within the project funded by the Czech Science Foundation under Grant number P402/12/G130. Work on this chapter was supported by the Czech Science Foundation under Grant number 18-19056S for JS, and DG and PM were supported by Charles University grant PRIMUS/17/HUM/.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to David Greger .

Editor information

Editors and Affiliations

Section Editor information

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Greger, D., Straková, J., Martinková, P. (2022). Extending the ILSA Study Design to a Longitudinal Design. In: Nilsen, T., Stancel-Piątak, A., Gustafsson, JE. (eds) International Handbook of Comparative Large-Scale Studies in Education. Springer International Handbooks of Education. Springer, Cham. https://doi.org/10.1007/978-3-030-38298-8_31-1

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-38298-8_31-1

  • Received:

  • Accepted:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-38298-8

  • Online ISBN: 978-3-030-38298-8

  • eBook Packages: Springer Reference EducationReference Module Humanities and Social SciencesReference Module Education

Publish with us

Policies and ethics