Development and Validation of a Test of Thinking Strategies in German as a Foreign Language: Language Assessment in Lower-Secondary School Students

Martina Hoffmannová; Simona Tušicová

doi:10.2478/acc-2026-0005

.blurhash-client-img { display: none !important; }

Development and Validation of a Test of Thinking Strategies in German as a Foreign Language: Language Assessment in Lower-Secondary School Students

ACC JOURNAL

Volume 32 (2026): Issue 3 (March 2026)

By: Martina Hoffmannová and Simona Tušicová

Open Access

|May 2026

Abstract

This study focuses on the development and validation of the test of thinking strategies in German as a foreign language. The main aim is to develop a valid and reliable instrument for assessing the thinking strategies of lower-secondary school children (aged 14–16) in the Hradec Králové region, Czech Republic. The test development process involved item analysis, pilot testing, and psychometric evaluation conducted between October and December 2024 on a sample of 69 respondents, to establish both item-level and overall test validity and reliability. The results indicate that the developed test is an appropriate assessment tool enabling professionals to assess and therefore better understand the needs of individual learners during the foreign language acquisition process.

References

AERA, APA, & NCME. (2014). The Standards for Educational and Psychological Testing. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. ISBN 978-0-935302-35-6. https://www.testingstandards.net/open-access-files.html
Search in Google Scholar Back to article
Anderson, L. W., & Krathwohl, D. R. (2001). Remembering and understanding: The cognitive process dimension. In L. W. Anderson & D. R. Krathwohl (Eds.), A taxonomy for learning, teaching, and assessing: A revision of Bloom’s taxonomy of educational objectives (pp. 27–38). Longman. ISBN 0-8013-1903-X.
Search in Google Scholar Back to article
APA. (2018a). Cognitive ability. In APA Dictionary of Psychology. https://dictionary.apa.org/cognitive-ability
Search in Google Scholar Back to article
APA. (2018b). Creativity. In APA Dictionary of Psychology. https://dictionary.apa.org/creativity
Search in Google Scholar Back to article
Asmar, N., Youssef, N. Y., Malhab, S. B., Bahous, S., & Karam, V. G. Y. (2025). Evaluating construct validity of virtual osces in exceptional conditions. BMC Medical Education, 25, 841. https://doi.org/10.1186/s12909-025-07383-5
Search in Google Scholar Back to article
Bauer, A., Butler, E., & Popović, Z. (2015). Approaches for teaching computational thinking strategies in an educational game: A position paper. In 2015 IEEE Blocks and Beyond Workshop (Blocks and Beyond) (pp. 121–123). IEEE. ISBN 978-1-4673-8367-7. https://doi.org/10.1109/blocks.2015.7369019
Search in Google Scholar Back to article
Bell, T., & Lodi, M. (2019). Constructing Computational Thinking Without Using Computers. Constructivist Foundations, 14(3), 342–351. https://123dok.net/document/q2nke36q-constructing-computational-thinking-without-using-computers.html
Search in Google Scholar Back to article
Bilbao, N., Goioaga, O., Latorre, I., & Perea, F. (2018). Thinking Strategies and Special Educational Needs. In 12^th International Technology, Education and Development Conference Proceedings (pp. 3817–3821). IATED. https://doi.org/10.21125/inted.2018.0742
Search in Google Scholar Back to article
Brečka, P., & Valentová, M. (2017). Critical and Creative Thinking Strategies in Teaching Technical Subjects. In 10^th annual International Conference of Education, Research and Innovation Proceedings (pp. 1565–1571). IATED Academy. https://doi.org/10.21125/iceri.2017.0490
Search in Google Scholar Back to article
Carr, N. T. (2011). Designing and Analyzing Language Tests. Oxford University Press. ISBN 978-0-19-442297-0.
Search in Google Scholar Back to article
Coniam, D., Lee, T., Milanovic, M., Pike, N., & Zhao, W. (2022). Role of expert judgement in language test validation. Language Education & Assessment, 5, 18–33. https://doi.org/10.29140/lea.v5n1.769
Search in Google Scholar Back to article
Council of Europe. (2014). Common European Framework of Reference for Languages (CEFR). https://www.coe.int/en/web/common-european-framework-reference-languages
Search in Google Scholar Back to article
Dusilová, D., Kolocová, V., Haupenthal, T., & Krüger, J. (2014). Passt schon! 1. Polyglot. ISBN 978-80-86195-89-6.
Search in Google Scholar Back to article
Escobar-Pérez, J., & Cuervo-Martínez, A. (2008). Validez de contenido y juicio de expertos: Una aproximación a su utilización. Avances en Medición, 6, 27–36. https://www.humanas.unal.edu.co/lab_psicometria/application/files/9416/0463/3548/Vol_6._Articulo3_Juicio_de_expertos_27-36.pdf
Search in Google Scholar Back to article
Esterl, U., Körner, E., Einhorn, Á., Kubicka, A., Andrášová, H., Beňová, Z., & Jenkins, E.-M. (2021). Team Deutsch neu. Klett. ISBN 978-80-7397-370-4.
Search in Google Scholar Back to article
Evans, S., Pude, A., & Specht, F. (2020). Menschen A1 Kursbuch. Max Hueber Verlag. ISBN 978-3-19-211901-9.
Search in Google Scholar Back to article
Evans, S., Specht, F., & Pude, A. (2021). Momente A1 Kursbuch plus interaktive Version. Max Hueber Verlag. ISBN 978-3-19-501791-6.
Search in Google Scholar Back to article
Finocchiaro, M., & Sako, S. (1983). Foreign Language Testing: A Practical Approach. New York: Regents Publishing. ISBN 0-88345-362-2.
Search in Google Scholar Back to article
Fritz, A., Gürsoy E., & Herzog, M. (Eds.). (2021). Diversity Dimensions in Mathematics and Language Learning. De Gruyter. https://doi.org/10.1515/9783110661941
Search in Google Scholar Back to article
Futschek, G. (2006). Algorithmic Thinking: The Key for Understanding Computer Science. In Mittermeir R. T. (Ed.), Informatics Education – The Bridge between Using and Understanding Computers. ISSEP 2006. Lecture Notes in Computer Science, vol. 4226. (pp. 160–168). Springer, Berlin, Heidelberg. https://doi.org/10.1007/11915355_15
Search in Google Scholar Back to article
Galaczi, E. (2020). What is Validity? Cambridge University Press & Assessment. https://www.cambridgeenglish.org/blog/what-is-validity/
Search in Google Scholar Back to article
Georgiakaki, M., Bovermann, M., Graf-Riemann, E., & Seuthe, C. (2014). Beste Freunde A1.1. Max Hueber Verlag. ISBN 978-3-19-101058-4.
Search in Google Scholar Back to article
Hering, A., Matussek, M., & Perlmann-Balme, M. (2017). Sicher! Deutsch als Fremdsprache Übungsgrammatik. Max Hueber Verlag. ISBN 978-3-19-301206-7.
Search in Google Scholar Back to article
Herzog W. et al. (2012). Pädagogische Diagnostik. https://www.walterherzog.ch/lehre/virtueller-campus/
Search in Google Scholar Back to article
Hismanoglu, M. (2000). Language Learning Strategies in Foreign Language Learning and Teaching. The Internet TESL Journal, 6(8). http://iteslj.org/Articles/Hismanoglu-Strategies.html
Search in Google Scholar Back to article
Hughes, A., & Hughes, J. (2020). Testing for Language Teachers (3^rd ed.). Cambridge University Press. https://doi.org/10.1017/9781009024723
Search in Google Scholar Back to article
Chomsky, N. (2016). The language capacity: architecture and evolution. Psychonomic Bulletin & Review, 24, 200–203. https://doi.org/10.3758/s13423-016-1078-6
Search in Google Scholar Back to article
Chráska, M. (2016). Metody pedagogického výzkumu: Základy kvantitativního výzkumu (2^nd ed.). Grada Publishing. ISBN 978-80-247-5326-3.
Search in Google Scholar Back to article
Krathwohl, D. R. (2002). A Revision of Bloom’s Taxonomy: An Overview. Theory Into Practice, 41(4), 212–218. https://doi.org/10.1207/s15430421tip4104_2
Search in Google Scholar Back to article
Lcom Team. (2022). Pattern Recognition in Computational Thinking. Learning.com. https://www.learning.com/blog/pattern-recognition-in-computational-thinking/
Search in Google Scholar Back to article
Lee, Y.-W. (2015). Diagnosing diagnostic language assessment. Language Testing, 32(3), 299–316. https://doi.org/10.1177/0265532214565387
Search in Google Scholar Back to article
Main, P. (2026). Thinking Strategies: A Teacher’s Guide. Structural Learning. https://www.structural-learning.com/post/thinking-strategies-a-teachers-guide
Search in Google Scholar Back to article
Multhaup, U. (1997). Mental networks, procedural knowledge and foreign language teaching. Language Awareness, 6(2–3), 75–92. https://doi.org/10.1080/09658416.1997.9959919
Search in Google Scholar Back to article
O’Reilly, L. (2021). Bloom’s Revised Taxonomy Worksheet. University of Colorado Denver. https://www.ucdenver.edu/Docs/Librariesprovider279/Default-Document-Library/Blooms_taxonomy_worksheet6cfe02e6302864d9a5bfff0a001ce385.Pdf
Search in Google Scholar Back to article
Pelikán, J. (2011). Základy empirického výzkumu pedagogických jevů (2^nd ed.). Praha: Karolinum. ISBN 978-80-246-1916-3.
Search in Google Scholar Back to article
Plonsky, L. (2023). Sampling and Generalizability in Lx Research: A Second-Order Synthesis. Languages, 8(1), 75. https://doi.org/10.3390/languages8010075
Search in Google Scholar Back to article
Rottenhofer, M., Kuka, L., Leitner, S., & Sabitzer, S. (2022). Using Computational Thinking to Facilitate Language Learning: A Survey of Students’ Strategy Use in Austrian Secondary Schools. IAFOR Journal of Education, 10(2), 51–70. https://doi.org/10.22492/ije.10.2.03
Search in Google Scholar Back to article
Serna, M. E. & Serna, A. A. (2015). Knowledge in Engineering: A View from the Logical Reasoning. International Journal of Computer Theory and Engineering, 7(4), 325–331. https://doi.org/10.7763/ijcte.2015.v7.980
Search in Google Scholar Back to article
Shang, Y., Aryadoust, V., & Hou, Z. (2024). A Meta-Analysis of the Reliability of Second Language Listening Tests (1991–2022). Brain Sciences, 14(8), 746. https://doi.org/10.3390/brainsci14080746
Search in Google Scholar Back to article
Schraw, G. (2011). Assessment of Thinking in Educational Settings. Oxford Bibliographies. https://doi.org/10.1093/obo/9780199828340-0062
Search in Google Scholar Back to article
Teimouri, Y., Sudina, E., & Plonsky, L. (2025). Individual differences in language learning and teaching: Growing pains at the theory-methods interface. Learning and Individual Differences, 124, 102786. https://doi.org/10.1016/j.lindif.2025.102786
Search in Google Scholar Back to article
Wiese, R. (1989). Psycholinguistik der Sprachproduktion. In Antos, G. & Krings, H. P. (Eds.), Textproduktion: Ein interdisziplinärer Forschungsüberblick (pp. 197–219). Berlin, Boston: Max Niemeyer Verlag. https://doi.org/10.1515/9783110962109.197
Search in Google Scholar Back to article
Willmes, K., Moeller, K., & Klein, E. (2014). Where numbers meet words: A common ventral network for semantic classification. Scandinavian Journal of Psychology, 55(3), 202–211. https://doi.org/10.1111/sjop.12098
Search in Google Scholar Back to article
Zhao, H., & Aryadoust, V. (2024). A meta-analysis of the reliability of second language reading comprehension assessment tools. Studies in Second Language Acquisition, 47(1), 388–416. https://doi.org/10.1017/s0272263124000627
Search in Google Scholar Back to article

Articles in this issue

DOI: https://doi.org/10.2478/acc-2026-0005 | Journal eISSN: 2571-0613 | Journal ISSN: 1803-9782

Journal RSS Feed

Language: English

Page range: 62 - 78

Published on: May 12, 2026

Published by: Technical University of Liberec

In partnership with: Paradigm Publishing Services

Publication frequency: 3 issues per year

Keywords:

Educational measurement,

Pilot study,

Psychometric properties,

Item analysis

Related subjects:

Business and economics,

Business management,

Business management, other,

Engineering,

Mechanical engineering,

Materials engineering,

Linguistics and semiotics,

Applied linguistics,

Applied linguistics, other,

Social sciences,

Education,

Education, other

© 2026 Martina Hoffmannová, Simona Tušicová, published by Technical University of Liberec
This work is licensed under the Creative Commons Attribution-NonCommercial 4.0 License.

Volume 32 (2026): Issue 3 (March 2026)