Investigating the Psychometric Properties (Validity and Reliability) of the Physical Education Teachers' Literacy Assessment Questionnaire

Document Type : Original Article

Authors

1 Assistant Professor of Sport Management, Department of Motor Behavior & Sport Management, Faculty of Sport Sciences, University of Isfahan, Isfahan, Iran

2 M.A. in Sport Management, Department of Motor Behavior & Sport Management, Faculty of Sport Sciences, University of Isfahan, Isfahan, Iran

3 Associate Professor of Sport Management, Department of Motor Behavior & Sport Management, Faculty of Sport Sciences, University of Isfahan, Isfahan, Iran

10.22091/jrim.2025.12116.1190

Abstract

This study aimed to develop and validate a physical education teacher's literacy assessment questionnaire. This research employed an exploratory mixed-methods design. In the qualitative phase, participants included 15 experts, university professors, educational supervisors, and experienced physical education teachers, while the quantitative phase involved 260 physical education teachers (30 people in the pilot study and 230 people in the main study) from 29 provinces of the country. Data in the qualitative phase were collected through semi-structured interviews and analyzed using thematic analysis. In the quantitative phase, a researcher-developed questionnaire titled "physical education teacher assessment literacy" was used, and descriptive and inferential statistical analyses were conducted using SPSS and LISREL software. The initial questionnaire, consisting of 70 items, was designed based on qualitative findings, and its face and content validity were confirmed by expert reviewers. A pilot study involving 30 physical education teachers was conducted to assess semantic validity, and necessary revisions were made to the items. The reliability coefficient was calculated using Cronbach's alpha, which yielded a value of 0.95. Exploratory factor analysis led to the removal of 15 items with factor loadings below 0.5, resulting in a final scale comprising 55 items and 9 factors. The Confirmatory factor analysis results indicated that all factor loadings and fit indices were within acceptable and desirable ranges

Keywords

References

Aarskog, E. (2021). ‘No assessment, no learning’: exploring student participation in assessment in Norwegian physical education (PE) [Article]. Sport, Education and Society, 26(8), 875-888. https://doi.org/10.1080/13573322.2020.1791064
Allen, R., Ferkel, R., Fisher, K., & Wawersik, A. (2022). An Economical Assessment Model for Elementary Physical Education [Article]. Journal of Physical Education, Recreation and Dance, 93(6), 51-58. https://doi.org/10.1080/07303084.2022.2081270
Arias-Estero, J., & Castejón, F. (2014). Using instruments for tactical assessment in physical education and extra-curricular sports [Article]. European Physical Education Review, 20(4), 525-535.https://doi.org/10.1177/1356336X14539214
Barrientos Hernán, E. J., López-Pastor, V. M., Lorente-Catalán, E., & Kirk, D. (2022). Challenges with using formative and authentic assessment in physical education teaching from experienced teachers’ perspectives [Article]. Curriculum Studies in Health and Physical Education. 14(2), 109–126. https://doi.org/10.1080/25742981.2022.2060118
Bores-García, D., Hortigüela-Alcalá, D., González-Calvo, G., & Barba-Martín, R. (2020). Peer assessment in physical education: A systematic review of the last five years [Review]. Sustainability (Switzerland), 12(21), 1-15, Article 9233.https://doi.org/10.3390/su12219233
Chng, L. S., & Lund, J. (2018). Assessment for Learning in Physical Education: The What, Why and How. Journal of Physical Education, Recreation and Dance, 89(8), 29-34.https://doi.org/10.1080/07303084.2018.1503119
Chng, L., & Lund, J. (2021). Assessment for Learning in Physical Education: Practical Tools and Strategies to Enhance Learning of Games [Article]. Journal of Physical Education, Recreation and Dance, 92(7), 31-38.https://doi.org/10.1080/07303084.2021.1948464
Constantinou, P. (2017). Instructional Assessment Strategies for Health and Physical Education [Article]. Strategies, 30(3), 3-9. https://doi.org/10.1080/08924562.2017.1297747
Cowan, D., & Taylor, I. M. (2016). ‘I’m proud of what I achieved; I’m also ashamed of what I done’: a soccer coach’s tale of sport, status, and criminal behaviour. Qualitative Research in Sport, Exercise and Health, 8(5), 505-518.https://doi.org/10.1080/2159676X.2016.1206608.
DinanThompson, M., & Penney, D. (2015). Assessment literacy in primary physical education [Article]. European Physical Education Review, 21(4), 485-503. https://doi.org/10.1177/1356336X15584087
Document of Fundamental Transformation of Education (2011). Ministry of Education. Iran
Ershad Iranji, T., Safania, A., farahani, A., & Nikbakhsh, R. (2022). Pathology of Physical Education Assessment in the High Schools of Iran. Research on Educational Sport, 10(27), 185-212. https://doi.org/10.22089/res.2021.10949.2127. [In Persian]
Eslami, M., Bahrami, S., & Vahdani,  M. (2024). Designing a needs assessment model for physical education teachers in Iran. Human Resource Management in Sports, 11(2), 295 -315. https://doi.org/10.22044/shm.2024.13631.2583 . [In Persian]
Evans, C., & Zhu, X. (2023). The development and validation of the assessment engagement scale [Original Research]. Frontiers in Psychology, 14.https://doi.org/10.3389/fpsyg.2023.1136878
Giraldo, F. (2021). Language assessment literacy and teachers’ professional development: A review of the literature. Profile Issues in TeachersProfessional Development, 23(2), 265-279. https://doi.org/10.15446/profile.v23n2.90533
Ha, T., Dauenhauer, B., & Krause, J. (2022). Facilitating Alternative Assessment with Technology in Physical Education. Strategies, 35(2), 36-39. https://doi.org/10.1080/08924562.2022.2031379
Hair Jr, J. F., LDS Gabriel, M., Silva, D. D., & Braga, S. (2019). Development and validation of attitudes measurement scales: fundamental and practical aspects. RAUSP Management Journal, 54(4), 490-507. https://doi.org/10.1108/RAUSP-05-2019-0098
Hajimahdi, N., & Sobhani Nejad, M. (2024). Educational Needs of Preschool Educators to Design In-service Training Courses. Journal of research in instructional methods, 2(1), 67-90. doi: 10.22091/jrim.2024.10855.1079 [In Persian]
Hay, P., & Penney, D. (2012). Assessment in physical education: A sociocultural perspective. Routledge.
Hodges, M., Liu, X., D. Hamilton, X., Doherty, B., Phelps, A., Colburn, J., & Knipe, R. (2022). A qualitative examination on the preparation of preservice physical education teachers for assessment in secondary teaching methods courses in the US. Physical Education and Sport Pedagogy.  29(6), 636–651.https://doi.org/10.1080/17408989.2022.2153816.
khodashenas, M. R. , Khodabakhshzadeh, H. , Baghaei, P. & Motallebzadeh, K. (2022). EFL Teachers Assessment Literacy Needs Inventory: A Case of Fulcher’s Assessment Literacy. Issues in Language Teaching, 11(1), 131-156. doi: 10.22054/ilt.2022.63731.639.[In Persian]
Khoshkholq, I. (2018). Principles, Goals and Applications of Assessment for Assessment Methods, Tehran: Merat Learning Schools Institute. [In Persian]
Killian, C. M., & Mays Woods, A. (2021). Assessment Practices in K–12 Physical Education in the United States: A Scoping Review of Research, 2000–2020 [Article]. Research Quarterly for Exercise and Sport, 92(2), 248-258. https://doi.org/10.1080/02701367.2021.1894315
Kim H. Koh (2011) Improving teachers’ assessment literacy through professional development, Teaching Education, 22(3), 255-276. https://doi.org/10.1080/10476210.2011.593164
Kim, Y., & Lee, O. (2022). Exploring the phenomenological meanings of assessment in physical education through primary teachers’ lived experiences. Physical Education and Sport Pedagogy, 27(6), 578-590.https://doi.org/10.1080/17408989.2021.1911983
Leirhaug, P. E. (2016). Exploring the relationship between student grades and assessment for learning in Norwegian physical education. European Physical Education Review, 22(3), 298-314. https://doi.org/10.1177/1356336X15606473
Leirhaug, P. E., MacPhail, A., & Annerstedt, C. (2016). ‘The grade alone provides no learning’: investigating assessment literacy among Norwegian physical education teachers. Asia-Pacific Journal of Health, Sport and Physical Education, 7(1), 21-36. https://doi.org/10.1080/18377122.2016.1145429
Leirhaug, P. E., Macphail, A., & Annerstedt, C. (2016). ‘The grade alone provides no learning’: Investigating assessment literacy among Norwegian physical education teachers [Article]. Asia-Pacific Journal of Health, Sport and Physical Education, 7(1), 21-36. https://doi.org/10.1080/18377122.2016.1145429 
Lyngstad, I., Bjerke, Ø., Bang, K. M., & Lagestad, P. (2022). Norwegian upper secondary students’ experiences of their teachers’ assessment of and for learning in physical education: examining how assessment is interpreted by students of different physical abilities. Sport, Education and Society, 27(3), 320-331. https://doi.org/10.1080/13573322.2020.1842728 
Macken, S., MacPhail, A., & Calderon, A. (2020). Exploring primary pre-service teachers’ use of ‘assessment for learning’ while teaching primary physical education during school placement [Article]. Physical Education and Sport Pedagogy, 25(5), 539-554. https://doi.org/10.1080/17408989.2020.1752647 
Masters, G. N. (2014). Assessment: Getting to the essence. Designing the Future, 4(1), 1-6
Md-Ali, R., Veloo, A. (2017). Teachers’ Autonomy and Accountability in Assessing Students’ Physical Education in School-Based Assessment. In: Amzat, I., Valdez, N. (eds) Teacher Empowerment Toward Professional Development and Practices. Springer, Singapore. https://doi.org/10.1007/978-981-10-4151-8_5
National Curriculum of Iran (2012). Ministry of Education, Iran.
Nowell, L. S., Norris, J. M., White, D. E., & Moules, N. J. (2017). Thematic Analysis: Striving to Meet the Trustworthiness Criteria. International Journal of Qualitative Methods, 16(1), 1609406917733847. https://doi.org/10.1177/1609406917733847 
Pastore, S. (2023). Teacher assessment literacy: a systematic review [Systematic Review]. Frontiers in Education, 8. https://doi.org/10.3389/feduc.2023.1217167  
Petre, C. (2023). Continuous assessment and synthetic assessment – elements of pedagogical technique. Curriculum Case Study: Personal Development. The „Black Sea” Journal of Psychology, 14(3), 46-55. https://doi.org/10.47577/bspsychology.bsjop.v14i3.246 
Popham, W. J. (2009). Assessment literacy for teachers: Faddish or fundamental? Theory into practice, 48(1), 4-11. https://doi.org/10.1080/00405840802577536  
Pourjafarian, M., & Mehrpouyan, P. (2024). Normalization of Aggression Questionnaire among Student Athletes in Mashhad. Journal of research in instructional methods, 1(4), 107-125. doi: 10.22091/jrim.2024.10277.1049
Rezasoltani, N., Azizian Kohan, N., & Vahdani, M. (2023). Feasibility of Adding a Student Workbook in Learning Packages for Physical Education Curriculum. Research on Educational Sport, 11(30), 193-218. doi: 10.22089/res.2022.13127.2285. [In Persian]
Smith, B., & McGannon, K. R. (2018). Developing rigor in qualitative research: problems and opportunities within sport and exercise psychology. International Review of Sport and Exercise Psychology, 11(1), 101-121.https://doi.org/10.1080/1750984X.2017.1317357
Stiggins, R. Arter, J. Chappuis, &Chappuis, S. (2004) Classroom assessment for student learning: Doing it right—using it well. Portland, OR: Assessment Training Institute.
Stiggins, R. J. (1991). Assessment literacy. Phi Delta Kappan, 72(7), 534-539.
Taslimi, Z., & Babooee, H. (2018). Coordinated and Focused Evaluation of Physical Education in Schools: A Qualitative Study. Research on Educational Sport, 6(14), 45-66. https://doi.org/10.22089/res.2017.4239.1306. [In Persian]
Vahdani, M., Malverdi, E., & Salimi, M. (2024). Analyzing the Dimensions of Assessment Literacy of Physical Education Teachers, Journal of Curriculum Research, 14(1), 189-208. 10.22099/jcr.2024.7636. [In Persian]
Vahdani, M., Rezasoltani, N., & Jafari, M. (2021). Designing of a pedagogical model to implementation the goals of the physical education curriculum of schools during the Covid-19 pandemic. Research on Educational Sport, 9(22), 14-46. https://doi.org/10.22089/res.2021.9596.1974. [In Persian]
Vahdani, M., Rezasoltani, N., Hoseinpour, E., & Ershad, T. (2023). Phenomenological Analysis (Lived Experiences) of Physical Education Teachers of Implemented Curriculum Challenges during the COVID-19 Pandemic. The Journal of New Thoughts on Education, 19(4), 119-142. doi: 10.22051/jontoe.2022.38592.3472. [In Persian]
Yamtim, V. & Wongwanich, S. (2014). A study of classroom assessment literacy of primary school teachers. Procedia-Social and Behavioral Sciences, 116, 2998-3004. https://doi.org/10.1016/j.sbspro.2014.01.696

Files

History

  • Receive Date: 13 January 2025
  • Revise Date: 05 February 2025
  • Accept Date: 15 February 2025

Share

How to cite

Statistics