logo logo European Journal of Educational Research

EU-JER is is a, peer reviewed, online academic research journal.

Subscribe to

Receive Email Alerts

for special events, calls for papers, and professional development opportunities.

Subscribe

Publisher (HQ)

Eurasian Society of Educational Research
Eurasian Society of Educational Research
7321 Parkway Drive South, Hanover, MD 21076, USA
Eurasian Society of Educational Research
Headquarters
7321 Parkway Drive South, Hanover, MD 21076, USA
observation preservice teachers rubrics student evaluation teacher education

Evaluation of Preservice Teachers’ Performance in School through Video Observations during the COVID-19 Pandemic

Maria Carme Peguera-Carré , Jordi Coiduras , David Aguilar , Àngel Blanch

Lesson study, observation and analysis are relevant to professional development and initial teacher education. As a strategy, it helps to bridge the g.

L

Lesson study, observation and analysis are relevant to professional development and initial teacher education. As a strategy, it helps to bridge the gap between theory and practice. The health conditions brought on by the COVID-19 pandemic forced the restriction of the tutors’ direct observation of preservice teachers at school. This study analyses preservice teachers’ performance through video observations to evaluate their professional activity at school during the COVID-19 pandemic. The Fifteen Items Revised Tsang-Hester Observation Rubric (FIR-THOR) was administered to a sample of 166 preservice teachers in their internship schools and their video recordings each one of 45-minute teaching lessons were analysed. The results show that the FIR-THOR appears as a robust instrument, which allows us to conclude that the instrument works well in the three five-items dimensions that compose it - Instruction, Management, and Assessment - proving to be reliable for assessing teacher intervention in the classroom. Among the three dimensions, the preservice teachers’ performance stands out in the Management of the classroom, as well as in the classroom Instruction. This contribution is relevant considering the potential of lesson analysis in learning and professional development during initial teacher training.

Keywords: Observation, preservice teachers, rubrics, student evaluation, teacher education.

cloud_download PDF
Cite
Article Metrics
Views
406
Download
455
Citations
Crossref
0

Scopus
0

References

Acar-Erdol, T., & Yıldızlı, H. (2018). Classroom assessment practices of teachers in Turkey. International Journal of Instruction, 11(3), 587-602. https://doi.org/10.12973/iji.2018.11340a

Ball, D. L., & Forzani, F. M. (2009). The work of teaching and the challenge for teacher education. Journal of Teacher Education, 60(5), 497-511. https://doi.org/10.1177/0022487109348479

Ball, D. L., Thames, M. H., & Phelps, G. (2008). Content knowledge for teaching: What makes it special? Journal of Teacher Education, 59(5), 389-407. https://doi.org/10.1177/0022487108324554

Battistone, W., Buckmiller, T., & Peters, R. (2019). Assessing Assessment Literacy: Are new teachers prepared to assume jobs in school districts engaging in grading and assessment reform efforts? Studies in Educational Evaluation, 62, 10-17. https://doi.org/10.1016/j.stueduc.2019.04.009

Baumert, J., Kunter, M., Blum, W., Brunner, M., Voss, T., Jordan, A., Klusmann, U., Krauss, S., Neubrand, M., & Tsai, Y. M. (2010). Teachers’ mathematical knowledge, cognitive activation in the classroom, and student progress. American Educational Research Journal, 47(1), 133–180. https://doi.org/10.3102/0002831209345157

Bear, G. G. (2015). Preventive and classroom-based strategies. In E. T. Emmer, & E. J. Sabornie (Eds.), Handbook of classroom management (pp. 15–39). Routledge.

Begrich, L., Kuger, S., Klieme, E., & Kunter, M. (2021). At a first glance–How reliable and valid is the thin slices technique to assess instructional quality? Learning and Instruction, 74, Article 101466. https://doi.org/10.1016/j.learninstruc.2021.101466

Bell, B., Osborne, R., & Tasker, R. (1985). Finding out what children think. In R. Osborne, & P. Freyberg (Eds.), Learning in science: The implications of children’s ideas (pp. 151–165). Heinemann.

Bell, C. A., Dobbelaer, M. J., Klette, K., & Visscher, A. (2019). Qualities of classroom observation systems. School Effectiveness and School Improvement, 30(1), 3-29. https://doi.org/10.1080/09243453.2018.1539014

Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7–74.  https://doi.org/10.1080/0969595980050102

Black, P., & Wiliam, D. (2010). Inside the black box: Raising standards through classroom assessment. Phi Delta Kappan, 92(1), 81-90. https://doi.org/10.1177/003172171009200119

Blanch, A., & Aluja, A. (2009). Validation study of the Spanish Version of the Work-Family Conflict Questionnaire (CCTF). Spanish Journal of Psychology, 12(2), 746-755. https://doi.org/10.1017/S1138741600002110

Blanch, A., & Aluja, A. (2016). Text mining a self-report back-translation. Psychological Assessment, 28(6), 750–764. https://doi.org/10.1037/pas0000213

Blikstad‐Balas, M., & Sørvik, G. O. (2015). Researching literacy in context: Using video analysis to explore school literacies. Literacy, 49(3), 140-148. https://doi.org/10.1111/lit.12037

Blomberg, G., Renkl, A., Gamoran Sherin, M., Borko, H., & Seidel, T. (2013). Five research-based heuristics for using video in pre-service teacher education. Journal for Educational Research Online, 5(1), 90–114. https://bit.ly/4280gkL

Bollen, K. A. (1989). Structural equations with latent variables. John Wiley & Sons. https://doi.org/10.1002/9781118619179

Byrne, B. (2001). Structural equation modeling with AMOS. Basic concepts, applications, and programming. Lawrence Erlbaum.

Charalambous, C. Y., & Praetorius, A. K. (2018). Studying mathematics instruction through different lenses: Setting the ground for understanding instructional quality more comprehensively. ZDM - Mathematics Education, 50, 355–366. http://doi.org/10.1007/s11858-018-0914-8

Chen, G., Chan, C. K. K., Chan, K. K. H., Clarke, S. N., & Resnick, L. B. (2020). Efficacy of video-based teacher professional development for increasing classroom discourse and student learning. Journal of the Learning Sciences, 29(4-5), 642-680. https://doi.org/10.1080/10508406.2020.1783269

Coiduras, J. L., Blanch, À., & Barbero, I. (2020). Initial teacher education in a dual-system: Addressing the observation of teaching performance. Studies in Educational Evaluation 64, Article 100834. https://doi.org/10.1016/j.stueduc.2019.100834

Dalehefte, I. M., & Kobarg, M. (2013). Aus Unterrichtsbeobachtungen lernen: Handreichung des Programms SINUS an Grundschulen [Learning from lesson observations: Handout of the SINUS programme at primary schools]. IPN – Leibniz Institute for Science and mathematics Education at Kiel University.

Danielson, C. (1996). Enhancing professional practice: A framework for teaching. Association for Supervision and Curriculum Development.

Danielson, C. (2013). The Framework for Teaching Evaluation Instrument. Danielson Group.

de Grift, W., Helms-Lorenz, M., & Maulana, R. (2014). Teaching skills of student teachers: Calibration of an evaluation instrument and its value in predicting student academic engagement. Studies in Educational Evaluation, 43, 150-159. https://doi.org/10.1016/j.stueduc.2014.09.003

Evertson, C. M., & Weinstein, C. S. (Eds.). (2006). Handbook of classroom management: Research, practice, and contemporary issues. Routledge. https://doi.org/10.4324/9780203874783

Fischer, H. E., & Neumann, K. (2012). Video analysis as a tool for understanding science instruction. In D. Jord, & J. Dillon (Eds.), Science education research and practice in Europe: Cultural perspectives in science education (Vol. 5, pp. 115-139). Sense Publishers. https://doi.org/10.1007/978-94-6091-900-8_6

Gaudin, C., & Chaliès, S. (2015). Video viewing in teacher education and professional development: A literature review. Educational Research Review, 16, 41–67. https://doi.org/10.1016/j.edurev.2015.06.001

Gazdag, E., Nagy, K., & Szivák, J. (2019). “I Spy with My Little Eyes...” The use of video stimulated recall methodology in teacher training–The exploration of aims, goals and methodological characteristics of VSR methodology through systematic literature review. International Journal of Educational Research, 95, 60-75. https://doi.org/10.1016/j.ijer.2019.02.015

Goldman, R., Pea, R., Barron, B., & Derry, S. J. (Eds.). (2007). Video research in the learning sciences. Lawrence Erlbaum.

Good, T., McCaslin, M., Tsang, H., Zhang, J., Wiley, C., Bozack, A., & Hester, W. (2006). How well do 1st-year teachers teach does type of preparation make a difference? Journal of Teacher Education, 57(4), 410-430. https://doi.org/10.1177/0022487106291566

Grossman, P., Compton, C., Igra, D., Ronfeldt, M., Shahan, E., & Williamson, P. (2009). Teaching practice: A cross-professional perspective. Teachers College Record, 111(9), 2055-2100. https://doi.org/10.1177/016146810911100905

Hackenberg, A. (2005). A model of mathematical learning and caring relations. For the Learning of Mathematics, 25(1), 44–47. https://www.jstor.org/stable/40248486

Harlen, W. (Ed.). (2001). Primary science ...taking the plunge: How to teach primary science more effectively for ages 5 to 12 (2nd ed.). Heinemann.

Herzog-Punzenberger, B., Altrichter, H., Brown, M., Burns, D., Nortvedt, G. A., Skedsmo, G., Wiese, E., Nayir, F., Fellner, M., McNamara, G., & O’Hara, J. (2020). Teachers responding to cultural diversity: case studies on assessment practices, challenges and experiences in secondary schools in Austria, Ireland, Norway and Turkey. Educational Assessment, Evaluation and Accountability, 32, 395-424. https://doi.org/10.1007/s11092-020-09330-y

Hill, H. C., Charalambous, C. Y., & Kraft, M. A. (2012). When rater reliability is not enough: Teacher observation systems and a case for the generalizability study. Educational Researcher, 41(2), 56– 64. https://doi.org/10.3102/0013189X12437203

Hodges, C., Moore, S., Lockee, B., Trust, T., & Bond, A. (2020). The difference between emergency remote teaching and online learning. EDUCAUSE Review. http://hdl.handle.net/10919/104648

Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118

Jewitt, C. (2012). An introduction to using video for research (NCRM Working Paper). National Centre for Research Methods. http://eprints.ncrm.ac.uk/2259/

Kazemi, E., Ghousseini, H., Cunard, A., & Turrou, A. C. (2016). Getting inside rehearsals: Insights from teacher educators to support work on complex practice. Journal of Teacher Education, 67(1), 18-31. https://doi.org/10.1177/0022487115615191

Klette, K., & Blikstad-Balas, M. (2018). Observation manuals as lenses to classroom teaching: Pitfalls and possibilities. European Educational Research Journal, 17(1), 129–146. https://doi.org/10.1177/1474904117703228

Kraft, M. A., & Blazar, D. (2017). Individualized coaching to improve teacher practice across grades and subjects: New experimental evidence. Educational Policy, 31(7), 1033–1068. https://doi.org/10.1177/0895904816631099

Kramer, C., König, J., Strauss, S., & Kaspar, K. (2020). Classroom videos or transcripts? A quasi-experimental study to assess the effects of media-based learning on pre-service teachers’ situation-specific skills of classroom management. International Journal of Educational Research, 103, Article 101624. https://doi.org/10.1016/j.ijer.2020.101624

Krammer, K., Ratzka, N., Klieme, E., Lipowsky, F., Pauli, C., & Reusser, K. (2006). Learning with classroom videos: Conception and first results of an online teacher training program. ZDM – Mathematics Education, 38, 422–432. https://doi.org/10.1007/BF02652803

Krug, M. (2009). "Videobasierte Methoden der Bildungsforschung: Sozial-, erziehungs- und kulturwissenschaftliche Nutzungsweisen"(19./20.06.2009, Stiftung Universität Hildesheim): Tagungsbericht. ["Video-based methods in educational research: Ways of using them in social, educational and cultural sciences"(19/20.06.2009, Foundation University of Hildesheim): Conference report.] Zeitschrift für Qualitative Forschung, 10(1), 161-167. https://l24.im/7QEwr

Lasagabaster, D., & Sierra, J. M. (2011). Classroom observation: Desirable conditions established by teachers. European Journal of Teacher Education, 34(4), 449-463. https://doi.org/10.1080/02619768.2011.587113

Lavigne, A. L., & Good, T. L. (2015). Improving teaching through observation and feedback: Beyond state and federal mandates. Routledge. https://doi.org/10.4324/9781315777030

Liu, S., Bell, C. A., & Jones, N. D. (2017, March 1-4). The validity of classroom observation systems in research and applied contexts [Conference presentation]. Annual Spring meeting of the Society for Research on Educational Effectiveness (SREE), Washington, DC.

McDonald, M., Kazemi, E., & Kavanagh, S. S. (2013). Core practices and pedagogies of teacher education: A call for a common language and collective activity. Journal of Teacher Education, 64(5), 378-386. https://doi.org/10.1177/0022487113493807

Miller, K., & Zhou, X. (2007). Learning from classroom video: What makes it compelling and what makes it hard. In R. Goldmann, R. Pea, B. Barron, & S. J. Derry (Eds.), Video research in the learning sciences (pp. 321–334). Lawrence Erlbaum.

Moyo, N. (2020). COVID-19 and the future of practicum in teacher education in Zimbabwe: Rethinking the ‘new normal’ in quality assurance for teacher certification. Journal of Education for Teaching, 46(4), 536-545. https://doi.org/10.1080/02607476.2020.1802702

Murtagh, L. (2022). Remote tutor visits to practicum settings and the changing dynamics between university tutors, school-based mentors and pre-service teachers. Journal of Further and Higher Education, 46(3), 354-367. https://doi.org/10.1080/0309877X.2021.1945557

Nevgi, A., & Löfström, E. (2015). The development of academics’ teacher identity: Enhancing reflection and task perception through a university teacher development programme. Studies in Educational Evaluation, 46, 53-60. https://doi.org/10.1016/j.stueduc.2015.01.003

O’Leary, M. (2012). Exploring the role of lesson observation in the English education system: A review of methods, models and meanings. Professional Development in Education, 38(5), 791–810. https://doi.org/10.1080/19415257.2012.693119

O’Leary, M. (2013). Expansive and restrictive approaches to professionalism in FE colleges: The observation of teaching and learning as a case in point. Research in Post-Compulsory Education, 18(4), 348–364. https://doi.org/10.1080/13596748.2013.847164

O’Leary, M. (2020). Classroom observation: A guide to the effective observation of teaching and learning (2nd ed.). Routledge. https://doi.org/10.4324/9781315630243

Osborne, J., Berson, E., Borko, H., Busch, K. C., Zaccarelli, F. G., Million, S., & Tseng, A. (2015, August 25-29). Assessing the quality of classroom discourse in science classrooms. [Conference presentation]. 16th biennial conference of the European Association for Research in Learning and Instruction, Limassol, Cyprus.

Peguera, M. C. (2022, January 31). Video 1. Extract of a video recorded PT’s lesson [Video]. YouTube. https://youtu.be/_UOLjcoSSLk

Pianta, R. C., La Paro, K. M., & Hamre, B. K. (2008). Classroom assessment scoring system™: Manual K-3. Paul H Brookes Publishing.

Prilop, C. N., Weber, K. E., & Kleinknecht, M. (2019). How digital reflection and feedback environments contribute to pre-service teachers’ beliefs during a teaching practicum. Studies in Educational Evaluation, 62, 158-170. https://doi.org/10.1016/j.stueduc.2019.06.005

R Development Core Team. (2014). R: A language and environment for statistical computing. R Foundation for Statistical Computing. http://www.R-project.org

Rich, P. J., & Hannafin, M. (2009). Video annotation tools technologies to scaffold, structure, and transform teacher reflection. Journal of Teacher Education 60(1), 52–67. https://doi.org/10.1177/0022487108328486

Richards, J., Altshuler, M., Sherin, B. L., Sherin, M. G., & Leatherwood, C. J. (2021). Complexities and opportunities in teachers' generation of videos from their own classrooms. Learning, Culture and Social Interaction, 28, Article 100490. https://doi.org/10.1016/j.lcsi.2021.100490

Roegman, R., Goodwin, A. L., Reed, R., & Scott-McLaughlin, R. M. (2016). Unpacking the data: An analysis of the use of Danielson’s (2007) Framework for Professional Practice in a teaching residency program. Educational Assessment, Evaluation and Accountability, 28, 111-137. https://doi.org/10.1007/s11092-015-9228-3

 Ronen, I. K. (2022). The experience of teaching: Beyond teaching skills the case of the academy-class practice model. Studies in Educational Evaluation, 72, Article 101115. https://doi.org/10.1016/j.stueduc.2021.101115

Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1-36. https://doi.org/10.18637/jss.v048.i02  

Sherin, M. G. (2003). New perspectives on the role of video in teacher education. In J. Brophy (Ed.), Using video in teacher education (Vol. 10, pp. 1–27). Emerald Group Publishing Limited. https://doi.org/10.1016/S1479-3687(03)10001-6

Smith, I. D., & Coombs, S. J. (2003). The Hawthorne effect: Is it a help or a hindrance in social science research? Change, 6(1), 97–111. https://bit.ly/3ZRZQxd

Spiro, R. J., Collins, B. P., & Ramchandran, A. (2007). Reflections on a post-Gutenberg epistemology of video use in ill-structured domains: Fostering complex learning and cognitive flexibility. In R. Goldman, R. Pea, B. Barron, & S. J. Derry (Eds.), Video research in the learning sciences (pp. 93–100). Lawrence Erlbaum.

Tournaki, N., Lyublinskaya, I., & Carolan, B. V. (2009). Pathways to teacher certification: Does it really matter when it comes to efficacy and effectiveness? Action in Teacher Education, 30(4), 96-109. http://doi.org/10.1080/01626620.2009.10734455

Tukey, J. W. (1949). Comparing individual means in the analysis of variance. Biometrics, 5(2), 99-114. https://doi.org/10.2307/3001913

van Es, E. A., Cashen, M., Barnhart, T., & Auger, A. (2017). Learning to notice mathematics instruction: Using video to develop preservice teachers' vision of ambitious pedagogy. Cognition and Instruction, 35(3), 165-187. http://doi.org/10.1080/07370008.2017.1317125

Venkat, H., Rollnick, M., Loughran, J., & Askew, M. (Eds.). (2014). Exploring mathematics and science teachers' knowledge: Windows into teacher thinking. Routledge. https://doi.org/10.4324/9781315883090

Williamson, B., Eynon, R., & Potter, J. (2020). Pandemic politics, pedagogies and practices: Digital technologies and distance education during the coronavirus emergency. Learning, Media and Technology, 45(2), 107–114. https://doi.org/10.1080/17439884.2020.1761641

Yang, C., Bear, G. G., May, H., & Curby, T. (2018). Multilevel associations between school-wide social–emotional learning approach and student engagement across elementary, middle, and high schools. School Psychology Review 47(1), 45–61. https://doi.org/10.17105/SPR-2017-0003.V47-1

Zaragoza, A., Seidel, T., & Hiebert, J. (2021). Exploring preservice teachers’ abilities to connect professional knowledge with lesson planning and observation. European Journal of Teacher Education. Advance online publication.  https://doi.org/10.1080/02619768.2021.1996558

...