ARTICLE | doi:10.20944/preprints202108.0318.v1
Subject: Social Sciences, Education Keywords: Inter-rater reliability; preservice teacher performance assessment; PACT; edTPA; weighted kappa; cognitive task analysis; qualitative; quantitative
Online: 16 August 2021 (10:51:52 CEST)
The Performance Assessment for California Teachers (PACT) is a high stakes summative assessment that was designed to measure pre-service teacher readiness. We examined the inter-rater reliability (IRR) of trained PACT evaluators who rated 19 candidates. As measured by Cohen’s weighted kappa, the overall IRR estimate was .17 (poor strength of agreement). IRR estimates ranged from -.29 (worse than expected by chance) to .54 (moderate strength of agreement); all were below the standard of .70 for consensus agreement. Follow up interviews of 10 evaluators revealed possible reasons we observed low IRR, such as departures from established PACT scoring protocol, and lack of, or inconsistent, use of a scoring aid document. Evaluators reported difficulties scoring the materials that candidates submitted, particularly the use of Academic Language. Cognitive Task Analysis (CTA) is suggested as a method to improve IRR in the PACT and other teacher performance assessments such as the edTPA.
ARTICLE | doi:10.20944/preprints202103.0010.v1
Subject: Business, Economics And Management, Accounting And Taxation Keywords: Project Based Learning; Scientific education; Preservice primary teacher; Emotions; Active Methodologies; Higher Education for Sustainable Development
Online: 1 March 2021 (13:13:23 CET)
The emotional dimension in education has become increasingly important in recent decades. Enhancing the emotional dimension of prospective teachers in science subjects is higher education stuff responsibility. The implementation of active methodologies could modify the traditional student-teacher roles that are encouraged by the educational policies implemented in the Bologna Process. The principal aim of this work is to describe a Project Based Learning methodology and to introduce it as potential resource for the emotional and cognitive improvement of 19 prospective primary teachers enrolled in a scientific subject. This is a qualitative study with a transversal sustainability approach in the context of a research line focused on Higher Education for Sustainable Development. A questionnaire was designed and filled by the students at two different times, before and after implementation of the activity. The initial feedback from students was surprisingly enthusiastic by the fact that they were working with rockets, despite of this is not a common emotion in the science field. The results show the emotional improvement of prospective teachers after the implementation. It is concluded that a correct science education is necessary during the training of teachers taking into account their emotional dimension and the social repercussion due to the future transmission.