The group admits that test -
based measures of teacher effectiveness correlate, on average, for any given teacher, from one year to the next, at no better than 0.35, well below the 0.90 correlation one would in principle like to have.
Officials in Georgia, for instance, contend that the state wants to turn its teacher - quality focus toward output -
based measures of teacher effectiveness, rather than credentials.
By way of comparison, the authors note that the impact of being assigned to a teacher in the top - quartile rather than one in the bottom quartile in terms of their total effect on student achievement as measured by student - test -
based measures of teacher effectiveness is seven percentile points in reading and six points in math.
Not exact matches
Whatever the parties negotiate or King decides, the evaluation system will be
based 20 percent on standardized test scores when applicable, 20 percent on other evidence
of student learning and 60 percent on classroom observation and other
measures of teacher effectiveness, in keeping with the 2010 state law on
teacher evaluation.
It would seem that the ongoing discussions about «
teacher effectiveness» and the creation
of evaluation systems focused on
measuring a
teacher's capacity (increasingly
based on test scores) often do very little to actually develop that capacity.
But, as numerous studies have shown, having a master's degree is generally not correlated with
measures of teacher effectiveness,
based on student test scores.
As importantly, it appears that existing survey -
based measures of non-cognitive skills, although perhaps useful for making comparisons among students within the same educational environment, are inadequate to gauge the
effectiveness of schools,
teachers, or interventions in cultivating the development
of those skills.
On the
basis of these survey results, we created three
measures: (1) the principal's overall assessment
of the
teacher's
effectiveness, which is a single item from the survey; (2) the
teacher's ability to improve student academic performance, which is a simple average
of the organization, classroom management, reading achievement, and math achievement survey items; and (3) the
teacher's ability to increase student satisfaction, which is a simple average
of the role model and student satisfaction survey items.
In Table 1
of the technical report (on which Jay
bases his critique), the MET team uses evaluation
measures from 2009 - 10 to test their ability to «post-dict»
teachers»
effectiveness the previous year.
The next round must get to
measuring teacher effectiveness based on student achievement, promoting professional development that is
based on research and effective practice and improves performance, providing incentives for
teachers who are effective, and requiring removal
of teachers who, even with solid professional development, can't or don't improve.
Student - test -
based measures of teacher performance are receiving increasing attention in part because there are, as yet, few complementary or alternative
measures that can provide reliable and valid information on the
effectiveness of a
teacher's classroom practice.
Our objective is to
measure the impact
of practice -
based performance evaluation on
teacher effectiveness.
«The MET findings reinforce the importance
of evaluating
teachers based on a balance
of multiple
measures of teaching
effectiveness, in contrast to the limitations
of focusing on student test scores, value - added scores or any other single
measure,» Weingarten said.
Implement a comprehensive evaluation system for
teachers and principals
based on multiple
measures of effectiveness, including student achievement
We analyzed scores on the inventory descriptively and used them to predict time - use data collected via in - person observations, a survey -
based measure of job stress, and
measures of perceived job
effectiveness obtained from assistant principals and
teachers in the school.
Since it may take a couple
of years for states and districts to follow the department's urging and set up systems that will allow them to
measure teacher effectiveness based on growth in student achievement, she said, states should be required to show that they are making good on the language about equitable distribution
of teachers that's already in the No Child Left Behind Act.
In addition, the U.S. Department
of Education strongly pressured states to adopt controversial policies expanding charter schools and
measuring teacher effectiveness on the
basis of student test scores.
Basis Policy Research and ATI have built a partnership supporting the fair evaluation
of educator
effectiveness by implementing mathematical models that include multiple
measures of student growth and which evaluate educator
effectiveness using techniques that take into account a variety
of factors that may impact student learning but over which the
teacher has no influence.
Setting aside the fact that the AFQT does not
measure teacher effectiveness, it is insulting and demeaning to argue that
teachers are not smart enough to receive market compensation comparable to their peers
based on the results
of a test that most
of them took as teenagers.
Put differently, what VAM -
based data provide, in general, «are incredibly imprecise and inconsistent
measures of supposed
teacher effectiveness for only a tiny handful [30 - 40 %]
of teachers in a given school» (see reference here).
We propose federal support to help states
measure the
effectiveness of individual
teachers —
based on their impact on student achievement, subjective evaluations by principals and peers, and parental evaluations.
It implemented a performance -
based compensation system combining student growth and achievement
measures with 23
measures of school
effectiveness, such as positive school culture, effective parent engagement, and
teacher leadership.
But the error rate
of these «value - added
measures» may be lower than the error rate
of classifications
based on traditional
measures of teacher effectiveness such as licensure status or years
of experience.
Along with creating and sharing quality examples
of standards -
based learning and teaching, the secondary goal
of this project is to demonstrate how theatre educators — classroom
teachers and teaching artists alike — can
measure the
effectiveness of their teaching and the learning
of students.»
We
measure growth and
effectiveness of teachers in many cases
based upon their students» growth and performance on these tests, so it makes sense to use the results as a baseline for students at the start
of the school year.
It also will be recommended that local boards only grant tenure to
teachers who achieve at least an «effective
teacher» rating on the new multiple -
measure teacher effectiveness evaluation,
of which a significant portion will be
based on student achievement data.
«The MET findings reinforce the importance
of evaluating
teachers based on a balance
of multiple
measures of teaching
effectiveness, in contrast to the limitations
of focusing on student test scores, value - added scores, or any other single
measure,» AFT President Randi Weingarten said in a statement.
Furthermore, they should evaluate
teacher effectiveness based on multiple
measures of both practice and outcomes that are considered in an integrated fashion, including:
Also recall that one
of the key reports that triggered the current call for VAMs, as the «more objective»
measures needed to
measure and therefore improve
teacher effectiveness, was
based on data that suggested that «too many
teachers» were being rated as satisfactory or above.
In addition, and as directly related to VAMs, in this study researchers also found that each rating from each
of the four domains, as well as the average
of all ratings, «correlated positively with student learning [gains, as derived via the Nevada Growth Model, as
based on the Student Growth Percentiles (SGP) model; for more information about the SGP model see here and here; see also p. 6
of this report here], in reading and in math, as would be expected if the ratings
measured teacher effectiveness in promoting student learning» (p. i).
This research brief considers the stability
of value - added
measures of teacher effectiveness over time and the resulting implications for the design and implementation
of performance -
based teacher compensation schemes.
We use longitudinal data from Washington State to provide estimates
of the extent to which performance on the edTPA, a performance -
based, subject - specific assessment
of teacher candidates, is predictive
of the likelihood
of employment in the
teacher workforce and value - added
measures of teacher effectiveness.
Proponents argue that using student scores on curriculum -
based tests as a
measure of school
effectiveness encourages
teachers to teach the curriculum.
On the eve
of the administration
of SBAC testing in our State, it has become clear to me, as interim Commissioner
of Education, that there is much validity embedded in the much - heated controversy surrounding Common Core State Standards, mandated standardized testing to
measure progress on those standards, and the intended practice
of evaluating
teacher effectiveness based on those student test results.
For the first time, an objective
measure of teacher effectiveness —
based on standardized tests that
measure student learning — will be part
of annual evaluations.
Unsurprisingly, we find that layoffs determined by a
measure of teacher effectiveness result in a more effective workforce than would be the case with seniority -
based layoffs.
First, assuming readily available
measures of teacher effectiveness actually
measure true
teacher effectiveness, an assumption to which we return below, the differences between seniority and
effectiveness -
based layoffs are larger and more persistent than we anticipated.
It's why the use
of VAM (Value Added
Measures) can not contribute valid or reliable data to a
teacher's
effectiveness rating — because VAM is a predictive model
based on comparing a set
of actual student test scores against a hypothetical group
of scores.