A central part of much of the teacher quality discussion has been the use of value -
added measures of quality.
Not exact matches
In recognizing the provision
of non — breast milk fluids to breastfed infants as a
quality -
of - care issue, in 2010, The Joint Commission, a major organization that accredits and certifies U.S. hospitals,
added exclusive breast milk feeding during the newborn's entire hospitalization as a new
quality of care
measure.
She
added that other
measures were also needed to ensure that older people's welfare remained a top political priority, such as improving the standards
of care services and action to enhance the
quality of life for the 500,000 people in residential care homes.
A new generation
of researchers who think about how best to
measure variables such as patient preferences and
quality -
of - life issues is coming
of age now, McDonald
adds.
It could be used to help decide which patients could benefit from being enrolled into clinical trials, as well as to
measure the
quality of care, he
added.
Romance isn't only
measured by the
quality of quantity
of sex in your life, but it begins with
adding random kind gestures into your activity list.
The debate about «value
added»
measures of teaching may be the most divisive topic in teacher -
quality policy today.
Important work by Stanford University researcher Raj Chetty and his colleagues finds that value -
added measures of teacher
quality predict students» outcomes long into the future.
The researchers assessed teacher
quality by looking at value -
added measures of teacher impact on student test scores between the 2000 — 01 and 2008 — 09 school years.
In essence, therefore, our two
measures of teaching
quality reflect, in the first case, value
added (or «deep learning») that is transferrable to subsequent classes in the subject, and, in the second case, inspiration, as indicated by the ability to convert students to a subject that they had not previously planned on studying in depth.
We see the same lack
of a relationship when we instead
measure instructor
quality using the «conversion rate» — an indicator capturing a very different aspect
of instructor
quality than the value -
added measure does.
Figure 1 compares our value -
added measure of teaching
quality to the probability
of being recognized for one's research.
Therefore, the difference between the 25th and 75th percentile
of the teacher
quality distribution,
measured in terms
of value -
added, is just three percentile points in the h - index distribution (and the opposite signed relationship as seen with the other
measure of research
quality).
Using the full population
of all first - year undergraduates enrolled at Northwestern between fall 2001 and fall 2008 (over 15,000 students in all), we empirically generate two new
measures of teaching
quality — one an indicator
of inspiration (the rate
of «conversion»
of non-majors to majors) and the other an indicator
of deep learning (the degree to which a professor
adds lasting value to students» learning that is reflected in success in future classes).
Figure 3 compares our value -
added measure of teaching
quality to a faculty member's percentile rank in the field - adjusted h - index.
The average gap in school
quality between these groups would be eliminated in the first step
of the two - step value -
added procedure, and thus would not carry over to the estimated growth
measures.
In addition, our analysis does not compare value
added with other
measures of teacher
quality, like evaluations based on classroom observation, which might be even better predictors
of teachers» long - term impacts than VA scores.
Recent research has shown that high -
quality early - childhood education has large impacts on outcomes such as college completion and adult earnings, but no study has identified the long - term impacts
of teacher
quality as
measured by value
added.
The correlation between teacher effectiveness (as demonstrated by value -
added student growth
measures) and student life outcomes (higher salaries, advanced degrees, neighborhoods
of residence, and retirement savings) is staggering; it's not an exaggeration to say that great teachers substantially improve students» future
quality of life and those students» contributions to the common good.
The Scholars» Paradise model would use «scale scores» or a «performance index» for the «academic achievement» indicator;
measure growth using a two - step value -
added metric; pick robust «indicators
of student success or school
quality,» such as chronic absenteeism; and make value
added count the most in a school's final score.
The stability
of value -
added measures of teacher
quality and implications for teacher compensation policy.
What reformers should do is develop the tools that can allow families to make school overhauls successful; this includes building comprehensive school data systems that can be used in
measuring success, and continuing to advance teacher
quality reforms (including comprehensive teacher and principal evaluations based mostly on value -
added analysis
of student test score growth data, a subject
of this week's Dropout Nation Podcast) that can allow school operators
of all types to select high -
quality talents.
Two academic researchers from the University
of Southern California and the University
of Pennsylvania looked at these value -
added measures in six districts around the nation and found that there was weak to zero relationship between these new numbers and the content or
quality of the teacher's instruction.
She also notes that if her system contradicts teachers» value -
added scores, this too should «raise red flags» about the
quality of the teacher, although she does not (in this article) pay any respect or regard for the issues not only inherent in value -
added measures but also her observational system.
KNOWLEDGE BRIEF 13 by Susanna Loeb In an effort to improve educational outcomes, states and districts across the country are collecting value -
added measures to assess the
quality of their teachers.
As per an article published last week in The Columbus Dispatch, the Ohio Department
of Education (ODE) apparently rejected a proposal made by the state's pro-charter school Ohio Coalition for
Quality Education and the state's largest online charter school, all
of whom wanted to
add (or replace) this state's VAM with another, unnamed «Similar Students»
measure (which could be the Student Growth Percentiles model discussed prior on this blog, for example, here, here, and here) used in California.
If we are going to use value -
added measures to make judgments about teacher
quality, we owe it to these teachers, to their students, and to the public to do all we can to ensure that the means
of computing them are accurate, reliable and fair.
Recent Vamboozled posts have focused on one
of the
qualities of the achievement tests used as the key
measures in value -
added models (VAMs) and other «growth» models.
That «value -
added (VA)
measures of teacher
quality show very consistent properties across different settings» is that on which Chetty et al. focus first and foremost.
«California teacher preparation programs are assessed using a wide array
of measures of program
quality,» he continued,
adding that the Commission is «committed to remaining a nationwide leader in educator preparation in order to ensure California students have a well - prepared and exceptionally qualified educator workforce.»
The Commission
of Higher Education is working to: 1) improve the
quality of teacher preparation and performance; 2) open the level
of dialogue among superintendents and principals and higher education teacher preparation programs; 3) expand communication among vertical teams in P - 16 to support students entering post-secondary education; and 4) review and
measure learning outcomes at all levels, including higher education and demonstrate significant value -
added for post-secondary options.
As Dropout Nation noted last week in its report on teacher evaluations, even the most - rigorous classroom observation approaches are far less accurate in identifying teacher
quality than either value -
added analysis
of test score data or even student surveys such as the Tripod system used by the Bill & Melinda Gates Foundation as part
of its
Measures of Effective Teaching project.
The report is certain to
add fuel to the fire in the ongoing debate in California and elsewhere over how to
measure teacher
quality and the effort or resistance
of some government bodies to tie teacher evaluations to standardized test scores.
New standards have been
added for testing theory, describing interventions,
measuring the
quality of implementation, documenting adaptations in the field, reporting study results, and evaluating outcomes
of scale - up efforts.
For those
of you who are not familiar with Linda Darling - Hammond, or her extensive career as one
of the best, brightest, and most influential scholars in the academy
of education, she is the nation's leading expert on issues related to teacher
quality, teacher recruitment and retention, teacher preparation, and, related, teacher evaluation (e.g., using value -
added measures).
«It is a telling moment when the voice
of the nation's employers, the CBI,
adds its weight to the calls for the government to act to redress the problems caused by legislation which is not supported by sufficient statutory guidance to schools, with inadequate accountability
measures, and far too laissez - faire an approach to
quality assurance.»
Earlier studies released by the MET project had examined three potential
measures of teacher
quality: observations
of teachers keyed to teaching frameworks, surveys
of students» perceptions
of their teachers, and a value -
added method, which attempts to isolate teachers» contributions to their students» academic achievement.
As a statistical tool, «value -
added» assessment is not a perfect
measure of teacher
quality.
Experienced teachers who meet or exceed standards
of teacher
quality may also qualify for tenure, which provides an
added measure of job security.
Unlike prior research, we directly assess teacher
quality with value -
added measures of impacts on student test scores, using administrative data on 33,000 teachers in Florida public schools.
Recently, I posted a critique
of the newly released and highly publicized Mathematica Policy Research study about the (vastly overstated) «value»
of value -
added measures and their ability to effectively
measure teacher
quality.
I have reviewed the next
of nine articles (# 3
of 9) here, titled «Exploring the Potential
of Value -
Added Performance
Measures to Affect the
Quality of the Teacher Workforce» as authored by Dan Goldhaber — Professor at the University
of Washington Bothell, Director
of the National Center for Analysis
of Longitudinal Data in Education Research (CALDER), and a Vice-President at the American Institutes
of Research (AIR).
Exploring the potential
of value -
added performance
measures to affect the
quality of the teacher workforce.
The panelists — including Arkansas's Fort Smith Public Schools Superintendent Benny Goodman and the National Center for Learning Disabilities's Laura Kaloi — also advocated for using multiple assessment
measures to judge school
quality,
adding more flexibility for improving low - performing schools, maintaining a focus on holding schools accountable for the performance
of student subgroups, tracking student growth, and ensuring states set high standards.
When using value
added, allow educational leaders to make judgments in interpreting the value -
added results in light
of other available
measures of teacher
quality and the principals» own assessments.
However, Steinberg's bill was an extremely technical piece
of legislation, which proposed a complex new accountability system that
adds graduation rates and other
measures to the API to establish a new index to be called the Education
Quality Index.
In this paper we examine the mobility
of early - career teachers
of varying
quality,
measured using value -
added estimates
of teacher performance.
And research finds high levels
of correlation between value -
added measures based on test scores and high -
quality, observation - based evaluation methodologies that focus specifically on instructional practice rather than outcomes.
The report notes that evaluations are most effective when value
added scores are combined with other classroom
measures, such as observations — which provide opportunities for school leaders and line managers to see teachers in action — and surveys
of pupils about the
quality of teaching they receive.
We also present qualitative evidence that loan - forgiveness recipients were
of higher
quality (as
measured by value
added) than nonrecipients who taught in the same subject but were not certified and thus ineligible.