Second, the pattern of results in that paper supports my argument about the disconnect
between test score gain and changes in later - life outcomes.
Last week, I argued that Hitt, McShane, and Wolf erred in including programs in their review of «school choice» studies that were only incidentally related to school choice or that have idiosyncratic designs that would lead one to expect a mismatch
between test score gains and long - term impacts (early college high schools, selective enrollment high schools, and career and technical education initiatives).
In a regression to predict student test score gains using out of sample test score gains for the same teacher, student survey results, and classroom observations, there is virtually no relationship
between test score gains and either classroom observations or student survey results.
Not exact matches
They scale the
gain in black students»
scores by the standard deviation of
test scores computed for a select sample of students, and observe that the
gain in their
scores due to attending private school is «roughly one - third of the
test -
score gap
between blacks and whites nationwide.»
What explains this disconnect
between math and reading
test score gains and later - life outcomes?
Each dot represents a school, and the diagonal line shows the overall relationship
between test -
score gains and fluid cognitive ability across the full sample of schools.
The correlations
between our summary measure of fluid cognitive ability and
test -
score gains in math and reading were 0.32 and 0.18, respectively.
Second, even in the absence of such behaviors, the correlation
between test -
score gains and improvements in long - term outcomes has not been conclusively established.
A compelling way to see this is to look at the relationship across schools
between the average
test -
score gain students make
between the 4th and 8th grade and our summary measure of their students» fluid cognitive ability at the end of that period (see Figure 2).
In addition, the differences in
test -
score gains between bottom - and top - quartile students on each non-cognitive skill amount to almost a full year's worth of learning in math over the middle school years.
This statistically significant difference of -0.23 standard deviations is in the opposite direction of that expected, based on the student - level relationships
between self - control and
test -
score gains displayed above.
For example, the effect of a one - hour later start time on math
scores is roughly 14 percent of the black - white
test -
score gap, 40 percent of the gap
between those eligible and those not eligible for free or reduced - price lunch, and 85 percent of the
gain associated with an additional year of parents» education.
Figures 1a, 1b, and 1c compare the average number of absences, the share of students who were suspended, and the average
test -
score gains between fourth and eighth grade of students who ranked in the bottom - and top - quartile on each skill.
The report by the NRC committee claims that
gains in
test scores on the National Assessment of Educational Progress (NAEP)
between 2007 and 2009 were no better than in the ten other school districts for which comparable data is available.
A
gain score is the difference
between two
test scores, each of which is subject to measurement error.
Overall, the 0.12 correlation
between new expenditure and
test -
score gain is just barely positive.
We estimate that improvement from the 25th to the 75th percentile of
test -
score change — that is, moving from a loss of 4 percentile points to a
gain of 3.8 percentile points
between 1999 and 2000 — produced on average an increase of 3 percentage points in an incumbent's vote share.
They found that in both math and science, the positive relationship
between lecture - style methods and
test score gains was maintained.
Contrast this information with what we know about the relationship
between credentials and classroom effectiveness, as measured by student
test -
score gains.
To sum up: 1) low - stakes
tests appear to measure something meaningful that shows up in long - run outcomes; 2) we don't know nearly as much about high - stakes exams and long - run outcomes; and 3) there doesn't seem to be a strong correlation
between test -
score gain and other measures of quality at either the teacher or school level.
This year, the state of California distributed $ 100 million to teachers in schools that started with
test scores in the bottom half of schools in 1999 and achieved large
gains in performance
between 1999 and 2000.
Also, there is much information to be
gained from having individual conversations with students who have these contradictions
between their standardized
test scores and their classroom grades and performance.
There are a range of tools that researchers could use here — value - added measures that distinguish
between the level of a school's
test scores and
gains of students on
test scores (
gains probably are what parents care about, and levels are a noisy signal of
gains), school climate surveys, teacher observation instruments, descriptions of curricula.
It's time that people start paying a lot more attention to this pattern of a disconnect
between short term
test score gains and long term life outcomes.
In DC ~ schools chancellor Michelle Rhee boasted that all subgroups improved reading and math
test scores between 2007 and 2010 ~ with low - income and minority high school students showing double - digit
gains.
For example, research on a privately funded school voucher program in New York City provides some evidence in favor of a link existing
between test scores and longer - term outcomes, where vouchers raised
test score gains and increased the likelihood of graduating from high school and enrolling in college.
No significant correlation was found
between increased spending on education and
test score gains.
Had competition
between private schools been maximising the quality of education each provided to its voucher students, we would not have observed such a large
gain in
test scores once schools knew their results would be made public.
In only 3 of the 8 models presented is there any statistically significant relationship
between either classroom observations or student surveys and
test score gains (I'm excluding the 2 instances were they report p <.1 as statistically significant).
Among the facts from the National Assessment of Educational Progress (NAEP) Fourth Grade Reading report cited by FairTest: — There has been no
gain in NAEP grade four reading performance nationally since 1992 despite a huge increase in state - mandated
testing; — NAEP
scores in southern states, which test the most and have the highest stakes attached to their state testing programs, have declined; — The NAEP score gap between white children and those from African American and Hispanic families has increased, even though schools serving low - income and minority - group children put the most emphasis on testing; and — Scores of children eligible for free lunch programs have dropped since
scores in southern states, which
test the most and have the highest stakes attached to their state
testing programs, have declined; — The NAEP
score gap
between white children and those from African American and Hispanic families has increased, even though schools serving low - income and minority - group children put the most emphasis on
testing; and —
Scores of children eligible for free lunch programs have dropped since
Scores of children eligible for free lunch programs have dropped since 1996.
Those with fewer computers were seeing larger educational
gains, as measured by PISA
test score changes
between 2009 and 2012.
From Chetty et al.'s research, we have estimates of the relationship
between cognitive outcomes in kindergarten, measured as percentile
test score gains, and dollar
gains in adult earnings.
«The magnitude of the
test -
score gains from one year are equivalent to 10 percent to 20 percent of the achievement gap
between minority and white students,» reads the report.
While there were no significant overall
gains among students of other ethnic groups, black students in their second year of private - school attendance improved their
test scores by 6.3 percentile points — a striking advance at a time when schools around the country are trying to close a persistent gap
between scores of white and black students.
Following
test scores from year to year in the same grade, the study finds that statewide improvements in standard Connecticut Mastery Test (CMT) scores reported by the Connecticut State Department of Education (SDE) between 2008 and 2009 — the period of the largest reported gains — were largely the result of the exclusion of students with disabilities from these standard test results, rather than overall improvements in performa
test scores from year to year in the same grade, the study finds that statewide improvements in standard Connecticut Mastery
Test (CMT) scores reported by the Connecticut State Department of Education (SDE) between 2008 and 2009 — the period of the largest reported gains — were largely the result of the exclusion of students with disabilities from these standard test results, rather than overall improvements in performa
Test (CMT)
scores reported by the Connecticut State Department of Education (SDE)
between 2008 and 2009 — the period of the largest reported
gains — were largely the result of the exclusion of students with disabilities from these standard
test results, rather than overall improvements in performa
test results, rather than overall improvements in performance.
In a study of three districts using standards - based evaluation systems, researchers found significant relationships
between teachers» ratings and their students»
gain scores on standardized
tests, and evidence that teachers» practice improved as they were given frequent feedback in relation to the standards.
While white, black and Hispanic children all made modest
test score gains in DC since 2003, the Rhee agenda has not significantly narrowed achievement gaps
between the various demographic groups, nor has it brought disadvantaged DC youth up to the national average
scores for peers of their same race and class in other cities.
The E. M. Kauffman funded Philliber Research Associates evaluation of the CDF Freedom Schools program in Kansas City conducted
between 2005 - 2007 indicates children who attend CDF Freedom Schools programs
score significantly higher on standardized reading achievement
tests than children who attend other summer enrichment programs; African American middle schools boys made the greatest
gains of all.
But in math, there was no consistent relationship
between teachers who had passing
scores on the edTPA and student
test -
score gains.
Competitive effects studies may have high external validity, but they have lower internal validity than RCTs, meaning we don't have as much confidence as we would with RCTs that there is a causal relationship
between school choice programs and
test score gains by students who remain in public schools.
In a comparative study of
test scores in states showing changes in the number of librarians
between 2004 and 2009, Lance and Hofschire (2011) determined states which
gained school librarians demonstrated a greater rise in reading
scores while states that lost librarians had an overall decline in reading
scores.
After controlling for poverty and
test scores from previous years, the Responsive Classroom (RC) approach contributed to the
gains in both reading and math, with a greater difference
between the intervention and control schools seen in math.