The spin begins on ACT scores

It didn’t take long after the release of state and national ACT scores for certain groups to start spinning the numbers for political gain.

Those numbers, you may recall from today’s story, showed average scores in Kansas holding pretty much steady from the year before, and still well above the national average.

Of course, some might argue that, itself, was the “spin” from the Kansas State Department of Education. And their spin was quickly followed by a news release from the Lawrence school district, indicating the average scores here were well above the state average.

It didn’t take long, however, for others to get in the game.

Mark Tallman of the Kansas Association of School boards posted today that the report was a mixed bag of results, but that overall scores in Kansas have been declining in rough correlation to the cuts in public school funding since 2009.

It’s an interesting graph, but it calls to mind the old Latin phrase, *Post hoc, ergo propter hoc” — “after this, therefore because of this.” Note that the Kansas line runs consistently above, yet parallel to, the national line, and both lines slope downward in about the same proportion, even though not all states have cut education funding by the same degree that Kansas has.

Meanwhile, the conservative think tank Kansas Policy Institute jumped into the game with a blog post of its own, reminding us that there’s always a dark cloud behind every silver lining.

Dave Trabert, executive director of KPI, makes a few good and valid points as he cautions people about making comparisons between districts, or between states, or between district and state and national averages.

The problem, he notes, is that within any of those population groups, there are glaring disparities between scores of whites, blacks, Hispanics and others. So the racial composition of any district or state will tend to skew the results.

Based on that, he goes on to point out that when you compare racial groups across states, Kansas is really not as good as it looks at first, and that Texas, with an average ACT score of 20.9, is actually doing better than Kansas, with its average score of 21.8.

Texas, by the way, often is cited by Gov. Sam Brownback’s administration as a model to emulate because it has no state income tax. It’s also the state that ranks 49th in the nation for per-pupil spending on education, which reinforces one of KPI’s key arguments about school spending — that more money doesn’t yield better performance.

To make this point, KPI often tries to use data showing that Kansas has, in its view, outrageously high per-pupil spending on schools, but that it gets only mediocre, by the group’s estimation, outcomes from it.

With regard to the ACT scores, however, KPI misses another important point. There are more variables at work than simply states and races. And that omission can lead people to believe, mistakenly, that if you simply adjust for the different racial makeup of a state or district, you can make valid comparisons.

But the ACT is not a random sample survey. The people who take the exam are not a representative sample of their ethnic subgroup in the state, or even of the college-bound members of their subgroups. ACT test-takers are an entirely self-selected group. Kids have a choice of college entrance tests they can take, and they sign up voluntarily — paying sizable sums of money — for the privilege of taking them.

In Kansas last year, where the ACT is the most popular among the two major college entrance exams, 75 percent of high school seniors took the test, even though only 65 percent of Kansas graduating seniors go on to college. Very few students here take the other major exam, the SAT.

Texas, by contrast, is a predominantly SAT state. Only about 37 percent of graduating seniors there took the ACT test last year, while about 57 percent of Texas’ graduating seniors go on to college.

So you cannot say that the average ACT scores of any group of students within a state, or an individual district, reflects the quality of education being delivered to that group, or even the college-bound subset within that group. The numbers just are what they are.

So what’s a parent, or taxpayer, to make of all this? I can only offer my purely non-expert advice:

Look at your kid’s score, whether its ACT, SAT or anything else. Is it good enough to get into college, or qualify for a scholarship? If so, fine. If not, then turn off the TV, take away the video games, sit down with them and help them study harder. Take some practice exams. Then take the test again.

More Education News

  • First Bell Blog
  • Schools and Education news