College Guide

Blog

September 28, 2011 10:00 AM (Sort of) Valid Standardized Tests

By Daniel Luzer

The ACT is a good predictor of college success. Well, part of it is, at any rate. The American College Testing (ACT) examination is the competitor to the SAT examination and, like the SAT, is basically an intelligence test originally sold as a predictor of college grades. It turns out parts of the ACT predict college success quite well, but other parts are essentially irrelevant.

According to an article by Laurent Belsie in the Christian Science Monitor:

The trick: Pay attention to the math and English scores and disregard the science and reading sections. By obscuring the predictive validity of the ACT’s math and English scores, “the Reading and Science tests cause students to be inefficiently matched to schools - admitted to schools that may be too demanding - or too easy - for their levels of ability,” write authors Eric Bettinger and Brent Evans at Stanford University and Devin Pope at the University of Chicago.
For example: If student A gets scores of 26 on reading and science and 22 for math and English, their composite ACT score would be 24, the same as student B who got scores of 22 on reading and science and 26 on math and English. But student A is 59 percent more likely to drop out in the first year of college - and 43 percent more likely in the third year - than student B is.

It’s not really clear how the researchers determined the ACT’s success to such a level of exactitude, but such information is potentially interesting. The researchers predict that using only the ACT math and English scores to determine admission colleges could reduce their student dropout rates by 7 percent.

Daniel Luzer is the web editor of the Washington Monthly. Follow him on Twitter at @Daniel_Luzer.

Comments

  • John on September 28, 2011 7:50 PM:

    I guess this partly makes sense. If you are good at math and English you essentially have good reasoning skills. Science, as tested, might be more an indicator of knowledge gathered. Not sure about reading.

  • charlie don't surf on September 28, 2011 8:18 PM:

    It's not clear what they're talking about here. The article talks about 4 tests, English, Math, Reading, and Science. But there is another component, Writing. It's an essay test. I have worked as a scorer for the ACT Writing exam. It is a job only given to expert test scorers with years of experience. It is the only component of the ACT that is judged solely by human scorers who make a direct assessment of the student's intellect, using the scorer's intellect.

    So what are they talking about here? English, Writing, or both? Based on my personal experience, the Writing test is the only directly testable insight into a student's intellectual capacity and level of maturity. Multiple choice questions (as used in the English and Reading exams) can only indirectly assess a student's English ability.

  • phein on September 28, 2011 9:27 PM:

    The written is not required by most colleges (just went through the admission grinder with eldest daughter), so they must be talking about the English.