Learn more, test more?

Here's an interesting thing I read in the New York Times: to learn more effectively, testing seems to help, if done in the right way:

Taking a test is not just a passive mechanism for assessing how much people know, according to new research. It actually helps people learn, and it works better than a number of other studying techniques.

The research, published online Thursday in the journal Science, found that students who read a passage, then took a test asking them to recall what they had read, retained about 50 percent more of the information a week later than students who used two other methods.

One of those methods — repeatedly studying the material — is familiar to legions of students who cram before exams. The other — having students draw detailed diagrams documenting what they are learning — is prized by many teachers because it forces students to make connections among facts.

These other methods not only are popular, the researchers reported; they also seem to give students the illusion that they know material better than they do.

In the experiments, the students were asked to predict how much they would remember a week after using one of the methods to learn the material. Those who took the test after reading the passage predicted they would remember less than the other students predicted — but the results were just the opposite.

“I think that learning is all about retrieving, all about reconstructing our knowledge,” said the lead author, Jeffrey Karpicke, an assistant professor of psychology at Purdue University. “I think that we’re tapping into something fundamental about how the mind works when we talk about retrieval.”

Now here is the part I found interesting, especially the section I have place in bold type:

The second experiment focused only on concept mapping and retrieval practice testing, with each student doing an exercise using each method. In this initial phase, researchers reported, students who made diagrams while consulting the passage included more detail than students asked to recall what they had just read in an essay.

But when they were evaluated a week later, the students in the testing group did much better than the concept mappers. They even did better when they were evaluated not with a short-answer test but with a test requiring them to draw a concept map from memory.

Why retrieval testing helps is still unknown. Perhaps it is because by remembering information we are organizing it and creating cues and connections that our brains later recognize.

“When you’re retrieving something out of a computer’s memory, you don’t change anything — it’s simple playback,” said Robert Bjork, a psychologist at the University of California, Los Angeles, who was not involved with the study.

But “when we use our memories by retrieving things, we change our access” to that information, Dr. Bjork said. “What we recall becomes more recallable in the future. In a sense you are practicing what you are going to need to do later.”

It may also be that the struggle involved in recalling something helps reinforce it in our brains.

Maybe that is also why students who took retrieval practice tests were less confident about how they would perform a week later.

“The struggle helps you learn, but it makes you feel like you’re not learning,” said Nate Kornell, a psychologist at Williams College. “You feel like: ‘I don’t know it that well. This is hard and I’m having trouble coming up with this information.’ ”

By contrast, he said, when rereading texts and possibly even drawing diagrams, “you say: ‘Oh, this is easier. I read this already.’ ”

...Testing, of course, is a highly charged issue in education, drawing criticism that too much promotes rote learning, swallows valuable time for learning new things and causes excessive student anxiety.

“More testing isn’t necessarily better,” said Dr. Linn, who said her work with California school districts had found that asking students to explain what they did in a science experiment rather than having them simply conduct the hands-on experiment — a version of retrieval practice testing — was beneficial. “Some tests are just not learning opportunities. We need a different kind of testing than we currently have.”

Dr. Kornell said that “even though in the short term it may seem like a waste of time,” retrieval practice appears to “make things stick in a way that may not be used in the classroom.

“It’s going to last for the rest of their schooling, and potentially for the rest of their lives.”

Now, notice that this testing is not the sort that one sees on standardized tests, because let's face it. If those tests increased learning, the current batch of students we have now, who have spent their entire lives being tested, would show truly startling gains in retention and understanding.

This goes back to what I have said previously, about the struggle to learn new material being a vital part of the learning process-- a learning process we have crippled for fear of misinterpreting the concept of "stress."

But, if I understand this correctly, and this is just a preliminary reading of this type of experiment, the implications for us as educators is to change the way that we present testing to the students and parents. We need to stop reinforcing the idea that the test is the end of the work with the material, and instead drive home the point that a test is yet another opportunity for learning. This gets back to the question of what our goals in education really are. Are the information and skills that we present only useful in accumulating credits and grades, or are we aiming to encourage and develop the lifelong use of knowledge, and eventually more capable students, workers, and citizens?

This gives us a lot to think about.

Idiocy from the Education Dept. Bureaucracy vs. a principal who did everything she could

Oooooh, this makes my blood boil. Read the whole thing-- it's worth it.

From the New York Times:

BURLINGTON, Vt. — It’s hard to find anyone here who believes that Joyce Irvine should have been removed as principal of Wheeler Elementary School.

John Mudasigana, one of many recent African refugees whose children attend the high-poverty school, says he is grateful for how Ms. Irvine and her teachers have helped his five children. “Everything is so good about the school,” he said, before taking his daughter Evangeline, 11, into the school’s dental clinic.

Ms. Irvine’s most recent job evaluation began, “Joyce has successfully completed a phenomenal year.” Jeanne Collins, Burlington’s school superintendent, calls Ms. Irvine “a leader among her colleagues” and “a very good principal.”

Beth Evans, a Wheeler teacher, said, “Joyce has done a great job,” and United States Senator Bernie Sanders noted all the enrichment programs, including summer school, that Ms. Irvine had added since becoming principal six years ago.

“She should not have been removed,” Mr. Sanders said in an interview. “I’ve walked that school with her — she seemed to know the name and life history of every child.”

Ms. Irvine wasn’t removed by anyone who had seen her work (often 80-hour weeks) at a school where 37 of 39 fifth graders were either refugees or special-ed children and where, much to Mr. Mudasigana’s delight, his daughter Evangeline learned to play the violin.

Ms. Irvine was removed because the Burlington School District wanted to qualify for up to $3 million in federal stimulus money for its dozen schools.

And under the Obama administration rules, for a district to qualify, schools with very low test scores, like Wheeler, must do one of the following: close down; be replaced by a charter (Vermont does not have charters); remove the principal and half the staff; or remove the principal and transform the school.

And since Ms. Irvine had already “worked tirelessly,” as her evaluation said, to “successfully” transform the school last fall to an arts magnet, even she understood her removal was the least disruptive option.

“Joyce Irvine versus millions,” Ms. Irvine said. “You can buy a lot of help for children with that money.”

Burlington faced the difficult choice because performance evaluations for teachers and principals based on test results, as much as on local officials’ judgment, are a hallmark of the two main competitive grant programs the Obama administration developed to spur its initiatives: the stimulus and Race to the Top.

“I was distraught,” said Ms. Irvine, 57, who was removed July 1. “I loved being principal — I put my heart and soul into that school for six years.” Still, she counts herself lucky that the superintendent moved her to an administrative job — even if it will pay considerably less.

“I didn’t want to lose her, she’s too good,” Ms. Collins said, adding that the school’s low scores were the result of a testing system that’s “totally inappropriate” for Wheeler’s children.

Justin Hamilton, a spokesman for the United States Department of Education, noted that districts don’t have to apply for the grants, that the rules are clear and that federal officials do not remove principals. But Burlington officials say that not applying in such hard times would have shortchanged students.

At the heart of things is whether the testing system under the federal No Child Left Behind Act of 2001 can fairly assess schools full of middle-class children, as well as a school like Wheeler, with a 97 percent poverty rate and large numbers of refugees, many with little previous education.

President Obama’s Blueprint for Reform says that “instead of a single snapshot, we will recognize progress and growth.” Ms. Collins says if a year’s progress for each student were the standard, Wheeler would score well. However, the reality is that measuring every student’s yearly growth statewide is complex, and virtually all states, including Vermont, rely on a school’s annual test scores.

Under No Child rules, a student arriving one day before the state math test must take it. Burlington is a major resettlement area, and one recent September, 28 new students — from Somalia, Ethiopia, Kenya, Sudan — arrived at Wheeler and took the math test in October.

Ms. Irvine said that in a room she monitored, 15 of 18 randomly filled in test bubbles. The math tests are word problems. A sample fourth-grade question: “Use Xs to draw an array for the sum of 4+4+4.” Five percent of Wheeler’s refugee students scored proficient in math.

About half the 230 students are foreign-born, collectively speaking 30 languages. Many have been traumatized; a third see one of the school’s three caseworkers. During Ms. Irvine’s tenure, suspensions were reduced to 7 last year, from 100.

Students take the reading test after one year in the country. Ms. Irvine tells a story about Mr. Mudasigana’s son Oscar and the fifth-grade test.

Oscar needed 20 minutes to read a passage on Neil Armstrong landing his Eagle spacecraft on the moon; it should have taken 5 minutes, she said, but Oscar was determined, reading out loud to himself.

The first question asked whether the passage was fact or fiction. “He said, ‘Oh, Mrs. Irvine, man don’t go on the moon, man don’t go on the back of eagles, this is not true,’ ” she recalled. “So he got the five follow-up questions wrong — penalized for a lack of experience.”

Thirteen percent of foreign-born students, 4 percent of special-ed students and 23 percent of the entire school scored proficient in reading.

Before Mr. Obama became president, Burlington officials began working to transform Wheeler to an arts magnet, in hopes of improving socioeconomic integration.

While doing her regular job, Ms. Irvine also developed a new arts curriculum. She got a grant for a staff trip to the Kennedy Center in Washington for arts training. She rented vans so teachers could visit arts magnets in nearby states. She created partnerships with local theater groups and artists. In English class, to learn characterization, children now write a one-person play and perform it at Burlington’s Very Merry Theater.

A sign of her effectiveness: an influx of new students, so that half the early grades will consist of middle-class pupils this fall.

Ms. Irvine predicts that in two years, when these new “magnet” students are old enough to take the state tests, scores will jump, not because the school is necessarily better, but because the tests are geared to the middle class.

Senator Sanders said that while the staff should be lauded for working at one of Vermont’s most challenging schools, it has been stigmatized.

“I applaud the Obama people for paying attention to low-income kids and caring,” said Mr. Sanders, a leftist independent. “But to label the school as failing and humiliate the principal and teachers is grossly unfair.”

The district has replaced Ms. Irvine with an interim principal and will conduct a search for a replacement.

And Ms. Irvine, who hoped to finish her career on the front lines, working with children, will be Burlington’s new school improvement administrator.

“Her students made so much progress,” Ms. Collins said. “What’s happened to her is not at all connected to reality.”

The story about the immigrant child and the passage about Neil Armstrong reminded me of that film The Gods Must Be Crazy. And the gods at the Education Department (many of whom have spent zero time in a classroom themselves) must be crazy to think that Bush administration policies that require new immigrants to be proficient in reading within a year should continue to be inflicted upon American students and public schools.

Throughout history our schools have been at the front lines of assimilating the children of immigrants to American culture. Most history books point to these successes when discussing the great waves of immigration that have swept over the United States since its inception. Yet how might that success have been viewed if test scores were the sole determination?

We teachers know our students as individuals. But schools with low student test scores are all lumped into a single category of failure regardless of the circumstances.

Where's some of that change you promised, President Obama?

Is this really necessary?

So it's not enough to run the PSAT, the SAT, and all the AP tests. Now the College Board seeks to traumatize eighth graders, too. From US News' education blog:

College Board, the owner of the SAT, is introducing a new standardized test next fall for students in the eighth grade. Like the PSAT for 10th graders, the new test, known as ReadiStep, will gauge the skills of eighth graders in mathematics, critical reading, and writing. The College Board says the scores won't be used for admissions or merit aid decisions. Only students and their schools will receive the results. The goal, officials say, is to provide feedback to school districts that want to prepare more students for college before they reach high school. "What makes this assessment valuable and not just another test is its instructional relevance," Lee Jones, a vice president of College Board, said this week in announcing the new test.

The National Center for Fair & Opening Testing, which is generally opposed to standardized testing, released a statement calling the new test "a cynical marketing ploy designed to enhance test-maker revenues, not improve access to higher education." Eighth graders already take statewide assessments that determine how well they have mastered math, reading, and writing skills. Robert Schaeffer, the center's public education director, questioned the value of another test. "The new exam will only accelerate the college admissions 'arms race' and push it down onto even younger children," he said.

College Board officials emphasized that school districts asked for the assessment. They also said the test is tied to rigorous national standards, so the results would offer a more reliable picture of students' abilities than state tests. "We feel confident enough from talking to College Board member institutions that they are excited about the test," Jones said, although he would not name or identify how many school districts asked the agency to develop such a test. College Board says it expects school districts, not students, to pay for the exams, although the exam fee has not been set yet. The two-hour, multiple-choice tests will be offered to students during a two-week window in the fall or the spring. Teachers, who will proctor the exams, will receive the results in four weeks.

Wow. What exactly is the purpose of this? Kids take the PSAT because it's actually the NMSQT-- the National Merit Scholarship Qualifying Test. It's also interesting that this is coming out right at the time that some colleges are turning their backs on standardized test scores as admission scores.