Friday, September 11, 2009

Congratulations: I may be wrong

I have been ranting (particularly here and here) that Texas' implementation of NCLB is doing a disservice to above average students. I am perplexed, but delighted, to report evidence that I have been wrong. Apparently, Texas students have been making remarkable gains in passing Advanced Placement exams.

The TEA has reported strong gains in AP pass rates, and the gains among some minority groups are truly spectacular. Being the cynic that I am, I had first assumed that the results were a consequence of fewer students taking the exams. But, according to the report, these gains while the number of students taking the exams has increased. So this positive result does not (immediately) look like the result of statistical manipulation.

My skepticism remains, and there are a few things to check out. But at the moment we have some good news, and I will take it as such.

It will be interesting to learn how these gains were distributed throughout the State. Do they come from a few school districts, and are those districts doing something unusual? If anyone knows where I can get this data, please let me know.

Wednesday, September 9, 2009

Schools are not a battleground

I have expressed in my posts here numerous criticisms of parts of our public education system. I have also expressed views about religion (I'm an atheist) that many people in my community would find anathema. At the same time, I am training to be a high school math teacher here in north Texas. Naturally, this can raise some legitimate concerns among potential colleagues, employers and student families when I start working. The goal of this post is the persuade even those who oppose everything I've stood for here that they have nothing to worry about with me in the classroom.

Why I want to teach

First of all my reasons for going into teaching are that I love explaining things and transferring knowledge. I believe that education is important in our society to help deliver on the promise of equal opportunity. Slightly more controversially I believe that for democracy to work the public needs to be educated to at least the point where they can meaningfully participate in the decisions we face. And even more controversially, I believe that public education plays an assimilatory role, preventing extreme fragmentation of society along ethnic, religious or linguistic lines. But if one sentence could sum up the feelings that drive me to be a teacher it would be a line from an old song:

I hear babies crying, I watch them grow, they will learn more than I'll ever know. And I think to myself, what a wonderful world. —Louis Armstrong

But stepping down from those lofty reasons, my job as a math teacher will be to teach math. I am one of those weirdos who really loves math. But I also love history, science and language and literature. I love thinking and ideas. But given my skills and what needs there are to fill, I can make the biggest contribution by teaching math. Teaching math will be my job and my mission.

Make things easier, not harder

Anyone who cares deeply about education, and I hope that that is true of every teacher, will have strong opinions about how we do things. Some of those opinions will include disagreements. But it helps no one to stir up trouble just to make a point. It only makes it harder for everyone to do their job.

A few individuals with their own political or religious agendas like to fight their battles in the schools. Whether it is people who object to the addition of under God to the Pledge of Allegiance or people who want school led prayer, they oughtn't make things harder for schools to do their jobs. I have little sympathy for those people, even where I might agree with their cause in principle. Ideally, I would like to see the Pledge restored to its original form, but I'm not going to make a fuss about it. Forcing school districts to spend real time and real money fighting a largely symbolic battle is destructive to our educational goals, angers people, and needlessly divides our community.

My concerns about the impacts of accountability requirements will not stop me from doing my job and focusing my efforts where state law and policy tell me to focus my efforts. Forgive me for waxing philosophical again, but there is much to learn from understanding where various policies come from. The policies come from people who were elected to make those policies or from people who were appointed by those elected. I may, on occasion, think that I know better then those people, but my conceit does not entitle me to defy those policies with which I disagree. Just as nobody should pick and choose which laws they obey based on whether they like those laws (otherwise why have laws?), I won't cherrie pick those policies which I like.

If I sign a contract with a school or a school district, I do so willingly and see it as a commitment to upholding my end of the contract. That means following their rules. It would be dishonest to sign a contract with the intention of doing anything other than accepting their policies. This point is point is very important. It is actually something that I thought about a great deal before enrolling in a teacher training program, but by seeking to be a teacher I have firmly decided that the value of doing so greatly outweighs the distaste for implementing a few policies I may not like.

In and out of the classroom

I can see no reason to ever mention my religious or political views in the classroom or to students. There are some things about myself that if expressed in the capacity as a teacher would be inappropriate. My religious and political views certainly fall into that category. However, anyone reading these blog postings (if anyone actually is) will realize that my political, social, and religious views are emphatically not secret. I am happy to share them with anyone (outside of my role as a teacher) who asks.

By seeking out my postings or searching for my musings you are asking me what I think. I am not pushing or advertising my views. I am not addressing a captive audience, and I am absolutely not using a school, classroom, or any authority I might have as a teacher to express my views. By coming here, you have asked me what I think.

Student discovery

I cannot prevent my students from doing the same sort of search or link following that brought you to my postings. I will do nothing whatsoever to encourage them to find this, but that won't stop the student who decides to google all their teachers. So some students will learn my views on politics, social matters and religion. This isn't the problem it might seem.

First of all, I like math, and that will be made known to all of my students. This already makes me a kook in the eyes of many of them. So if I have other kooky ideas, that should come as no surprise. And having one kooky teacher who is an atheist will be balanced out by having a dozen others who have more conventional views. I would be over-estimating my status and influence if I thought that students discovering what my views are would change their views.

I also don't think that I should be singled out for making my opinions available on line. If you are active in your church or a civic organization, if you have ever contributed to a political campaign or are registered to vote for a particular party, then your religious and political views are available to anyone who knows how to search the Internet. You may not have gone into detail about your views, but much will be guessed from your affiliations. Should everyone who works for the public schools try to eradicate all public traces of their views on religion or politics? That would be both unwise and impossible.

Deletion and pseudonyms

Should I remove my postings on controversial matters from the sites I control (this blog and goldmark.org? Well, I could, but I have a posting history that goes back to 1986, and I do not have the ability to have everything I've said over the decades removed from where they can be searched. And given how my views, approaches, and spelling have changed over the past 20 years, I would much rather have someone read my more recent comments than my older ones. So if I attempt to remove what I can, then what is left paints a very distorted picture of my views. In truth there is no delete button on the Internet.

I should also make it clear that when I first became active on the Internet, we didn't use pseudonyms. The usernames under which we posted were the usernames that we had on some mainframe computer and were not under our control. Pseudonyms were possible, with effort and resources, but rare. So from the beginning I've posted under my own name. The other problem with pseudonyms is that they are very rarely anonymous. It is possible to operate truly anonymously on the net, but it is difficult. (Most people who think that they are operating anonymously are not.)

It is also not my style to hide from what I say. It would feel dishonest writing under a pseudonym. I should not feel embarrassed by what I say in a public arena. Of course over the decades I've said plenty of things that I'm embarrassed by, and maybe years from now I'll be embarrassed by what I write now. Nonetheless, I hope that my openness about my views and the explanation I've given above should make it clear that my various musings on the Internet will not interfere with my teaching.

Tuesday, September 8, 2009

No Child Gets Ahead - The evidence

In April I wrote a piece No Child Gets Ahead in which I argued that current implementations (and particularly in Texas) of the No Child Left Behind program is detrimental to the interests of the above average student. Let me also remind everyone that I consider the goals of NCLB laudable and important. Again, see that earlier rant for a defense of those goals.

Now there is increasing evidence that I am correct. Brighter students are not advancing at the rate one might normally expect of them. This was discussed in a New York Times opinion piece titled Smart Child Left Behind on August 28, 2009. The authors, Tom Loveless and Micheal Petrilli, refer at first to report by the Center for Educational Policy published in June 2009.

The Rosy CEP report

The CEP report asks the question in its title, Is the emphasis on proficiency shortchanging higher- and lower-achieving students? Their answer is no. But Loveless and Petrilli argue that the CEP's report is deeply flawed. After reading the report, I entirely agree that it is broken beyond repair. The most egregious error in that study is the exclusive use of state proficiency test scores. State proficiency tests are designed to measure skill at the grade proficiency level. They never test anything above grade level (which is where advanced students are). My anecdotal experience is that pretty much everyone in my daughter's gifted and talented program hit the ceiling (score 100%) of the state TAKS tests. State proficiency tests are not designed to measure learning beyond the grade level proficiency levels, and simply don't work to measure learning for the high level students. The CEP report pretty much spells out the flaw without realizing it

The main measure of student achievement for this study consists of data from the state tests in reading (or English language arts) and mathematics used for NCLB accountability. Although no large-scale test provides a complete picture of student achievement, we have analyzed state test results because these tests are given to nearly all students in a state, are intended to reflect each state’s academic content standards, and are designed to assess whether students have met their states’ expectations for performance at a particular grade level. [Emphasis mine.]

It appears that the CEP report measures success in a state by looking at state results in terms of the percentage of students (with each state) scoring proficient or above. This notion of counting the number of students who exceed a certain (minimal) standard as a way of seeing whether you are serving the higher performing students is entirely missing the point of the exercise. The question we are asking is Does the way we measure school success shortchange the top students?. The CEP's answer appears to be, Well if we count success according to the way NCLB measure it, then we have success..

Another astounding flaw in the CEP analysis is their use of states as their level of analysis. For them, a gain in a small state completely off sets a lose in a large state, even if it means a decline for millions of more students than there is a gain for. This is truly blushworthy error. even though they fully acknowledge it (on page 18). I could go on. These are not minor technical quibbles. These problems completely and utterly undermine the CEP conclusions.

Why worry

Before I go on to cite the evidence for my assertion that NCLB does shortchange the better students, let me spell out why I and so many others worry that it would do exactly that. I've outlined these reasons in my earlier rant and when combined with the actual level of these proficiency standards (see my rants, Race to the Bottom and No Comparison) there really is a concern. As I said before, people and systems do respond to incentive systems, so we should look very clearly at what we incentivize.

Two Scenarios

The NCLB incentive system rewards schools and districts for the number of students who pass (minimal) proficiency tests. The margin of passing or failing (how high above or below the passing cut-off) counts for nothing. Imagine a class with three students: Alice, Bob, and Charlie. And suppose that the proficiency level is considered met if a student scores a 70 on the crucial test. (Obviously I'm grossly simplifying the examples for the purposes of illustration.)

Now consider scenario 1: Alice scores a 78 and passes. Bob scores and 70 and passes, Charlie scores a 50 and fails. In this scenario, the class has two passes and one failure. That is what will be counted in determining the school's, district's, and (probably) teacher's rating.

Now consider scenario 2: Alice scores a 95 and passes, Bob scores a 69 and fails, Charlie scores a 62 and fails. This class has one pass and two failures. The school, district, and teacher will be marked down severely for this.

All of the incentives (and they are powerful incentives) of NCLB push for scenario 2 above scenario 1. But let's look which class is serving the students better. Both Alice and Charlie do much better in scenario 1 than they do in scenario 2. While Bob does slightly worse in scenario 1 then in 2.

Of course you may object that I could have set up an example where the class that did better on NCLB criteria would also be the one that we would all agree better served the students. But my example illustrates real choices that schools and teachers make every day.

Suppose that you are a teacher and you are confident that Alice will pass the exam with little extra effort from you. With more effort from you, she might learn a great deal, but she is already on a clear target to pass the exam. And suppose that Bob is a student who looks like he will pass the exam, but only if you put extra effort into preparing him. Finally, as a teacher, with all of your pre-tests and such, you determine that even with an extraordinary effort on your part, Charlie is unlikely to pass the exam. If you want to keep your job, and the school wants to keep property values high in its district, then you will focus your effort on Bob.

Response to Response to Intervention

In the excellent teacher training program that I am currently enrolled in, we have been studying the mechanisms by which we identify and help the struggling student, Bob, before he falls too far behind. It is a program (or framework) called Response to Intervention (RtI). It really looks like it should be effective at identifying students like Bob earlier and getting the teacher to devote more time to Bob's needs. But of course any additional time spent on Bob will be time taken away from Alice and Charlie (unless additional staff are provided or the school day is lengthened).

This is one thing that people always seem to forget. Anyone who says that we need to spend more time doing X (where X is "with struggling students", "in the library", "teaching math", "practicing bus evacuations", "taking tests", etc) needs to remember that that means spending less time doing something else. This applies to money as well as time. An additional dollar spent on X is a dollar taken away from something else. It's easy to say what we should spend more time or money on, but it's very hard to answer the question of where that time or money comes from.

How to find out

I've already explained that if we want to test whether the incentives set up by NCLB create a disservice to above average students, we can't measure that by counting how many states have an increase in the number of students reaching the proficient level in that state. So how do we check? First of all we will need to use measures that are (a) comparable across states, and (b) which accurately measure the skills of the above average student. Ideally, we would like to have (c) where the progress of individual students from year to year is measured.

Getting data that is comparable across states is difficult. NCLB allows each state to set its own minimum and proficient standards. Because both politicians and educators like to be able to boast about how well their students are doing, there is pressure to set these standards low. (There are also some good reasons to set them low.) As a consequence of this, there is an incentive to shy away from mechanisms that allow state standards to be compared with one another or have students from one state compared with those of another. (See my earlier rant, No Comparison.)

We also need achievement results that don't suffer from a ceiling effect. That is, it should assess the full range of student achievement including those students near the top. This can be difficult for a number of reasons. First of all, the state assessments for NCLB are completely unsuited for this; so any tests would need to be in addition to those required for NCLB. Secondly, most testing to see whether students have learned the material presented in class; thus they rarely can test students who are above grade level.

Fortunately, there have been an number of attempts to collect such data. In an earlier post, I discussed the Measure of Academic Progress produced by the Northwest Evaluation Association. This time, I will be looking at The Nation's Report Card: Writing 2007 produced by the National Center for Education Statistics (part of the US Department of Education). They developed a scale which should include most advanced students, and sampled school children from across the country. Details of their method can be found in the report. For our purposes, merely showing a chart on page 9 of their report should make the point.

nations report card writing 2007-page9.jpg

Before NCLB went into effect nation wide (2002) there was no growth in 8th grade writing skills at the lowest levels, while there were gains at the highest level. After NCLB went into effect, there were gains significant at the lowest levels and stagnation at the upper levels. Now I admit that I did troll through reports to find the most dramatic example. But for all grades studied and in all areas we find that NCLB has led wonderful gains at the lower levels. These are important and valued achievements. At the same time, it has lead to a flattening of growth at the higher levels.

In all fairness?

As I've said elsewhere, gains in one place often have costs elsewhere. If we have to have a trade off of improvements for the top students or improvements for the bottom students, maybe we are redressing a prior imbalance by focussing on the struggling student. I will address this issue in a later post. Here I will say that the situation before NCLB was destructive and unjust, with the below average abandoned. NCLB needs to be credited with fixing that. But the current situation, in which the above average student is ignored by the educational system, is little better. But whether you think that the current situation is right or wrong, I hope that everyone realizes that it does shortchange the above average students. In future posts, I will try to elaborate on how I think we can develop an accountability system that establishes incentives which serve all students.

Sunday, August 16, 2009

Call Me Uppity

Once again there is a complaint about "militant atheists". The latest to reach my door step was an opinion piece in today's (August 16, 2009) Dallas Morning News by Rod Dreher. (Note that the on-line version doesn't have the subheading that exists in the print edition Militant atheists think replacing religion with science will solve everything. But the title does talk about atheist fundamentalists)

The article itself is mostly arguing that science and religion don't need to conflict, just as long as each stays within its proper domain. I do not intend to deal with that here. It's something that I've been wanting to write about for a while, but here I want to write about the phrases militant atheism and atheist fundamentalist.

Let's look at what it takes to be a militant for any other cause or belief system. Environmentalists usually have to engage in or actively endorse violence or, at the very least, vandalism to earn the title. Racial supremacists often need to actually try to kill someone before they are called militants. Merely rehearsing race war in the woods with your friends on the weekends doesn't quality. Anti-capitalists have to riot to get called militants. As for religionists, in this country they can withdraw from the public school system, go door to door telling you you are damned to Hell, demand special holidays, prevent the sale of alcohol on their sabbath, disregard parts of the Constitution; and we call this business as usual. To be a militant, they actually need to kill someone. But when they do they are still not called militants religionists unless they are Muslim. They are just called crazy individuals acting alone. When a women kills her child because she believes it is possessed by demons we call her crazy (as she is), even if the belief in demon possession is reinforced in her church. When preachers and politicians talk about placing Jesus and the Bible at the heart of government or suggest that they are on a mission from God to transform the nation, we don't even bat an eye.

But what does it take for an atheist to be called militant? Well, openly declaring that you are an atheist (say wearing a t-shirt) might do the trick. If that doesn't do it then maybe taking the extreme step of encouraging other atheists to come out of the closet must be militant activism.

But the thing that will really get you labelled as a militant is stating that you find many religious beliefs silly. Let's be clear, we are not talking about go door to door ridiculing people's beliefs. We are not talking about putting up billboards making fun of their beliefs. We are talking about writing books and posting blogs. Maybe there is the occasional letter to the editor. The mere fact that we are now feeling free to openly challenge religious beliefs gets us called militant.

I try to respect people. And if their beliefs were private matters, I would have no reason to fuss about them. But we all know that religious beliefs have played a major role in history and are likely to continue to do so. They are influential ideas in the public sphere. Like any beliefs that matter, they must be open to criticism and even ridicule.

This is why we get called militant. People like me no longer bow to the taboo of criticizing religious beliefs. But please face up to what bothers you about that, and use the right word. Call me uppity.