Peer Review - what's in it for my learners?

http://www.londonmet.ac.uk/deliberations/ocsld-publications/div-ass5.cfm
The link above will take you to an article describing the potential benefits of incorporating student peer review in assessment of learning at the college level.
Share your response - Do you think middle school students would benefit in similar or different ways? What support or training or practice would help middle school students get most value out of peer review? Did the article surprise you, and if so, how?
If you have used peer review in your classroom, share what you did and how your students responded, relating your experience to the ideas in this article.
If you have experienced peer review as a learner yourself, share your experience of that.

Comments

Peer review is very important, as others have said, for building higher level thinking skills. Those skills need to be scaffolded like any other skills, however, and one way to do this, (which I stole from a colleague) is to give students lists of comments from which to choose at first. For example, if it's the first time that students are reviewing to see whether a peer's written evidence backs up a claim that a plant is Japanese Barberry, I might provide this sample list:
* Your evidence includes a description of part of the plant you observed and connects that evidence to the plant ID card's description
* Your evidence includes a description of part of the plant, but doesn't connect the evidence to the species ID card
* Your evidence claims that the plant matches the ID card, but doesn't describe any part of the plant

After students gain more expertise in the types of language and feedback that are meaningful, they can stray away from "You missed a capital letter." toward more meaningful feedback.

Having an essential question and objectives also helps to guide peer review, because students can be directed to keep their comments focused on whether or not the essential question is being answered, or a certain objective is being met with the work being reviewed.

Oddly enough, this article not only remind me that I do this in my classroom; but also, reminded me that there is much more I can do. For example, I just created the Invasive Species Comic Life Project Rubric with student input and I have students look at examples-like when we do lab reports- of both "good" and "not-so-good" work and discuss why, etc... I often allow them to choose assessment tasks and want them actively engaged in self-assessment as well. However, after reading the article, I realized there's a whole lot more still that I can do. I have them participate in peer feedback, but not peer-assessment feedback and I need to explore self-assessed grades/marks as well as peer-assessment grades/marks.

Since 8th grade science is a new curriculum to me, I find that I need to not only get familiar with the curriculum; but also, develop some standard lessons for science that I can do for any science class no matter which grade level, in case I move again. :) For example, I should have an activity that goes with the scientific method, lab safety, how to write a good lab report, etc... and those would fit in nicely with this topic of peer review as well as a grade span. That way I could reuse them and empower, engage and enlighten students all at the same time. Just imagine!

I read this entry with interest because I've so often felt that way and this person described it well. It made me reflect on how, once I've become used to doing certain kinds of assessment with students, it's not the time to just sit back and stop changing. It just means the time has come to take the next step, do a little more. It's much easier once the ball is rolling, and a little subtle change can make a huge difference.

I liked this article and the suggestions given for tick marks and comments from kids. I do a ton a peer review work with my science students in the area of technical writing and quality work. They have totally missed the boat on these topics in many ways and I am not sure why the students in classes that I see today are so far behind the ones ten years ago. I usually do set them up in a common group so that they are able to edit papers and provided feedback for those with similar needs and abilities however there are always a couple who I can't meet their needs in this way. For those individuals, I try to meet with them and have them do more of a self reflection on the work.

Some of the stuff in the article was above the level that I have, but for the most part it was helpful. In terms of Vital Signs we split it up into different days. On one day we worked on the written pieces, their ability to clearly express themselves in writing. We used a separate day to focus on the quality of photos. They were far more intrigued by this part and I can see that, if left to their own decisions, they would have spent days on this part.

I am a proponent of teaching kids to self-assess. One of the hardest things for my students is to look at an example and compare it to something that isn't as....'pretty'. I know that before they started to write out their first investigation pages I had them look through the Vital Signs database and had them pick out one excellent example and one that needed improvement. It was evident right away that they were only focusing on pictures, I had a number of students pick out examples that had great pictures but had very little written components (one student noted that that was why they picked it less reading). However it was a great opportunity to have them discuss what makes a good piece of written evidence. My only concern is the level of self assessment that 7th graders can handle. At this stage most don't have a very good eye for detail, they tend to gloss over 'boring' parts and focus just on what they find interesting. I feel the ideas in the article would be better suited for older students (at least in intensity).

This article truly seems to speak more to the teacher of undergraduates than to a teacher of a VERY mixed seventh grade. With my upper level kids, I anticipate that the peer review process will go smoothly, and is something we can integrate very well. We already practice some peer feedback- particularly for presentations. However, especially in my current seventh grade, we have a group of students who take any opportunity to be funny/outrageous/ absurd and this will be a challenge!

Challenges are what teaching is all about. It is important for all students to develop skills in both providing and accepting courteous constructive criticism. However, I do tend to emphasize the positive as the kids take almost everything personally. We have been having parent teacher conferences and a constant theme is the movement at this age from the concrete to the abstract. I would argue that many students do not yet have the intellectual maturity to distinguish between personal criticism and a critique of their work. Likewise, they are unable to deliver feedback on a person's work without directly commenting on the person. Thus peer review, while an important process, must be addressed very carefully.

After doing our field investigation, and while still in the field, we did a quick peer review to make sure that data was recorded (lengths, colors, species characteristics, GPS recorded correctly, etc) prior to leaving. This way students’ didn't rely only on the pictures for their species data or memories for other areas. It also assured the group that they covered all the areas necessary before having to leave.

In the classroom, the team members pooled their data, comparing how data was written, information used and relayed, etc. They then wrote a group team investigation using blank field notes. They then swapped with another group. This group then reviewed and made notes and/or comments, even offering suggestions and perhaps questions for further explanations. The leader of this group, then brought the ‘updated’ field book to the original group and explained their reasoning for the changes and/or comments.

The original group then made the necessary corrections, for a ‘final draft’ field notes. This was then given to me for a ‘final’ review, where I then offered my comments. This was then given back for a ‘final’ copy write-up. This handwritten draft is then put on the computer in ‘Word’ so they just need to copy and paste into the Vital Signs’ fields.

I keep all copies of the field notes in case of absences, so the remaining members can still work on the material. It also allows me to see the progression from initial investigations to the final team one. More importantly, it shows them the progression, and progress, they made!

I'm especially interested in the idea that a course originally insisted on 2 essays, but toned it down to one. This being done specifically to encourage better writing and an eventual stronger paper as the outcome. It's something I've considered in the past, myself. I guess it's a matter of quality over quantity.

In my language arts classes, I have had my students do peer conferences during their writing. However, I've never considered having students think critically about how they've used their peer's feedback before. I liked some of the questions they're expected to consider, and am thinking of including it in the writing process they follow.

I agree with the article that it's important for them to learn how to assess themselves. It is a life skill that is as equally important as knowing how to work collaboratively with others.

I am firmly committed to peer review, and believe that its flaws are a reflection of the complexities inherent in authentic work. It is a messy process, indeed, but that should only give us more fuel to aggressively tackle the challenges and commit to making peer review a fundamental part of the ongoing learning experience of experiencing scientific inquiry in the classroom. Is it a pain? Yeah, it's hard. That's why it's so important.

The question as to whether I personally experienced peer review as a student dredged up memories of one lesson I had as a 10th grade English student. In retrospect, my teacher was clearly "experimenting" with using peer review, as we did it once and never repeated it. The experience for me was unforgettable. I had never been exposed to the work of random peers in my classroom before. I got a paper from a kid whose writing level was so simplistic and awkward, I recall being completely overwhelmed with where to start in giving him feedback to improve his writing. I muddled through; don't think I even made it past the first painful paragraph. I'm sure my feedback totally sucked, and I imagine that upon reading it, my teacher threw his hands up in the air and resolved never to try that failed lesson again. But the pathetic reality is that from that day, I didn't find myself in another situation to give feedback on someone's writing until years later in the workplace. And that was scary. Because by that time, the quality of the product really mattered, and I had no tools to describe what needed improving, nor any tact to do it in a way that didn't threaten my relationship with my colleagues. The bottom line is that that skill came eventually, but I had to develop it OUTSIDE of the safety net of academia, and doing so felt wicked risky and stressful. Of all the useless information that I expended energy memorizing and regurgitating over the long span of my academic career, why couldn't the hugely important skill of delivering frank and quality feedback have taken more precedence?

I gotta be honest; that single experience as a learner trying to use peer review was not pleasant. I felt bewildered and inadequate. I wanted to provide useful feedback, but wasn't practiced at it, at all. I think seeing an example of how teachers do it would definitely have helped, before tackling the task. But here's the thing: this is the reason that so many students give lame peer reviews. It's not that they don't care, or that they are too lazy. It's that delivering feedback (especially written) is a really, really hard skill to learn. And if we want kids to learn valuable skills in school, well, that's where our instructional efforts should be focused.

I'm going to just wrap this up by stepping off my high horse and divulging that I haven't done a whole lot of peer review in my career as a teacher. I shy away from it because, well, it's really hard and frustrating. But I liked the tools offered in this article, and think they might really help to improve my ability to get back in there and tackle it some more. And most importantly, by reflecting on the essential value of teaching peer review, my commitment to its importance is rejuvenated. So I'm off to try it again. And again, and again. Because neither I, nor my students, will ever master it. And that, right there, is the reason to keep trying.

I have mixed feelings about peer review.

As mentioned by others, the feedback given is sometimes very surface-level if the reviewer does not truly understand the concept or goal. I am fortunate to work with a language arts teacher who does an incredible amount of work around peer review and protocols for feedback. Some student groups gave wonderful, useful suggestions to their classmates. Unfortunately, getting the groups to use the feedback to revise and improve their work was a struggle. Many have the "getting it done is good enough" attitude and do not see the value in revision. I will say that knowing the observations would be posted online did make some of the student groups a lot more thoughtful of the process. I did have students do peer review for grammatical issues as well as making sure that the writing made sense. We also did a quality check to make sure that the written and visual evidence matched and told the whole story.

If I had to count the revision process as part of a grade, I'm not quite sure how I would do that considering the wide range of abilities in my classroom.

While I think that peer review can be very helpful in certain instances, I believe, along with kmonitz, that most students probably wouldn't take it seriously.

Yes, I believe that the norms can be taught and that some students can be very good at it. There are very few students in my sphere of influence that would be able to handle it on more than an occasional basis. Not only that, but it would take a long time to teach and at this point, I have no more room to budge.

Next year with my incoming students I would start the peer review process from the beginning and make sure that they see it as a regular part of their learning process in science. Baby steps, that's how you have to move on some things. Knowing you are moving in the right direction, but maybe taking a little longer to get there.

I think the difference between peer review and assessment needs to be clear. Many middle school teachers (myself included) incorporate peer review (i.e. peer editing and more) in the scope of classroom normal procedures. As commented in the article peer review : “…develops students' critical faculties; …significantly better work is produced; …and it is more like the 'real world' - good writing involves redrafting in the light of criticism.”

I also feel that having students involved in creating assessment criteria is a valuable use of time and effort. My experience is that having students involved in the development of grading criteria and norms helps them understand what the expectations are and how to meet those expectations.

What I am not so sure about is peer assessment and grading being a viable goal for middle school teachers and students. Peer assessment and peer grading requires a level of maturity that a majority of middle school students do not yet have. Assessing written work that involves higher order thinking skills could be problematic for 8th graders. Recently I had students read an article about how trash (and invasive species!) travel via the oceans of the world. I posed several questions for students to answer after we had read and discussed the article. As I review and assess the answers generated by the students I have to remember that some of them are more advanced developmentally than others. Consequently where one student may analyze the material and propose ideas or make conclusions another student can only recap, summarize and explain what they read. While an adult can appreciate and discern those differences for each student and grade based on an individual’s capabilities I do not think middle school students would have that ability.

In the past I have occasionally had students assess their peers regarding group participation and effort when a group project has been completed. Occasionally I have incorporated the students peer assessment into the final grade for the project.
The few times I have had student’s peer grade I discussed this with all students prior to the activity. A rubric was used to ease the process and I asked students to be thoughtful and keep their assessments confidential. While some students were able to thoughtfully assess their peers, I think the majority were not. Most students would either take the easy road and grade everything high or the slash and burn approach and totally rip the other student to shreds. I found it difficult to see how the peer assessments were valid or helpful.

Do you think middle school students would benefit in similar or different ways? I am skeptical about this working at the middle school level. As much as I would want to think that they could be objective about the work and not about the person, I just don't think they could do it. It would take a lot of practice-- a lot of practice and I'm not sure that I would be willing to invest that amount of time.

What support or training or practice would help middle school students get most value out of peer review? Did the article surprise you, and if so, how? I was surprised that the article advocated peer grading although it seemed geared toward older students. Again, I just don't think that middle school kids, on average, are able to comfortably peer review without letting emotion into their experience and to add the option to give grades seems too much. It would take several sessions of practice with sample pieces to work students into the role of reviewer. They would have to learn how to read work to give valuable feedback.

If you have used peer review in your classroom, share what you did and how your students responded, relating your experience to the ideas in this article. I have only used peer editing in my classroom thus far. Because I don't have major writing pieces in my science classroom, it hasn't been a priority for me as a tool for my students.

Do you think middle school students would benefit in similar or different ways?-----I know a retired language arts teacher who was using peer review with good results. Kids knew the norms, liked it.

What support or training or practice would help middle school students get most value out of peer review? Did the article surprise you, and if so, how?----- I am afraid it surprises me to read all the things teachers could/should do to ensure success with this method. No one has time for all of that. But in an ideal world, the exemplars would be important, and keeping it simple, just looking at a few concrete criteria at first. The MEA released items have useful samples of work representing levels of achievement.

If you have used peer review in your classroom, share what you did and how your students responded, relating your experience to the ideas in this article.--------The one time I used a form of peer review with much success was poster talks. Student groups had each made a poster about a National Park. Each poster had the same required components. The students had to take turns standing by the poster giving the 'talk' and answering questions. When you weren't giving talks, you went to the other talks, and you had to take notes. They each had the same note-taking handout to fill in for each poster. At the bottom of the note-sheet was an evaluation question. So--here's the kid, going from poster to poster, trying to take same notes on each one, but some posters are better than others, the info is better, or easier to see/understand or the presenter is better at explaining. I actually got a lot of useful feedback from that one.