My past few<\/a> blog posts<\/a> have been concerned with the usefulness of peer grading.\u00a0 Steve Joordens showed<\/a> that peer grading was pedagogically useful for first-year psych students…but what about computer science students?\u00a0 Would they learn from it?\u00a0 Would they become better programmers?<\/p>\n We don’t know.<\/p>\n Maybe it’s time to find out.<\/p>\n It’s pretty simple, actually.<\/p>\n I have two groups of students.\u00a0 Let’s call them groups A and B.<\/p>\n For each student in A, have them complete a simple programming assignment (call it P1).\u00a0 Once they’re finished, have them complete a second simple programming assignment (call it P2).<\/p>\n For each student in B, have them complete P1.\u00a0 Once that’s done, have them view 5 or 6 different mocked up submissions, also for P1.\u00a0 For each submission, have the students fill out a rubric and assign a grade. Once finished, the students then complete P2.<\/p>\n Then, I get some fellow graduate students to mark my mocked up submissions, the group A P1\/P2 submissions, and the group B P1\/P2 submissions.<\/p>\n If grading made the students better programmers, we should see an increase in the number of marks given to the students in group B for P2.<\/p>\n This experiment is nice and simple. And, besides showing if peer grading makes students better programmers, it gives us a couple of bonuses:<\/p>\n I’ll have to do randomization here and there to eliminate ordering effects – for example, randomizing the criteria on the rubric, randomizing which assignments go first and second, randomizing the order in which the mock-up submissions are shown, etc.<\/p>\n One thing to consider though:\u00a0 what effect does simply seeing the rubric<\/em> have on students?<\/p>\n I’ve been in courses where I’ve not been allowed to see the marking rubric for some assignment.\u00a0 It’s frustrating.\u00a0 Seeing the rubric helps me focus on the areas that I’ll be marked on.<\/p>\n So what if just seeing the rubric makes the students “better programmers”?\u00a0 One way to counteract this would be to have the rubric for the second assignment be quite a bit different than the one for the first assignment.<\/p>\n Oh yeah.\u00a0 Stats.\u00a0 Not my strongest subject.\u00a0 I’m going to have to brush up on this (and probably enlist some help within the department) if I’m going to do this properly.\u00a0 I’m probably not going to get as many participants as I think I will…so I have to accommodate small N.\u00a0 Hrm.<\/p>\n Anyhow, this is where my summer experiment seems to heading.\u00a0 What do you think?\u00a0 I’m all ears.<\/p>\n","protected":false},"excerpt":{"rendered":" The Question My past few blog posts have been concerned with the usefulness of peer grading.\u00a0 Steve Joordens showed that peer grading was pedagogically useful for first-year psych students…but what about computer science students?\u00a0 Would they learn from it?\u00a0 Would they become better programmers? We don’t know. Maybe it’s time to find out. The Experiment […]<\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[454,626],"tags":[501,648,647,132,561],"class_list":["post-1141","post","type-post","status-publish","format-standard","hentry","category-code-reviews","category-research-computer-science-technology","tag-code-review","tag-learning","tag-peer-grading","tag-programming","tag-students"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/prmTy-ip","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/mikeconley.ca\/blog\/wp-json\/wp\/v2\/posts\/1141","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mikeconley.ca\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mikeconley.ca\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mikeconley.ca\/blog\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/mikeconley.ca\/blog\/wp-json\/wp\/v2\/comments?post=1141"}],"version-history":[{"count":9,"href":"https:\/\/mikeconley.ca\/blog\/wp-json\/wp\/v2\/posts\/1141\/revisions"}],"predecessor-version":[{"id":3181,"href":"https:\/\/mikeconley.ca\/blog\/wp-json\/wp\/v2\/posts\/1141\/revisions\/3181"}],"wp:attachment":[{"href":"https:\/\/mikeconley.ca\/blog\/wp-json\/wp\/v2\/media?parent=1141"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mikeconley.ca\/blog\/wp-json\/wp\/v2\/categories?post=1141"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mikeconley.ca\/blog\/wp-json\/wp\/v2\/tags?post=1141"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}The Experiment<\/h4>\n
Bonuses, and Other Concerns<\/h4>\n
\n
Statistics<\/h4>\n