the experiment I’m conducting<\/a>?\u00a0 I’ve been testing out various components of it while I wait for ethics board approval, and some interesting questions have come up.\u00a0 Some of these questions have already been raised in other posts (and in comment threads – thanks for the discussion, all!), but I want to summarize them here.<\/p>\nAccess to the Internet<\/h3>\n
When participants are working on the assignments, they will be given full access to the Internet.<\/p>\n
I had a bunch of conversations with undergrad instructors here at UofT, and across the board, during programming exercises, students have full access to the Internet.\u00a0 They’re prohibited from just copying and pasting code from somewhere else into their assignments, but they can certainly look at online documentation and examples to get some ideas.\u00a0 So I’m going to allow this as well, in order to better model an actual undergraduate assignment.<\/p>\n
I’m also considering writing a script that will take a screen capture every 30 seconds or so in the background.\u00a0 This way,\u00a0 I can quickly get a sense of the participants activity during the assignments.\u00a0 This should hopefully give me some idea of how much time they’re spending in the browser, and how much time they’re spending writing Python.<\/p>\n
Participant Programming Ability<\/h3>\n
The only prerequisite for my participants is that they must have 4+ months of Python programming experience.\u00a0 I’m not filtering out the stronger or weaker programmers.\u00a0 I’m taking them all.<\/p>\n
Why?\u00a0 Because I think this will give me a more accurate model of the composition of a first or second year programming course.\u00a0 From my experience, students in first and second year programming courses have a wide spectrum of strengths and abilities.<\/p>\n
But what if they don’t complete any of my assignments?\u00a0 What if they stare blankly at the screen, or give up, or just surf Reddit because they can’t understand what I’m asking from them?\u00a0 That’s OK – completion of the assignments is not necessary, and again – this relaxation helps to better model a real programming course (because there are invariably students who don’t start, or don’t finish a programming assignment).<\/p>\n
And it’s OK if they don’t do well.\u00a0 I’m taking a reading of their programming abilities with the first assignment, getting them to do peer grading, and then taking a reading with a second assignment.\u00a0 I don’t care what absolute grades they get, I care about what happens after they’ve done the grading<\/em>.<\/p>\nI might also see some interesting trends – for example, participants who perform poorly on the first assignment might benefit greatly from the peer grading, whereas participants who perform strongly on the first assignment might see little benefit.\u00a0 Or vice-versa.\u00a0 Or neither.\u00a0 Granted, I probably won’t be able to collect enough participants to make such statements with statistical strength, but if a signal appears to be there, it’d be an interesting direction for future work.<\/p>\n
30 Minute Time Limit<\/h3>\n
Students will have 30 minutes maximum to complete each assignment.\u00a0 And that’s absolute – it includes reading the assignment, surfing the Internet, and coding it up.<\/p>\n
This is because a hard time limit like this, again, better models the state of classrooms as they are.\u00a0 In an open-book exam, you’re not timed on how long you’re spent only writing, with the clock paused as you glance at your textbook.\u00a0 You have a firm time limit, and that’s it.<\/p>\n
In an ideal world, students would be given a more personal level of teaching, as opposed to this mechanical, factory-floor approach.\u00a0 But if I (or anybody) is ever<\/em> going to implement these ideas into a real classroom setting, I’ll want to make sure it can be easily adapted into the teaching environment as it already is<\/em>.<\/p>\n","protected":false},"excerpt":{"rendered":"This is mostly a reminder note to myself, but I thought I’d post it publicly. So, remember the experiment I’m conducting?\u00a0 I’ve been testing out various components of it while I wait for ethics board approval, and some interesting questions have come up.\u00a0 Some of these questions have already been raised in other posts (and […]<\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[626],"tags":[662,503],"class_list":["post-1241","post","type-post","status-publish","format-standard","hentry","category-research-computer-science-technology","tag-notes","tag-research"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/prmTy-k1","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/mikeconley.ca\/blog\/wp-json\/wp\/v2\/posts\/1241","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mikeconley.ca\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mikeconley.ca\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mikeconley.ca\/blog\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/mikeconley.ca\/blog\/wp-json\/wp\/v2\/comments?post=1241"}],"version-history":[{"count":4,"href":"https:\/\/mikeconley.ca\/blog\/wp-json\/wp\/v2\/posts\/1241\/revisions"}],"predecessor-version":[{"id":3178,"href":"https:\/\/mikeconley.ca\/blog\/wp-json\/wp\/v2\/posts\/1241\/revisions\/3178"}],"wp:attachment":[{"href":"https:\/\/mikeconley.ca\/blog\/wp-json\/wp\/v2\/media?parent=1241"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mikeconley.ca\/blog\/wp-json\/wp\/v2\/categories?post=1241"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mikeconley.ca\/blog\/wp-json\/wp\/v2\/tags?post=1241"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}