Time Well Spent

Maybe it doesn’t matter what techniques we use in the classroom; maybe it’s how much time students spend with the material we want them to learn!

I got this idea after an experiment on the learning efficacy of a collaborative group exercise. Half the students from my and my colleague’s Intro to Political Science classes were split into problem-based learning (PBL) working groups and lecture-discussion groups. The experiment took place during a single class period and included a pre-test/post-test plus a retention test two weeks later.

In contrast to other studies, I found no significant relationship between participating in the PBL exercise and better learning. It’s possible that these results were caused by not debriefing the PBL groups (to keep the experiment to one class period), or because the PBL groups were busy learning skills rather than the content (like how to get along).

It’s possible that the better learning from collaborative projects reported in other studies occurs simply because their participants spend more time with the material than those in more standard settings. Thanks to the two-teacher feature of the quasi-experimental design, I was able to test this ‘time-spent’ hypothesis in two ways.  First, my own classes required all of my students, regardless of treatment group, to write an individual paper that drew on the same material used in the exercise.  This paper was assigned after the post-test, and was due a week before the retention test.  Students who spent the time to write the paper scored significantly higher on the retention-test than those who didn’t.

Second, my students faced the threat of a pop oral quiz each day while my colleague’s didn’t. The data showed that my students were significantly more prepared for class the day of the experiment.  They scored much higher on the pre-test, and held onto that ‘bump’ in the post-test and retention-test.  Again, it seems, students who spent more time doing the reading actually learned and retained more.

Bob Amyot, Hastings College, Hastings, NE – ramyot@hastings.edu

Live from the TLC

A few thoughts from the initial day of the 2012 APSA Teaching and Learning Conference:

I missed the opening speakers due to a fog-induced flight delay.

The Grand Hyatt in Washington, DC, is pretty swank. The conference sessions are being held about four floors below ground level, an ideal location for the Iranian nuclear  development program. One tunnel connects to the Metro Center station, so it’s easy traveling between the hotel and DCA.

This year’s conference track on IR simulations and role-play again promises to be interesting. We’ve already had Dr. Robert P. Amyot of Hastings College present evidence that brings a fundamental premise of pedagogical simulations into question: that simulations in and of themselves significantly enhance student learning. He argued that learning is more a function of how much time students spend writing and thinking about a topic. Instructors should therefore focus their energies on discovering whatever motivates students to do this, rather than on a particular pedagogical style or tool.

Tomorrow Dr. Victor Asal of SUNY-Albany will be reprising his role as the grandfatherly mentor when he presents a variety of gaming exercises related to identity salience and political violence.

Multi-Tasking With Reflection

Most of us would agree that reflection is an important part of the learning process. The hard part about reflective exercises is making students think about course content rather than their feelings about it.

One of my colleagues in philosophy uses an exercise that I’ve adapted for a course I’m teaching now. Five times during the semester students write a one-page reflection on previous reading assignments and class discussions. Students can attempt to clarify a particular point made in class, critique someone else’s point, wonder about the implications of a particular idea, or consider the relationship between one author’s writing and another. Students must raise a question (or questions) as part of each paper.  These questions can go in the direction of the individual student’s choosing, but they should be clear, concise, and original.

Here’s where things get interesting: students post their questions online for review by their peers. The questions that are regarded as the “best” (however defined) by the students are used for additional classroom debate. The process of reflection moves from being solely internal (where I am the only other person who learns what a student is thinking) to being shared and evaluated among peers. At the same time, students are generating a bank of exam questions that I can draw from. If the questions I include on an exam have already been discussed, there’s no need for me to set aside additional class time for an exam review session.

Perseus prepares to engage Medusa in a self-reflection exercise . . .

Using Sherlock to Teach Sources v. the Literature

One of the challenges with students is that they often aren’t trained to recognize the difference between sources and the literature.  We may attempt to teach them the difference between primary and secondary, or scholarly and non-scholarly, but even amongst solid scholarly sources there are differences: there are the key works that make up the core of the literature on a debate, and there are the sources that sit on the fringes of the debate or never even quite enter into it.  Students think sources are something to use to prove their point, rather than a place to start out their process to discover what others have already discovered.  Even if you can get them to accept that scholarly sources are superior to, say, Wikipedia (a daunting task!), it can be difficult to explain to them that there is a difference between the literature and random sources, and that its important.

Enter Sherlock Holmes.

I’m a bit obsessed with the new BBC series called Sherlock, which if you haven’t seen it is a clever modern retelling of the stories.  Imagine Sherlock Holmes with a smartphone, and you have the heart of this series.  There is one particular scene in the first season that is useful in helping students understand the core of the above lesson.  In episode 3, starting at 19:53 (per Netflix instant), Sherlock asks Watson’s opinion of a pair of sneakers.  With encouragement, Watson notes some facts about them and their owner from the worn sole, clean appearance, and writing on the inside.  He asks Sherlock how he does, and he replies ‘Well, John.  Very well.  Of course you missed everything of importance.”  Sherlock then figures out the ‘important’ details–that the child had a skin condition, that he was from Sussex, and that he loved the shoes dearly.

I used this in my methods class today to get students thinking ‘What would Sherlock Do?’.  In other words, finding facts is not particularly difficult, but it also doesn’t tell us the whole story, and without the right facts, we are left completely in the dark about the phenomenon we are studying.  The right facts–or the literature–put us on the path of discovery.  Finding the right facts also means that Sherlock Holmes wouldn’t think of us as idiots…so again, ‘What would Sherlock Do?’  An amusing way to teach a simple but incredibly important lesson, and usable not only in methods, but any class where you expect students to use scholarly sources or do a literature review for a research paper.

The Results Are In

As I’ve discussed here and here, this past semester I ran a role-playing simulation for undergraduates on international relations in Europe on the eve of World War I. Previously I had tested for the simulation’s possible effects on student learning by comparing essay exam grades from a “regular” class that participated in the simulation to grades from an honors class that had not. Grades from the honors class were higher, and in most cases the differences were statistically significant, but the possibility existed that the higher scores were due to the honors students supposed better academic ability.

This semester I finally was able to teach an honors class again and do a more valid comparison. Some preliminary data crunching indicates that the simulation had no effect on essay assignments and exams, not what I’d expected. However, in a 2009 study, Stroessner,  Beckerman, and Whittaker found that students’ “writing ability, at least extemporaneous writing, was not affected” by Barnard’s Reacting to the Past role-playing simulations.* This makes me wonder what can be changed about history-based role-playing simulations so that students become better able to connect their simulation experiences to course content and demonstrate that connection through their writing.

I know someone reading this is thinking “it’s quite possible that your assignments and exams aren’t measuring what you think they are measuring.” Yes, possible, but logic dictates that if (a) we think it’s important for students to learn how to use theory to create a coherent and persuasive written explanation of an event, and (b) a question asks, for example, “did the international system in Europe prior to World War I best reflect liberal or realist IR theory, and why?” then (c) assignments and exams indicate how well students can accomplish (a). In other words, I’m testing for what I think students should know, and the simulation that I’ve been using doesn’t seem to have any effect on how much knowledge students acquire over a semester.

I will be presenting on this subject at the APSA Teaching and Learning Conference (TLC) in February. I’ve been attending the TLC  since 2007 and it’s been remarkably rewarding — lots of interesting and pedagogically practical information. I encourage you to attend.

*Stroessner, Steven J, Laurie Susser Beckerman, and Alexis Whittaker (2009) “All the World’s a Stage? Consequences of a Role-Playing Pedagogy on Psychological Factors and Writing and Rhetorical Skill in College Undergraduates,” Journal of Educational Psychology 101(3):605-620.

Connections Exercise

This is the last week of classes, and I’m trying to get students to think about how what has happened inside the classroom can be used to understand a world of which they remain mostly ignorant. So I’ve come up with the following small group exercise, which I’ll probably give them about twenty minutes to complete:

Write a short narrative (not a bulleted list) that explains the connection between the following people, places, and things:

Cairo
Davis
Free Trade Area of the Americas
Foreign Assistance Act Of 1961
Jamestown
John
Linda
Mahmoud
Manama
Miami

 Correctly connecting eight of the above items earns one point toward your final grade for each person in your group. For nine, two points. For all of them, three points.

Since my students might find this post on Google, I’m not going to post the answer until later this week (please don’t reveal the answer if you know it).

The Pedagogical Utility of Half Credit

I structure most of my courses around what I call reading responses — short writing assignments on journal articles that students complete outside of class. These assignments fulfill several objectives:

  • Students read, think, and write outside of class, making them better able to actively engage with ideas during class. As a consequence, I don’t have to lecture as much and the dynamic of the class moves away from me delivering facts while students try to memorize them.
  • Students are able to exercise a limited degree of choice, which increases their sense of ownership and investment in the course (I typically have about fifteen assignments but students are only expected to complete ten of them).
  • Students have repeated opportunities to practice constructing written arguments that contain evidence from “experts in the field.”

It’s easy for students to earn full credit on these assignments. They must be:

  • turned in on time (before class, via course management software),
  • present an argument that addresses the question,
  • contain specific, properly cited references to the assigned reading.

I do not allow rewrites on these assignments because the requirements are very simple and the responses are the basis for class discussion on the days that they are due. Invariably there are some students who cease including cited references to readings in their responses about three-quarters of the way through the semester. I suppose the practice of completing these assignments becomes so routine to them that they get lazy about how they construct their arguments. In these cases the students automatically earn half credit. Receiving a score of 50 percent on an assignment usually wakes them up and gets them back on track fairly quickly.

Active Learning About Plagiarism

All my syllabi contain the usual policy statement about plagiarism — refer to the catalog for the university’s definition, don’t do it, if you do do it you might fail the course. And as is the norm for information that’s in a course syllabus, the statement often gets ignored, and I end up meeting budding plagiarists in my office for face to face discussions.

I’ve started requiring that any student who wants to “discuss” a plagiarized paper and the the grade (of zero) that it has received bring a document (typed, paper) to the meeting. The document has to contain, in the student’s own words, how the contents of his or her paper relate to the definition of plagiarism contained in the catalog. In other words, the student has to argue effectively that the paper was not plagiarized or admit to the plagiarism.

This method prevents the usual weepy sniffling or feigned indignation that occurs at such meetings. The student is forced to reflect on his or her actions, and the consequences thereof, before he or she enters my office. And I get a written confession.

Another benefit is that the process makes me less central to the situation and the conflict becomes more impersonal. When students read the university’s definition of plagiarism and begin writing about it, they see that they have violated a university policy, which I, as a faculty member, am simply upholding.

Using Rubrics As Teaching Tools

In the early years of my teaching career, I adopted rubrics to speed up grading of student writing, but I’d see the same mistakes, from the same students, on paper after paper throughout the semester. The content of the rubric would leave as little an impression on students’ minds as the inked comments on their papers. And there were the usual end-of-semester complaints of “Why didn’t I get a good grade on this?”

Now I have students create their own rubrics (sort of). About a week before the first major writing assignment is due, I distribute a few short writing samples to students. Each sample is a modified anonymous passage written by students in prior semesters. Each passage contains a variety of writing errors — vague or hard to find thesis statement, illogical organization, run-on sentences, spelling mistakes, etc.  I usually hand out five or six different samples. Students read and write comments on the samples and then form groups with other students who have the same one.

While in groups, students compare notes and discuss how the passage they’ve examined can be improved. In the final stage of the exercise, one student from each group reports on the group’s findings to the rest of the class. I jot down notes and ask questions.

I then tell the class that I will create a rubric based on what they have identified as indicators of good and bad writing. Students are therefore responsible for following their own recommendations.

Students make similar comments every semester, so I don’t have to change my rubric much, if at all.

Blog-based Simulations

Two years ago I created a role-play simulation for an undergraduate international relations course. Though the simulation includes an in-class component, much of the action occurs on this blog. Feel free to borrow what I’ve created — just please credit me and my employer in the process. A few thoughts on using simulations like this:

Students are increasingly unfamiliar with blogging. Not only do I need to include a training session in how to use the blog for the simulation, I need to discuss the underlying premise of blogging itself. Though students may be regularly reading blog-style publications, social networking and mobile device apps have eclipsed blogs in their collective unconscious.

A blog should have the capability of delivering real-time updates to students’ preferred means of communication. While I do not necessarily need to know that Zachary replied to Kaitlyn’s latest post with “U rock grrl ha ha,” a torrent of messages appearing on students’ smartphones helps keep the simulation at the top of their screens and at the forefront of their minds outside of class.

The instructor must emphasize to students that any communication conducted outside of the blog will not be graded and, if done in lieu of the blog, will harm a student’s grade. This goes for texting, email, and face-to-face meetings. I tell students that I’ve created the blog to be their online workspace, and it’s their responsibility to use it.

Last item, which applies generally to all team-oriented simulations: individual writing assignments prevent free riders. Student who do a task initially on their own will be less likely to think “group project” when doing the same task later on with others.