Happy New Year to all. I hope our collective breaks have been enjoyable and that we are reinvigorated for the start of spring term! I know I could use a couple of extra weeks, but instead I’m finishing up a paper and getting ready for SPSA next week.
I’m a fan of oral examinations in our field. One of the challenges students face in a written exam is interpreting exactly what we mean in the questions that we ask. Language that, to us, appears clear and obvious, to them is vague and confusing. This is even more the case for multiple choice questions, when there is not only a stem to interpret, but four or five possible choices. No matter how clear we are, students–even, perhaps especially, those who are very prepared for the exam–can overthink the options and choose the wrong answer. Another problem with written exams is that its not exactly a skill set that students need after graduation. I can’t imagine many situations where, outside of formal education and standardized entrance/exit exams, they will be asked to prove their knowledge on the basis of prewritten questions that they do not know ahead of time. I doubt many of us actually grade students on the sentence structure and grammar, so as an exercise in writing its not particularly useful either.
Oral exams, on the other hand, can accomplish the same goals as written exams–testing students’ knowledge and understanding of the material–but have some additional benefits. As an interaction between professor and student, they can help us dig through the BS that fills exam answers and figure out whether the student really knows what they are talking about. It also can help us clarify the question or ask it in a different way to help a struggling or confused student better understand what is being asked. Finally, its pretty decent training for the post-school world, where you may have to defend a political argument before peers or supervisors in the course of a conversation.
We use an oral exam as the capstone project for our majors, called the Overview, so I instituted a mini-overview in my required methods class. The Overview requires students to sit a 45 minute oral exam with two faculty members on a scholarly book, and face questions about the authors argument, values, and methodology and are asked to synthesize those with ideas and issues confronted in their coursework. The mini-overview is a miniature version of that. It acts as the midterm in my methods class, and students read a book chapter or article that I assign (the same one for each student) and sit a 15 minute oral exam with me. In the course of the mini-exam, we focus almost entirely on methodology and analyzing the argument and I have students break down the variables, measures, methods, sources, etc. Students also turn in an annotated abstract of 300 words for the piece, with the annotations noting the X, Y, theory, methods, and findings.
I only had 25 students in this class, so it is perhaps easier for me to do individual oral exams than it would be if I had 100 students. Most of the exams were held during what would have been class time, so it did not take up too much of my time, and grading occurred immediately. If you have larger classes, you could consider training TAs to give these exams, as we trust them with grading anyway.
In general students performed better on this oral midterm than my previous group of students had on their written exam, and this was at least partly due to my ability to probe their responses for understanding, and encourage them to make vague responses concrete. My first crop of students that underwent mini-overview take their capstone Overview this spring, so I will report back on its longer-term impact then.