How Do I Get An “A”?

Last summer, when building LMS sites for my fall semester undergraduate courses, I inserted a link titled “How do I get an ‘A’,” assuming it would get students’ attention. The link was to this short video about the importance of deadlines.*

I decided to expand on this idea for the spring semester and beyond, with an LMS page that contains the link to the video and this advice:

  • The due date is not the do date. Instructions and deadlines for all course assignments are available in the syllabus and on Canvas from the beginning of the semester. Plan ahead and complete assignments several days before they are due.
  • See the syllabus for the location of reading assignments. Ask librarians how to access these materials at no cost. There are computers available for this in the library and at other campus locations.
  • Revise your writing to eliminate as many unnecessary words as possible. Bad writing is an indication of sloppy thinking. If you are not familiar with the revision process, use the Writing Center.
  • Read the feedback on the quality of your work that is contained in assignment rubrics and my comments. It is not possible for me to care more about your learning than you do.
  • Sleep, eat, and exercise. Sufficient quantities of each are necessary for learning.

While the above can be construed as facilitating more learned helplessness among students, I’m finding that my syllabus quizzes just aren’t doing the job of communicating some of the most basic academic aspects of being a college student.

*Courtesy of TikTok via Reddit. Not something I created.

The Death of Curiosity? Part 1

Our fall semester is nearly done, and I’ve already started mentally reviewing it. Although this might be a consequence of recency bias, the teaching-learning environment feels like it has been below average.

Given their annotations on Perusall, many students seem to still have great difficulty identifying the thesis, independent variables, and dependent variable of assigned readings — despite the accurate comments written by classmates.

Attendance in class has frequently been below fifty percent, and a greater portion than usual of the students who do come to class look like they mentally check out during discussions. For context, see my October series on physical presence in the classroom here, here, and here.

Possible solutions to the above problems? Instituting pop quizzes based on Perusall readings and class discussions, machine-graded in the Canvas LMS, comes to mind. If students don’t want to voluntarily eat the carrot of knowledge, then perhaps I should use the stick of multiple choice questions that directly affect the course grade. Two potential drawbacks to this method: first, the difficulty of guiding in-class discussions toward quiz questions that were created before the discussion occurred, and second, potential complaints about not being allowed to “make up” quizzes that were missed when absent. My general policy is not to complicate my life by scheduling alternative testing dates, granting deadline extensions, etc. As I’ve stated before, I regard students as legal adults capable of setting their own priorities.

Before classes end this week, I’ll be gathering slightly more objective feedback on the “skills” components of my two undergraduate courses via anonymous surveys. I’ll report the results in my next post.

Reality Check

As a response to the situation described in my last post, I created an in-class exercise for my comparative politics course — this worksheet:

1. Write the main thesis of these articles by changing each article’s title into a declarative sentence containing “because,” “causes,” “is caused by,” etc.:

Ronald Inglehart and Christian Welzel, “How Development Leads to Democracy: What We Know About Modernization,” Foreign Affairs 88, 2 (March/April 2009): 33-48.

Alfred Stepan, “Brazil’s Decentralized Federalism: Bringing Government Closer to the Citizens?” Daedalus 129, 2 (Spring 2000): 145-169.

Larry Diamond, “Why Are There No Arab Democracies?” Journal of Democracy 21, 1 (January 2010): 93-112.

Javier Corrales, “Authoritarian Survival: Why Maduro Hasn’t Fallen,” Journal of Democracy 31, 3 (July 2020): 39-53.

Scott Mainwaring, “The Crisis of Representation in the Andes,” Journal of Democracy 17, 3 (July 2006): 13-27.

2. Fill in the blank cells in the table below with information from Larry Diamond, “Why Are There No Arab Democracies?”:

3. Given the above, what causes the value of the dependent variable? How do you know this? Is this a Most Different Systems Design or a Most Similar Systems Design?

I gave students 10 minutes to work on these questions individually, followed by 10 minutes in breakout rooms with teammates to discuss their answers. Afterward, I reviewed the lesson by asking students to state what they wrote for each thesis or blank table cell. This occupied the remaining 30 minutes of class. While I don’t know what students thought of this exercise, it’s something I can use in the future either in the same way or as part of an exam.

Identifying How Assumptions Meet Reality

Four weeks until classes end, and I’m noticing some of the same problems in my comparative politics course that I saw a year ago. First, some students are not able to consistently locate a journal article’s main thesis, even though I simplified the assignment’s format, students discuss their work among themselves when creating presentations about the articles, and I review the organization of each article after the presentations. Second, students aren’t sharing notes about assigned articles despite my adaptation of Helen Brown Coverdale’s study huddle system. Since collaborative notetaking with Google Docs didn’t work, I assumed that students would at least share their completed article analyses with their green or red teammates. Nope. While the analyses are graded as individual assignments, the “sharing” aspect is not, so probably students see no reason to do it.

Seven years ago, I wrote about mistakenly assuming that students knew the meaning of methods in social science research. A similar problem might be occurring with thesis. Although students have probably heard the term since ninth grade English, maybe they still don’t really understand it. Or, even if they do understand, they could be unwilling to make the effort required to identify what and where it is in a text. As a more direct colleague put it, the problem can originate with stupidity, laziness, or a combination of both.

A solution might be to ask students to find where in the body of an article its title has been converted into a cause and effect statement. For example, I recently assigned “Authoritarian Survival: Why Maduro Hasn’t Fallen” by Javier Corrales (Journal of Democracy 31, 3). The thesis is essentially “Maduro hasn’t fallen because . . .”

As for the unwillingness of students to share their ideas about readings via collaborative notetaking, I would not be surprised if this stems from being taught since early childhood that reading is an isolated rather than a social activity. I.e., the ideal reading environment involves a room of one’s own, a blanket, a cup of tea, and possibly a cat, to ponder silently the meaning of what one has just read. This technique works fine for people like ourselves, because academia self-selects for the highly literate. But the average undergraduate student probably doesn’t know really know how to think about what they’re reading while they’re reading it. According to colleagues who know much more about this subject than I do, if reading is instead a public activity, the metacognition that occurs in the truly literate becomes visible and transferable to others. Social interaction facilitates a better understanding of the text.

Luckily we live in an era of digital tools that allow a reader to easily interact with a text and with other readers. One of these tools is Perusall, which a couple of English professors on my campus have been raving about. I have asked our IT support unit to link Perusall to my Canvas account so that I can start experimenting with it, hopefully before the semester ends. If that happens, I’ll report my observations here.

New books in teaching and learning

And now its time for a little self-promotion.  

I want to draw our readers attention to two new edited volumes they might find useful in their own teaching.  Full disclosure: I have chapters in both of them, so my recommendation is not without bias. Both are interdisciplinary in approach, which can be very helpful in furthering our own innovation as teachers.

The first book is Human Rights in Higher Education: Institutional, Classroom, and Community Approaches to Teaching Social Justice, edited by Lindsey N. Kingston and published by Palgrave in its Studies in Global Citizenship, Education and Democracy series.  Many of our classes touch on human rights, and this book offers different perspectives on how to bring a human rights and social justice approach to undergraduate education.  All of the authors are connected to Webster University, but are from different disciplines including philosophy, sociology, criminology, law, photography, and psychology.  The approaches look at fostering human rights education at the institutional level (considering campus culture, student affairs, and research programs), classroom level (through specific courses, study abroad, and projects), and the community level (conferences, teaching non traditional students, and legal outreach).  My own chapter evaluates an interdisciplinary course I co-created with professors in philosophy and education on the Millennium and Sustainable Development Goals that included a three day educational simulation of hunger and poverty at Heifer Ranch in Perryville, Arkansas.

The other book is Learning from Each Other: Refining the Practice of Teaching in Higher Education., edited by Michele Lee Kozimor-King and Jeffrey Chin and published by University of California Press.  The social scientists in this book offer innovative ways to approach curriculum design, classroom instruction, out-of-classroom experiences, and assessment.  One of the chapters, Jay R. Howard’s ‘Student Reading Compliance and Learning in the Social Sciences’ touches directly on previous ALPS conversations about encouraging students to do the reading, and is well worth a look. My chapter dives into the literature on simulations and games in the social science, evaluating data from published simulations in political science to determine whether concerns about simulations taking too much classroom time are valid (spoiler alert: I say no).  

There are lots of great books out there on pedagogy, but if you want some very recent work directly speaking to social scientists, you might want to check these two books out!

When students are unprepared for class

In line with Simon’s musings on whether or not he matters, I’ve been wrestling with whether all of my ideas about how to structure classes to get particular results actually work.  Do they matter?  

In one of my classes, only a handful of students were able to answer a pretty basic question: what is the main claim in this reading?  I’m sure many of us have experienced this before, but in line with my strategies on ensuring students do the reading, I thought I was well inoculated against the steady silence of puzzlement, for two reasons:

  1. Students have to write on all the readings each week.  Those papers include an annotated bibliographic entry for each reading, where in 1-2 sentences they must state the main claim of each reading.  Since about half the students wrote last week, they should know this.
  2. In this particular case I was asking about last week’s readings, which we had already discussed.  This was review!  I had mentioned these main points at least once before during our previous classes.

And yet, silence.

That’s not strictly fair.  A handful of students were able to answer my question for each of the readings.  But the bulk of the students just sat there, staring at me. First, let’s review Simon’s thoughts on getting students to talk, and then let’s consider the possible reasons for this, and how to solve them:

  1. They had not done the reading.  Since they only have to write 8 of the 12 papers, these students may have chosen not to write last week–and therefore didn’t bother to read.  
    • Solutions: require more papers. 8/12 was probably too generous, and it is clear that when students do not have to write, they don’t always do the readings very closely (often due to other legitimate commitments, such as work).
  2. They did the reading, but couldn’t remember it. Students may not take good notes when they read, and therefore can struggle with details.  They may also need training in how to identify key points so that they don’t miss the forest for the trees.
    • Solutions: teach students how to take notes on the reading.  Its an important skill, and we should not assume they already have it.
    • Continue to require the annotated bibliographies of the weekly readings so they build this skill over the course of the term.
  3. They did the readings, but were confused.  The readings I am assigning are a mix, but many of them are scholarly in nature.  Not all students in the class are majoring in the social sciences, and therefore may struggle with key terms. It was also a lot of reading–about 100 pages–and some of the chapters could have been split in two because they covered two widely different topics.  
    • Solutions: Review the syllabus to make sure that the mix of readings is appropriate in terms of amount and difficult.  
    • Take note of key terms and review them in class so that non-majors don’t feel lost.  
    • Continue to review the key point of each reading in class prior to discussion so that everyone is on the same page.  
  4. They may or may not have done the reading, but they did not make the connection between our discussions last week and the question of this week.  While I had mentioned the key points of the readings last week in passing, I didn’t make a point of it–I did not write them on the board, or encourage students to take notes of what I had said.  Often students don’t know how to recognize a key point that is made solely verbally.
    • Solution: anytime I mention a key point, make sure I put it on the whiteboard to signal to students that it is important.
  5. They may have known the answer, but chose not to speak up.  Even though I’ve encouraged my students to ‘fail’ in line with previous discussions on ALPS, many of them are afraid to say something wrong.
    • Solutions: whenever possible, use small groups to discuss the question first.  This allows students to check their answers with a small group of peers first, and then share them with the rest of the class if encouraged.  
    • Minute papers–where students take a minute to write down their thoughts–might also give them the time they need to choose the right wording for their responses.
    • Note who in their papers got the answer correct, and then cold call on those students to read their responses.  
    • Using encouraging language and thanking students for offering their response may also encourage quieter students to share their ideas in the future.  
    • Track and increase wait time.  What feels like an eternity to us in the silence is often mere moments, which might not be enough time to process the question and generate a response. There are plenty of strategies out there to do this effectively.

My takeaway: the students failure to answer my basic question is as much my failing as theirs.  We need to recognize the reasons WHY students can’t identify the key point of a reading, and exhaust all the structural and instructional tools and methods we have to get them to a point where they do the readings and are willing and able to talk about them.  Our job is provide the tools and training they need to succeed, and we should always make sure that any issues on the part of our students aren’t caused by a failing on ours.

ISA 2018 San Francisco Report

I’m just back from the International Studies Association’s Annual Meeting in San Francisco, and it was a pedagogy bonanza! Great attendance at the pedagogy panels (even those held at off-times) and excellent discussion all around. One thing I love about us pedagogy types is a commitment to leaving plenty of time for Q&A and discussion, since everyone in the room has some expertise to share.

Victor Asal and I ran a new Career Course on Teaching the Intro Class. We focused on both intro to IR and comparative politics, covering such topics as what to do on Day 1, reading/text options, writing good exams and written assignments, classroom management, and of course, games and other activities to teach the material. Our participants had a ton of great ideas and insights.

On the panel on Theory and Practice in IR Teaching: Effectiveness, Political Engagement, and Active Learning, Marcelo Valenca of Escola de Guerra Naval discussed the changing nature and approaches toward pedagogical training in Brazil. He pointed particularly to the impact of the pedagogy workshops held by the College of Wooster’s Jeffrey Lantis, Kent Kille, and Mathew Krain as being instrumental in bringing change to that country. The Wooster Three were mentors of mine when I was in graduate school, so I wasn’t surprised but still pleased to learn about the far-reaching impact of their efforts.

I presented a paper on using a game-version of the television show Survivor to incentive my students to complete the readings, pay attention to current events, and learn geography. The results on the geography front were…not what I expected. Students who took a single, traditional Map Quiz performed much better than this students in the game that had regular, weekly practice in geography! But as we’ve said many times before, failure can be a useful learning tool and this has prompted me to really investigate the key variables about the game that may have hindered learning, so more on that in the future.

An audience member on that panel (Ian Manners, University of Copenhagen) pointed out the utility of using student-created learning modules as a way of engaging students in learning content at a high level. I love this idea, and i’m going to use it in my seminar on sex, marriage, and violence in the fall.

Finally, some conference news: ISA is holding its first Innovative Pedagogy Conference on November 15th in St. Louis, the day before ISA’s Midwest meeting. There will be a plenary, keynote speech by ISA President Patrick James, a graduate student teacher training certification session, and 8 workshops on subjects such as faculty led study abroad programs, designing curriculum, research literacy, civic engagement, assessment of active learning, publishing in the scholarship of teaching and learning, designing simulations, and using simulations and games to teach political violence. At least two members of Team ALPS (myself and Victor Asal) will be there, so please join us!

ISA now has a Professional Resource Center which includes a syllabi archive and a great site for finding some good simulations to use in your classes. You do have to be a member to access the PRC but consider sending in your materials for inclusion!

Finally, a note on submitting to ISA: the two sections that tend to sponsor ALPS-style papers and roundtables are Active Learning in International Affairs (ALIAS) and International Education. I’m section program chair for the latter, and talking with the program chair for ALIAS, we not that we don’t get a ton of first-round submissions. If you’ve thought about presenting a paper or organizing a panel or roundtable relevant to either section, please do so–we are eager for more submissions for next year’s conference in Toronto. There are also opportunities for Innovative Panels, Career Courses, and Flash Talks–check out ISA’s website for more details. Some topics that I know are of interest to my section include best practices in study abroad, transformations in higher education (particularly from a comparative perspective), the challenges of being a faculty administrator of international programs, and curricular design features for IR programs.

That’s it for now! As usual, conferences spur me into thinking in new directions for my pedagogy, and I’m excited to start putting some of these ideas into practice.

Getting Rid of Everything But the Kitchen Sink

This post was inspired by the ideas that Erin Baumann, Harvard, and John Fitzgibbon, Boston College, presented at the APSA Teaching & Learning Conference two weeks ago. They pointed out that instructors, myself included, often begin the course design process from the content-centric position of what we want students to learn. We collect resources for student consumption that illustrate principles and facts that we think are relevant to the subject of the course. Content for learning triumphs over the process of learning.

When engaging in this sort of scavenger hunt for content, a potentially much more useful question to ask is “What don’t students need?” The value of this approach hit home during a redesign of my course on economic development. I’ve taught this course for years at a variety of universities, and while I always make it a practice to update the readings, the learning objectives with which they were associated remained a fairly static and not very well thought out conglomeration. For the fall 2018 semester, the course is being consolidated with another course on environmental politics, and I’ve been forced to think hard about how I can adequately serve both subjects simultaneously.

I concluded that my existing course design wasn’t very elegant. Though I was fairly satisfied with what students were doing in terms of assignments and exercises, my predilection for the subject material had caused me to fall into the trap of “it would be nice if I covered . . . ” rather than ruthlessly restricting my syllabus to only the most essential content.

I needed a new design process, so I tossed everything about the existing course into a spreadsheet. Then I identified old and new topics — learning objectives actually — that I thought were critical to the new course, and deleted everything else. Same for readings — I discarded whatever didn’t narrowly correspond to the now smaller number of learning objectives, and found a few new ones that did.

I’m sure students will be pleased with the shorter reading list, even though their ability to skip over the most important, more-difficult-to-digest material in favor of breezier newspaper and blog articles has been greatly reduced. I’m happier because the course will be less of a bugaboo to teach given the pared-down content.

Links to the full series of posts on redesigning this course:

Collaborative Reading – Follow-Up Thoughts

Today we have an update from Colin M. Brown, College Fellow in Government at Harvard University. He can be reached at brown4 [at] fas [dot] harvard [dot] edu.

In a post last year, I talked about the potential of using annotation software like CritiqueIt to make the reading process more collaborative. In short, by creating a single copy of the reading that students can mark up together online, there’s the potential for creating discussion prior to and during class, and also for getting students to see course readings as statements in a dialogue.

My first use of CritiqueIt was promising, but I’m less satisfied after having further used it in two undergraduate seminars plus a graduate-level, continuing education course.

Two things have continued to work, probably still making the tool a net positive. First, as a diagnostic tool CritiqueIt makes class prep easier, because it gives me a window into what students find interesting or are struggling with. Students indicate their interest implicitly or explicitly, and they also seem relatively fine with using their comments to signal that something doesn’t make sense—especially useful when they’re having difficulty with something I didn’t expect. Second, they seem to like it. Students seem to perceive it as a cool new gimmick, and I seem to get credit for trying it.

However, while CritiqueIt lets me know what students want the conversation in class to be about, it hasn’t generated a conversation among students on its own. Students have posted a few responses to other students’ annotations, but the kind of exchange I mentioned in the original post hasn’t happened consistently. Students seem to be completing the assignment because it sends me a signal that they have, in fact, engaged with the reading. This provides me with feedback for me, as mentioned above, but was not my ultimate reason for using the tool.

Since I want students to see political science writings as part of an ongoing exchange of ideas, there are three changes that I’ll be implementing next semester, thanks to insights from my colleague Daniel Smail, who has been experimenting with the same tool in his history courses:

  1. Build CritiqueIt into the entire semester. Students need time to get used to the tool, and the expectation that it’s an integral part of their work.
  2. Assign early readers. If everyone reads the night or morning before class, there’s less incentive to start a dialogue that none of their peers will respond to. By dividing up the collaborative readings and having one or two students make their annotations three or four days before class, there will be more time for students to jump into the conversation.
  3. Work CritiqueIt into summative assessment. This also normalizes the use of the tool, and gives students the incentive to develop better commenting skills. Students will need several days to virtually hand the document back and forth so this has to be accounted for in scheduling other assignments. But giving them a longer piece of journalism on the broad course theme and having them react to it, and then to each other, knowing that their comments will be graded on some explicit rubric, might be a better way to tease out their ability to respond critically to arguments—and actually use something they learned from class.

 

The First Day of Class: Remix

As classes start up again for the fall semester, this might be a good time to revisit some great ALPS posts on how to approach the first days and weeks of the term.  We recommend:

Start the way you finish–A reminder that active learning–regardless of when you may have scheduled a simulation or other activity–begins on day one.

Picture it! A game for the first year students that teaches students to create and read maps while learning how to get around campus.

Close reading a syllabus–why not quiz your students on the syllabus to incentivize them to read it thoroughly?

Government in our lives--an idea for starting that first class session of American politics.

Today’s lucky winner is… and The other side of presenting–two posts that look at how to approach student presentations, from requiring all students to show up ready to present on the day’s topic to teaching students how to be the audience for a presentation.

And finally, because every class benefits from a bit of lego, take a page from Susherwood’s playbook and think about using lego in your classes.

 

Happy Fall Semester!