This week we had the pleasure of welcoming Sebastian Bae to our campus. Sebastian is a wargame designer and research analyst for CNA, and also teaches a course on wargame design at Georgetown. Amongst other events during his visit, he gave a talk called The Educator’s Toolkit: Learning to Use Wargames, and I want to highlight one of the key contributions of this talk: the six elements of good educational games. While Sebastian was focusing on e war-games, this advice applies to any educational gaming, inc. in politics and government.
At ISA a couple of weeks back, I facilitated a Teaching Cafe discussion on AI and Chat GPT’s impact in our classes. Thanks to the Innovative Pedagogy Conference Committee generously allocating us space, several colleagues from a variety of different institutions stopped by to share their thoughts and ask questions about the ethics, practical responses, and positive aspects of this technology. I’m going to share a few of these responses in case they aid others in thinking through how AI will affect their teaching, with the caveat that AI is advancing at a rapid rate and many of the strategies we discussed will be outdated very quickly.
I’ve categorized our conversation into three themes: how to mitigate the impact of AI in our classes; ethics and academic honesty; and leveraging AI to teach.
I’m back from Montreal with an overwhelming to-do list. Regular ALPS readers may have noticed that in recent years I haven’t been writing here as much; that’s partially due to free-riding on Simon and Chad, who do an excellent job; part because I don’t teach undergraduate students anymore; and part because I’m busier than I’ve ever been. I’ve promised Simon that I’ll start posting more, and so here’s an initial effort: unpacking the excellent roundtable discussion on early career instructors at ISA 2023: why we are remiss as a profession in providing support, and some tools and considerations for changing that.
I co-chaired the roundtable with Michael Murphy of Queens University–and if you aren’t reading his work, you should. He is the one who coined the ‘early career instructor’ moniker, an important way of considering the needs of those who are first starting out teaching. As a profession, we generally do a terrible job of preparing our ECIs for the classroom. With some exceptions, graduate students are rarely actively encouraged and supported in pursuing opportunities related to teaching: in general, such opportunities impose some kind of cost to pursue, in time, money, or reputation. Many have shared that they are either actively discouraged from spending any time on learning to teach, and that they are told their career will suffer if they are perceived as caring too much about teaching.
Fresh off the virtual presses is my latest article, Simulations and Games (SAGs) to Teach Conflict and Political Violence, a literature review in the Oxford Research Encyclopedia of International Studies. In it, I pose several new typologies as I consider the key considerations for instructors who are considering what kind of game or simulation to use in their classes. This piece will be useful both to scholars publishing on SAGs, providing ways to categorize their activities, and also to instructors who are trying to decide what kind of SAG to use in their classroom.
Here are 7 considerations or decision points for choosing a game or simulation, according to my analysis of the existing literature:
ISA was full of great ideas in the teaching and learning space, as it usually is. I want to talk about the one that has prompted me to blog for the first time in too long. Short version: chairs or course coordinators should screen student course evaluations for harmful, vitriolic comments prior to passing them on to instructors. First, credit: this idea originates with Dr. Meg Guliford, Penn Provost Postdoctoral Fellow at the University of Pennsylvania, who was a panelist on a roundtable for early career faculty to talk about their experiences as teachers. It was a fantastic panel set up by Michael Murphy of the University of Ottawa, and I’m using this platform to raise the signal on what I think is an important practice that should be standard at all institutions.
Dr. Guliford noted the harmful effects of reading vitriolic comments on student evaluations, particular for a professor that is BIPOC, a woman, LGBTQ+ or a member of another marginalized community. Imagine you are scrolling through stacks of evaluations after a class has ended, looking for constructive feedback that you can use to reflect on your teaching practice. Instead, you read the most unconstructive of comments–racist, sexist, hurtful language that is included under the veil of anonymous end of course evaluations. There is no value in an instructor reading such comments; the practice is strictly harmful to the morale and mental health of the instructor.
So why not screen them first? Student evaluations are not private–they are typically processed by someone who passes them on to instructors after course grades are posted. Often copies are given to departmental leadership to review the performance of faculty in the classroom, and they are referred to in decisions on tenure and promotion. Why not then, as part of the process, have a step where someone in leadership reviews the evaluations and simply removes any comments that are entirely unconstructive and hurtful? Of course negative comments that are constructive in nature (“I did not get any feedback on assignments; the professor showed up late constantly; the professor was unprepared or unclear”) should remain–I only advocate for removing the kind of comments that can are entirely meant to hurt. To use the famous phrase, ‘you know it when you see it’. If you don’t think that happens, or have never seen it–I’m happy for you, but ask that you don’t assume your experience is representative.
In my view, this practice should be standard at all institutions. Sure, it will require some extra time from departmental leadership, but I can think of few things that cost so little and yet could do so much. Big thanks to Dr. Guliford for raising this idea and I hope to see it adopted widely.
I’ve been in a few sessions recently where well-meaning faculty point out how important active learning is—true!—and then immediately mention ‘simulations and games’ as key examples of active learning (AL). Also true! But let’s be clear, simulations and games aren’t the only kind of active learning. They aren’t the most common kind, the easiest to do, or even what I would recommend that most faculty start with. When the right simulation or game is chosen, executed well, and debriefed effectively, it can be a great learning tool. But games and simulations are neither necessary nor sufficient for active learning, and I want to encourage everyone to think more broadly about how to increase AL in their classes.
Active learning is any tool, technique, or approach that calls on learners to actively engage in the learning process. The point is not the tool itself, but adopting a learner-centric approach that ensures that students are not simply passive recipients of information. ‘Activating’ the students, then, is about asking them to think, process, and make connections about the material, rather than just listen, read, or write down information. In some cases, a passive approach makes sense! Sometimes you really do just have to transmit information. The problem arises when we consistently turn to passive approaches without considering and experimenting with active approaches, which have a solid record of producing better engagement and learning. See for example Deslauriers et al 2019, where even students who thought they learned more from a more passive approach actually learned more from an active one.
Simulations and games, then, can be active or passive, depending on whether everyone has the tools to effectively participate or actively watch and listen. Watching others play a game is only active if the observers are prompted to provide comments and input based on their observations. In such cases, they are active observers. Even participation doesn’t necessarily make the experience ‘active’. A simulation or role-play exercise where a student is too anxious about their performance or grade to pay attention and fully participate is not active for that student. So AL is not just about the activity you do, but how you use it and help students learn from it.
Moreover, AL encompasses so much more than simulations and games. Structuring a lecture around a provocative question, where students are encouraged to think through the steps as you go along, can be active. So can asking good discussion questions that lead to dynamic student to student debates. Asking students at the end of class to reflect on what they learned that day (or what was still confusing) is a method of active learning, and in can be done in one minute at the end of class, or as a written, audio, or video journal they create throughout the term.
When you consider that active learning can really be just small interventions in teaching (as Jim Lang puts it in his book,Small Teaching: Everyday Lessons from the Science of Learning), it suddenly becomes achievable for everyone. Simulations and games are sometimes a tough sell—they can seem juvenile or take too much time away from other content. But active learning? The benefits are clear and centering such techniques doesn’t actually require much work or time.
Even this blog makes this mistake—we are Active Learning in Political Science, and yet most of our coverage is on games and simulations. So consider this a call for a broader approach, one that brings legions more faculty into the world of active learning, without requiring a conversion to the gaming world. Let’s look for the small interventions that anyone can use—from a great discussion question to a good group activity to great reflective prompts—and be more careful with how we define and explain what active learning really is.
I mentioned Discord about a year ago as we were all turning to virtual instruction at the start of the pandemic. I want to return to it specifically in the games and simulations context, though, as it has some really useful properties that can aid those instructors looking for a way to run their online simulations. If you are ready to start thinking about how to run Model UN, Diplomacy, or other complex simulations online, you should really consider Discord.
Discord is a social media platform used by gamers, podcasters, and other content creators to connect with their communities. Each group has their own discord ‘server’, a private space that you can only enter with an invitation. Inside, you can create text and voice based ‘channels’ that let you structure conversations by topic. These channels can be open to everyone on the server or private and hidden. As the server creator or administrator, you also have a lot of latitude for customizing settings–such as making something read-only or enabling ‘slow mode’, which prevents any one person from dominating the conversation. And server members can message each other individually or create small groups for private conversation. The text conversation is asynchronous, but it is easy to jump into a voice channel for voice-only or video conversations.
This kind of format lends itself very well to running complex simulations. There are several key needs for running an online simulation:
Instructors must be able to review rules and procedures, share documents and updates, and take questions from students, publicly and privately.
Students need to be able to post in-character public messages for other participants to see.
Students need to be able to post privately to their teammates, if they have them.
Students need to be able to send private messages to other students for secret negotiations.
Students may need to post files or links, share their screen, or jump onto a quick voice conversation.
It is easy to do all of this in Discord, without the constraints of a standard learning management system/virtual learning environment. By creating ‘roles’ in the server with different permissions, you can divide students by their teams or in-game roles and set channels that only they can access and that can identify them within the server. This makes communication much easier. For example, if you are running a UN Security Council simulation, you can create a ‘role’ for each country in Discord. You might not need to set up private channels for each country if there is only one person in each role, but this allows students to message each other without having to check a list of who is playing what role. They could also have a public channel for making speeches, and another where they upload and discuss the wording on resolutions. If you are running a full UN simulation with many different committees, you can have channels dedicated to the General Assembly and each committee, and private channels dedicated to each country so members of the same team can talk privately and share information. Discord therefore supports simulations both large and small.
I’m using Discord right now to run a game of Diplomacy in my ISA Career Course on Games and Simulations in International Relations (with Victor Asal). There are plenty of online platforms that you can use, but I chose to use Discord because I didn’t know in advance if I would have more than 7 players. Most online platforms don’t allow for teams–but Discord does. Here is what the server looks like:
As you can see, I have a general channel for administrative purposes. I’ve since created a new read-only channel called ‘maps and result’s where I post the outcomes of each game turn along with updated maps. The public channels–text and voice–are open to all players if they want to openly communicate. Italy has made a call for peace and protection of the status quo–but no responses so far! the other channels are organized by country category. Each country has a private text and voice channel open only to their team and the facilitators. They also have a private ‘orders’ channel where they submit orders for their units each turn. I use those channels to adjudicate each turn. If they want to message another team, all they have to do is right-click on the name of the person they want to message (their country name is next to their name) and select ‘message’ and that will open up a private conversation for negotiations. The person-shaped icon in the top right of the screen pops up the list of server members for this purpose. It will also tell you who is online in case you want to invite them into a voice chat.
Running the game this way instead of over email or through an online game system gives me several advantages as an instructor. I can keep tabs on most of the gameplay, although some private conversations I would only see if I’m invited to join them (something you can require if you want). I also have a record after the gameplay of everything that happened, which is useful for debriefing, grading, and assessment. The interface is easy to use, and once students get familiar with it, you can reuse it for different games and exercises throughout your course. I can also allow ‘observers’–people who want to watch but not play. I can give them as much access as I want–for example, I can limit them to read- and listen-only so they can’t interfere with the game play.
I’ve used discord for running an monthly trivia game as well as a 200+ person multi day conference, so I can attest to its robust capabilities. It is free, accessible from outside the US, pretty easy to learn, and has a robust mobile app that make it accessible to students. The main downsides are that the server creator needs to put in a bit of work to figure out how to set up the server to meet your needs, and that the video and screen sharing systems aren’t always reliable. Asynchronous text channels and voice channel work just fine though.
I know a lot of faculty want to run simulations but are restricted by social distancing or virtual classrooms. If you are ready to try something new, try Discord. I have no relationship with the company and am not being compensated by them for this post–I just want to recommend something that I’ve found very useful in my own teaching.
If you are teaching synchronous virtual classes on Zoom, Webex, or any other teleconference platform you are probably using breakout groups for small group discussions or student presentation preparation. Breakout groups are a great technique to break up a session and help build connections between small groups of students, but they suffer from three core problems:
Students don’t remember or understand the prompt and take awhile to get started.
Coordinating how to take notes or otherwise share the group’s work with other groups can be difficult and time-consuming, and may result in a single student doing most of that work.
Students don’t get a quality set of notes from the presentations of other groups, reducing the likelihood that they will get much value from what other groups have done.
Collaborative document editing solves all three of these problems.
This idea is courtesy of Dr. Jenny Cooper of Stonehill College, who has found great success in creating a seamless breakout group experience in her classes. Instructors create a shared slide presentation in MS Teams or Google Slides that contains a slide with the prompt, instructions for the group work, and any expected output. This is followed by individual blank slides for each group to fill in, labeled ‘Group 1’ ‘Group 2’ etc. Share the link to the presentation with students, and then every member of each group can access and edit the document in real time during breakout groups, recording notes, images, or graphics in their assigned blank slide. The result is a single shared document that contains the work from each group, eliminating the need to share screens or additional files during presentations and ensuring that students have a complete set of notes they can review after the class.
This method can be used by anyone regardless of what teleconference system you are using. I advise that only those classes already using MS Teams should use the Teams method; everyone else should use Google Slides. This is easy to use for students: Google Slides does not require students to create an account to access or edit a document; all you have to do is send your students a link with editing privileges to the slide presentations, or post one in your LMS/VLE. They will click on the link and immediately be able to edit the document in either platform. As for faculty, if you have ever created a PowerPoint or other slide presentation, then this method will require minimal effort to adopt.
The only drawback is that there can be connectivity issues if a lot of people are accessing the same document at once. If you see that happening, you may want to ask a single student in each group to act as notetaker, and to share their screen within the breakout group so that their group mates can easily see what they are writing. In addition, students accessing Teams or Google Slides on a mobile or tablet may not have full editing functionality, so notetakers should generally be students using a computer.
Here is an in-depth guide with screenshots on how to do this in both MS Teams and Google Slides:
For those of us holding synchronous online class sessions, you will probably end up using breakout groups at one point or another. Most of the major video conferencing platforms have some capacity for splitting participants simultaneously into separate virtual rooms, letting you hold small group discussions or facilitating other kinds of group interaction and work. Here are five tips for increasing the effectiveness of your breakout groups.
Design concise prompts with clear instructions and outputs. More so than when in the physical classroom, it is really important to have very clear prompts so that students know exactly what it is they are supposed to be doing in the allotted time. The Transparent Teaching project calls on us to ensure students understand the purpose, required tasks, and criteria for success for any assignment, and this holds true for discussion prompts as well. In particular, make sure students know what output is expected, whether that is a collective answer to a question, a summary of their key discussion points, or a written product of some kind. Having an output will increase student focus on the prompt and motivate discussion.
Excessively communicate your prompts. We’ve all been in the situation when an instructor asks us to do something, and after we move around or open the required software we realize we can’t quite recall the instructions. Breakout rooms are particularly susceptible to this, especially as it can take a couple of moments for everyone to transfer from the main video conference room to the breakout room. Simply telling students the prompt right before the move to the breakout groups, then, will likely result in many students being unclear on what they need to do. It is much better to over-communicate your prompts then the reverse. So, post the prompt on your LMS/VLE prior to or during class, so students can download it. Put it in the written chat. Share it on your screen while also explaining it to everyone. Pause and ask if anyone has questions about what they are supposed to do before you send them into their groups. And if you use Zoom or another program that lets you broadcast a message to everyone, do so 30 seconds after the breakout rooms start as one final reminder. This will make sure that students don’t spend the first two minutes of your breakout room trying to recall what they are supposed to do.
Decide whether you want stable teams or constantly changing groups. Stable teams help students get to know each other as they work with the same small group again and again. That can be essential in a fully online course where building connection and community can be very difficult. Teams can name themselves and even compete with each other during the course. At the same time, if conflicts develop, students can feel stuck and isolated if they are always with the same group again and again. Plus if you can’t set breakout rooms in advance, you’ll have to manually assign each student to their correct team every session. One possible solution is to change teams up every few weeks. That lets students get the benefits of a stable group, but they also know that if they are unhappy they will have a new team soon. Alternatively, use teams but regularly poll your students to see whether they are happy or would like a change, so you can tailor groups to their preferences.
Stay visible while the groups are running. In the physical classroom, you can look at into the room and get useful clues about who is doing well and who is struggling. You can easily see which groups are in animated discussion, and which ones are silent and looking confused. You can also easily wander from group to group. While you don’t get some of those clues in the virtual world, it is still important to check in regularly with your groups. You need to know that they understand the task, that the time you’ve given them is sufficient, and to give them the opportunity to easily ask you questions or get your input. Pretty much all breakout room platforms let the instructor jump from group to group. Do just that–pop into each group, stay for a couple of minutes and provide answers or assistance as needed, and then jump to the next.
Use collaborative documents to capture the work of each group. One challenge with breakout groups is figuring out how to share the work of each group. In most platforms, students can access a whiteboard or share their screen, but they have to then save that document while still in the breakout group, and then figure out a way to share it with the rest of the class. A better idea (courtesy of Dr. Jennifer Cooper of Stonehill College) is to set up a single collaborative document that all the students can use to record their presentations or answers. Create a Google Slides presentation with a number of blank slides, labelled ‘Group 1’ ‘Group 2’ or with team names, if you are using teams. Share the link, allowing anyone with the link to edit the document. Ask students to record their prompt responses or other outputs in one of those blank slides. All the students can access and edit the slides at all times, meaning that every member of each group can record their thoughts or help build the team’s presentation. This also makes it very easy share their work with other groups, as everyone will already be looking at the same document. Once the synchronous session is over, they will still have access to it, which can be a helpful addition to their class notes.
There you go! Five tips that will improve your use of breakout groups. If you have additional tips, please share them in the comments!
The Call for Proposals is now open for the Fall 2020 NAFSA Research Symposium*, which will be held virtually in partnership with George Mason University’s Center for International Education and the Office of Fellowships on Friday, November 20, 2020 at the end of International Education Week. For the first time, in addition to the standard research panels, we will also offer a virtual poster fair.
Please review the Call for Proposals guidelines before submitting either a 1-page paper proposal (due September 7) or a 250-300 word research summary for a poster (due October 5).
Paper proposals should present original, unpublished research in international education; poster submissions may focus on ongoing or completed research relevant to the broad field of international education.
*If you are interested in becoming a Peer Reviewer for this & future events, please email research@nafsa.org stating your research interests (topics/methods/etc).