Mekong Dam Simulation, Part 2

Today we have a second guest post from Sharmaine Loh and Marek Rutkowski, of Monash University—Malaysia, and Joel Moore, Monash University—Australia. They can be contacted at sharmaine [dot] loh [at] monash [dot] edu, marek [dot] rutkowski [at] monash [dot] edu, and joel [dot] moore [at] monash [dot] edu.

In our last post, we described our Mekong River crisis simulation. The assessments that we use for this simulation are designed to reward student preparation and engagement (a detailed breakdown is in this appendix).

Students are initially provided with detailed position descriptions for employment in the organisations to which they’ve been assigned. They are asked to prepare for a mock job interview for that position, which requires them to conduct research and think about their role in the simulation. We have offered this scenario in an applied capstone class, so have required students to identify their own readings and research to be able to fulfil their roles.

Once the simulation begins, students write a weekly strategy memo for the lead member of their organization based on independent research they’ve conducted, an opportunity for them to consider the practical, actionable implications of scholarly work in the social sciences. Students also must also document their interaction with other organisations and the media during the simulation in a reflective journal.

The head of each organization in turn relies on his or her team members to regularly provide advice about the best course of action in the unfolding crisis. If a group suggests a questionable course of action, the instructor uses follow-up questions to prompt students to consider possible negative consequences, e.g. how would investors view a decision to cancel the project?

At the end of the course, students analyze their experience of the simulation in a writing assignment.

The simulation is designed to make it difficult for students to upset the status quo. Local and international NGOs usually must settle for limited gains based on a government’s willingness to placate its critics. While this sometimes leads to frustration and disillusionment for students, it allows them to gain a better understanding of the power disparity between governmental and nongovernmental actors. While students sometimes initially attempt to resolve the crisis by reaching a consensus among all parties involved, they quickly realize that this is impossible due to conflicting interests. While students are allowed to make risky decisions if they are well considered and not purposely disruptive, successfully negotiated political and policy changes in the simulation have always been limited and incremental. 

In past iterations of the simulation, the incumbent Thai leadership has usually been able to retain control of the government and dominate issue framing, in some cases solidifying its position in the process. Thai opposition groups have had to navigate between outright rejection of government policies and a more conciliatory and constructive criticism. Students have learned that political change is difficult to accomplish without a broad anti-government bloc that includes civil society organisations.

Changes at the international level have also been limited, accurately reflecting the shortcomings of the Lower Mekong  governance regime and ASEAN’s commitment to the principle of non-interference. Students’ attempts to amend the 1995 Mekong Agreement have been hindered by states’ competing foreign policy objectives and the strict application of sovereignty. At most, parties have agreed on a controlled and gradual extension of the Mekong River Commission’s supervisory apparatus.

We have identified a few ways in which the simulation can be further improved. Students’ concerns about free riding within teams, while partially mitigated through the use of a team member evaluation tool (e.g. CATME or Feedback Fruits, we used one developed for this class by Joel), have continued. A possible solution could be a “divorce option,” where students would be allowed to “fire” a free riding member. We have also observed that students’ insufficient background knowledge can lead to unrealistic behaviour in the simulation. This could be mitigated by an increased redundancy within groups (multiple students being given the same or similar role) and an added criterion of academic performance in determining group allocation (Joel’s tool for the allocation of students into groups for class assignments has also been used to allocate students into roles for this class). 

Mekong Dam Simulation

Today we have a guest post from Sharmaine Loh and Marek Rutkowski, of Monash University—Malaysia, and Joel Moore, Monash University—Australia. They can be contacted at sharmaine [dot] loh [at] monash [dot] edu, marek [dot] rutkowski [at] monash [dot] edu, and joel [dot] moore [at] monash [dot] edu.

We developed a six weeks long simulation with three contact hours per week about international competition over freshwater resources of the lower Mekong River. The simulation, which we call the Riparian Dam Crisis, is designed to provide students with the opportunity to build collaboration, communication, and negotiation skills while learning about Southeast Asia. Students are introduced to select theories before the start of the simulation and incentivised to conduct independent research and source other relevant materials to inform actions of their groups throughout. 

The simulation involves a Thai-funded hydroelectric dam project in Laos. Most of the dam’s electricity will be purchased by Thailand. Shortly before the dam goes into operation, a drought reduces downstream water to its lowest level in living memory. This scenario, which resembles the real-life Xayaburi dam a few years ago, reflects competing economic and environmental demands, weak regional regimes for dispute resolution, domestic political considerations, and transnational advocacy networks. Students assume the roles of various stakeholders that must try to achieve specific objectives in an evolving situation, such as the Thai, Lao, and Cambodian ministries of foreign affairs, rural NGOs, the regional Mekong River Commission, Thai political parties, and journalists. For example, the dam has been constructed wholly within Laos’s borders, which paradoxically gives the smallest country the largest say in the simulation’s outcome. Cambodia is the most negatively affected by upstream dams in Laos, but it has limited influence over Laos and Thailand because it is not a participant in the project. Meanwhile Thailand is very susceptible to domestic pressure from interests that either support or oppose the dam.

During the simulation, student journalists representing two Thai media outlets conduct interviews and create stories targeting different audiences. The simulation’s other stakeholders need to engage strategically with reporters to have their actions framed in a positive manner. 

Thus, there is one constellation of groups that broadly favours pushing forward with the dam, another one that generally wants to halt the dam, and a third whose position is flexible. After an initial feeling-out period, students identify aligned groups and develop strategies to achieve their objectives. Each time we have run this simulation, students have focused on their efforts on preserving or creating a sympathetic ruling coalition in Thailand after they had exhausted other diplomatic avenues. Students have been quite creative in creating novel strategies to achieve group objectives, such as staging mock mass protest campaigns, lobbying global powers, and bringing down Thailand’s ruling coalition with a vote of no confidence.

In a future post, we will describe how we assess student learning from the simulation and how we adapted it over time in response to student experience.

Typologies for Conflict Simulations and Games

Fresh off the virtual presses is my latest article, Simulations and Games (SAGs) to Teach Conflict and Political Violence, a literature review in the Oxford Research Encyclopedia of International Studies. In it, I pose several new typologies as I consider the key considerations for instructors who are considering what kind of game or simulation to use in their classes. This piece will be useful both to scholars publishing on SAGs, providing ways to categorize their activities, and also to instructors who are trying to decide what kind of SAG to use in their classroom.

Here are 7 considerations or decision points for choosing a game or simulation, according to my analysis of the existing literature:

Continue reading “Typologies for Conflict Simulations and Games”

Content currency

Not like it used to be

A couple of months ago, I had to update some materials on one of our courses. Written in 2015, it dealt with the UK’s relationship with the EU.

We can leave the extent of the rewrite by noting that I was just happy to have something material to contribute.

Obviously, this is an extreme example – a function of our distance learning model and material revision cycle – but it highlights a long-standing challenge of how to address the ever-changing landscape of politics and international relations in our classes.

This has been brought home once again by this weekend’s election of a new Australian government.

Normally, it’s not somewhere that much crosses my path, but I’ve been working on a climate policy negotiation for our new IR programme and have spent some time of late working up country information sheets for the various roles. Including, well, you get the idea.

Continue reading “Content currency”

Say what you see

As part of the package of materials I’m building for our new Masters in IR, I’ve been trying out some different ways of stimulating reflection and discussion with our students.

As a reminder, we run a fully distance-learning model, with weekly asynchronous bundles of written, audio and visual elements, with a lot of our students doing this around work or other commitments.

The mix of elements is an important point for us, both because it maintains interest for students and because it opens up different ways of looking at key questions when opportunities for face-to-face discussion with peers are limited: sometimes just trying to approach an issue in a different manner can help things to click together.

As such, while I’ve been putting a lot of effort into an asynchronous negotiation exercise, I’ve also been looking at ways of tackling other elements in an interesting and engaging way.

So I’ve been exploring some visual analysis of a table.

You’ll know the table, since it launched a thousand memes, back before the visuals from Ukraine became a lot more visceral (in all senses).

Source: DW

We’re written before about getting students to produce memes on subjects, but this time I’m more interested in the image as originally presented.

Strange as the table might be, it’s also evidently a conscious choice (given that Putin met other world leaders in different settings and around different furniture), so the question we might ask of students is: “what impression is Putin trying to convey here?”

That’s partly about the impression on Macron, but also (and more importantly) the impression on other audiences, both within Russia and beyond.

In my exercise, I ask students to write about what they think of these different communications, with some prompts for reflection once they’ve done. These prompts are important because they remind the student that what they see is not necessarily what others see.

This is a key part of this activity, since the polysemic nature of political communication is not always so obvious in other media, whereas visuals set up much more space for multiple interpretations. To make the obvious point here; this table set-up looks so odd to me that it must have some other set of meanings that I have missed.

Moreover, precisely because this image got so reworked for memes and mockery, there’s a follow-up exercise here to ask students to consider what those memes try to do and how they try to do it.

For my students, this will be a 15 minute exercise in total, but if you ran this in class you could easily make an hour of it, through exchanging ideas and grounding it back into wider patterns of Putin’s (self-)representation and communication. Plus how our view of it changes with all that has followed.

Critical thinking and the Ukraine invasion

I’m not an IR person, and I know it.

Unfortunately, a lot of the people I follow on social media do think they are now specialists in warfare, diplomacy or the operations of civil nuclear facilities. These people were also once ‘experts’ in epidemiology, Brexit, macroeconomics, US presidential politics, populism, immigration and many other things besides.

I have my doubts.

This is probably also a problem you face as you try to make sense of the world around us: yes, you know some people who do actually really know stuff, but they get buried in a big pile of hot takes, motivated reasoning and even propaganda.

So what to do?

I’m guessing that Ukraine is an easier case for the readership of ALPS blog to handle, since it’s closer to many of our research interests: even if we don’t work on relevant topics ourselves, then we know the people who do and tap into their expertise.

Of course, as the whole Mearsheimer thing has shown in the past week, even very competent people come up with dubious positions, although you at least get lots of material for your next IR theory class.

(For my part, I’ve limited myself to working up the one element I do feel competent to speak on).

However, for your students this might still be at the edge of their knowledge, abilities and confidence, so how can we help them parse the situation?

For me, task number one has be a strong refresher on how to evaluate information (and it’ll be a refresher, because of course you teach this as a matter of course, right?).

That means making sure they understand the importance of verification, of triangulation, of expertise and of all the other things that we have probably internalised over the years. If we running a class that needed to engage with this I’d be asking students to locate good guides to how to do this, then pulling them together into a master document that they can all use for their subsequent research.

For as fluid as case as an active conflict, information is incomplete and often contradictory, so giving students the tools to determine what they know and what it means is essential. The growing OSINT community is a really good starting point for looking at the operational end of things, while the more strategic reasoning requires engagement with those working in a number of different domains, including Russian politics, military doctrine and sanctions.

As we’ve seen in recent years with whatever crisis you care to imagine, there is a huge potential to access properly informed and well-evidenced specialists on any given topic. But that means cutting through the guff and being able to contextualise what we read.

And that’s a great life-skill to be developing in our students, regardless.

[Turns on Twitter] Seriously…?: Dealing with high-tempo topics

You what?

Next week I’m giving a community class about the situation in Ukraine. Aside from my “that’s not my specialism” queries, my main issue is the obvious one of “what’s the situation in Ukraine going to be next week?”

Of course, as a specialist on EU-UK relations, I have plenty of techniques to hand to deal with subject matter that flies along, faster than any journal article publication timeline. So let’s lay them out, for your benefit and mine.

First up: don’t teach just about today’s events, or even particular much about them.

Any political events happen within a set of contexts and those don’t move so fast. Yes, the flashing headline in your feed is exciting and NOW, but it’s part of a bigger picture. And that bigger picture is going to be more valuable to your students than your hot take, precisely because it’s more durable and gives them the skills to understand what happens the day (or week, or year) after your lesson.

So keeping the contexts and underlying dynamics clear is route one for handling these topics. For Brexit, that meant unpacking British European policy in the post-war, the changing nature of the EU’s operation and the legal and economic logics that might bound action. For Ukraine, I’m reading up on Russian foreign policy, European security architectures and a bit of contemporary military doctrine.

Communicating a framework for understanding is going to be much more useful to students than a narrow explanation of why this event happened right now.

Second: check your feed, but not too much.

While the here and now shouldn’t be the primary focus, you still want (and need) to be able to talk about it: if nothing else, students often want your take on it all and that can be a good way to pull them into the framework of analysis you’re offering.

That means you do need to be abreast of what’s going on, so make sure you have a sense of it all.

In the case of Brexit, I had several classes where important things happened literally as I spoke: then we used that to try and test our framework, as a kind of proof of concept. For Ukraine, the pace is less hectic, but I will need to have answers should someone decide that a Thursday lunchtime is a good moment to launch a cyberattack or a ground invasion.

Finally: don’t panic.

This is always good advice, for all teaching.

Don’t panic, because you’ve done your prep [right?] and you have a analytical framework to soak up surprises.

Don’t panic, because surprises will be as surprising for your students as they are for you, so any response you can articulate is going to be impressive.

And don’t panic, because everyone should understand that things move on. Worst case, you don’t have an answer, and that’s fine: you’re a teacher, not a talk radio pundit. Explain what you can and can’t say, on the basis of the evidence there is and point to what you’d need to know to be able to make a further determination. It’s basically the framework point, narrowed down to the specific thing.

A Human Rights Foreign Policy Game

Today we have a guest post from Michelle Goodridge, academic librarian at Wilfrid Laurier University. She can be contacted at mgoodridge [at] wlu [dot] ca.

After a casual conversation about classroom games with my colleague Professor Andrew Robinson, we created a foreign policy simulation for his course, HR 100 Human Rights and Human Diversity. We had two goals for the simulation: first, have students explore why state actors fail to advance human rights domestically and internationally, and second, measure the simulation’s effectiveness in helping students achieve desired learning outcomes.

We modified the International Trade Game by:

  • Orienting the exercise around human rights instead of international trade.
  • Dividing students into three teams of high and middle-income pro-human rights. democracies, two teams of low-income democracies indifferent to human rights, one team of a high-income state that is anti-human rights, and one team representing an NGO.
  • Introducing the political objective of re-election.
  • Creating different winning conditions for each team.

To form teams, students picked one of several different colored t-shirts that we had laid out around the classroom. Each team received a corresponding packet of instructions and resources. I had the role of The Trader who accepted the geometric shapes produced by teams in exchange for political support units. Andrew injected human rights crises into the simulation via PowerPoint. The simulation ran an hour, with defined victory conditions that needed to be met to have a winner. Often none of the teams met its victory condition, which came as a shock to the students, but it helped illustrate the complexity of international relations.

After the game concluded, we took time to debrief the students, and this is when students made robust connections between the simulation and concepts they had been studying. I can only assume this is because verbalizing these responses right after the exercise is easier than writing them down a week afterward.

We attempted to measure the effectiveness of our Human Rights Foreign Policy Game with pre/post test evaluations. The evaluation results were anonymized, coded, and analyzed using SPSS. We found that the richest data came from students’ responses to the evaluation’s open-ended questions. So far, we have run this simulation in six semesters, and we will probably continue to use it in the future because of the high percentage of students reporting that it helped them learn. For more details, please see our article “Objective Assessment of Pedagogical Effectiveness and the Human Rights Foreign Policy Simulation Game,” Journal of Political Science Education 17, 2 (2021): 213-233, DOI: 10.1080/15512169.2019.1623048.

Statecraft in the International Relations Classroom

Today we have a guest post from Eric Cox, an associate professor at Texas Christian University. He can be contacted at e[dot]cox[at]tcu[dot]edu.

Does the online Statecraft simulation improve student learning when used as a key component of international relations classes? I explored this question in a Journal of Political Science Education article through a controlled comparison of two IR course sections taught during the same semester. One section was randomly chosen to participate in Statecraft, the other was assigned a research paper. The primary finding of the study was that students in both sections performed similarly on exams when controlling for other factors.

Statecraft is a turn-based simulation that divides students into “countries” that they govern. Each country must choose its form of government, economic system, and other attributes. Players also choose whether to focus on domestic spending priorities such as schools, hospitals and railroads, or on military capabilities. They must deal with terrorism, the melting of Ice Mountain, pirates, and rumors. The simulation is, to put it mildly, complex. I have been using it for just over a decade.

To try to put the students doing the research paper on an equal footing with those engaged with Statecraft, I dedicated several days of class to instruction in research writing skills and peer review. The students in this section spent roughly the same amount of time in class on their paper as the students in the Statecraft section did on the simulation. Both groups also wrote about the same amount.

At the end of the semester, I compared class performance on three exams and gave students a brief survey on their experiences. The initial findings were surprising: the research paper class did much better on exams but were less satisfied with the research assignment than the Statecraft students were with the simulation. I obtained access to students’ GPA when entering the course, and re-ran my analysis with GPA, whether students were taking the course for a grade, and whether students were political science majors as controls. Once these controls were introduced, the effect of Statecraft went away. The strongest predictor of course performance was their incoming GPA. Students with high prior GPAs made As, B students made Bs, and so on. Academic performance was independent of the research paper or Statecraft assignment. However, students in the Statecraft section showed a strong preference for the simulation over a traditional research paper, and students in the research paper section indicated they would have rather done Statecraft. Subsequent student evaluations have also demonstrated the relative popularity of Statecraft.

That said, my use of Statecraft has evolved, something I discuss in detail in my chapter of Teaching International Relations. Foremost, I dedicate class time to the simulation, and draw examples from the simulation when discussing IR theory, issue areas, and current events. Students have indicated that the simulation gives them a greater appreciation for the complexity of international relations and the challenges leaders face. 

Editor’s note: previous posts on Statecraft can be found here.

Observing Observation

Two weeks ago, students in my economic development and environmental politics course played my simulation on freshwater resource scarcity in Asia. If my memory is correct, it was the first time running the simulation in the physical classroom, and I was interesting in whether students behaved differently in the face-to-face environment compared to a prior iteration of the simulation that occurred online.

You can lead the students to knowledge . . .

The underlying mechanics of the simulation were unchanged: six teams, each representing a different country with one or more transnational rivers crossing its territory. Turn by turn, the population expands, more food must be produced, and water demand increases, yet countries are building dams upriver and rainfall declines because of climate change. Eventually a country has a famine and millions of refugees spill into its neighbors.

This time around I added a victory condition: members of the team with the greatest percentage growth in GDP per capita when the simulation ended earned five points (out of a thousand) toward their final grades. I put a copy of the simulation’s spreadsheet, which shows how actions taken by teams affect water availability, food production, hydroelectricity generation, and GDP, on the LMS and encouraged students to experiment with it before the simulation started.

Student did seem more engaged with the simulation in the classroom than they had online, though it was far easier for me to observe their interactions. The real surprise was how baffled students were about the cause and effect relationships built into the spreadsheet. Growth in GDP requires growth in hydroelectric capacity, which only comes from building dams. Yet teams were hesitant to build dams. By the end of the simulation, China, for example, had stockpiled enough of a reserve to have constructed over one hundred dams, yet it had built only a handful. The largest change in GDP among the six teams? Only 1.1 percent over a twelve year period.

Students clearly had not tried to figure out the spreadsheet before the simulation started, and none of them seemed to understand the relationship between economic growth, food, and water. Consequently, many of them flailed about helplessly as their country’s water supply steadily dwindled. When asked during the debriefing why they chose inaction instead of action, I got mostly blank looks. As I’ve noted before, many students seem to have little understanding of cause and effect; instead, in their worlds, stuff just happens. While I would prefer not adding multiple assignments to the course to force students to work with the simulation’s causal relationships before the simulation actually begins, it might be necessary.