Google Forms

Google Cookie MonsterAs I wrote in my post on the perils of small classes, this past semester I used Google Forms to create a digital ballot for presentation competitions. The ballot worked well — students could hide their votes from other students, and tabulating the results only took a few seconds on my part.

The success of the ballot led me to adopt Google Forms for end-of-semester teammate evaluations. This turned out to be a much simpler method of incorporating individual accountability into collaborative projects than the worksheets I had used previously in a first-year seminar and a capstone course. No time wasted in class while students complete evaluation forms, and no entering of numerical data into a spreadsheet. I create one form for the whole class, which I send out by embedding the link in one email. Google does the rest for me.

Some students failed to follow directions, but that happens regardless of whether an evaluation is on paper or electronic. As stated on the forms I created, I just deleted those responses from the results.

Presentation Fail Part II

Cat Xmas LightsA follow-up to my last post about presentations and the problem of transfer:

Last week students designed and delivered team presentations for the fourth time this semester. Most teams again did not communicate a coherent argument. Many of students’ essays submitted earlier in the week suffered from the same problem. I can’t tell if students simply ignored the essay template I had created — must I make this another graded assignment so it gets used? — or if they are incapable of using an outline to organize a piece of argumentative writing. Given that the essays are supposed to help students sort out their ideas before they begin collaborating on presentations, the presentations are garbage in, garbage out. 

From a more macro perspective, students appear unaware of the difference between haphazardly collecting facts about something and seeking information for something. Simply relaying what is described in the readings in the absence of an over-arching narrative muddles students’ messages to the point of incomprehensibility.

While being married to an English professor might make me more sensitive to the function of narrative than the typical undergraduate, it looks like students need some basic help with storytelling.

Effective storytelling persuades as well as informs. The ultimate goal is not to raise awareness but to motivate people to take action. This means a story should produce an emotional response in addition to communicating facts. As Maya Angelou once said: “I’ve learned that people will forget what you said, people will forget what you did, but people will never forget how you made them feel.”

It’s quite possible that the unsatisfying results I’ve been getting from the essays and presentations are caused by the absence of an emotional hook. In these tasks, the application of theory to particular cases is supposed to supply the narrative arc, but students might not find this personally meaningful. They might not care about the answer they get when they ask themselves “so what?” 

Reframing these assignments in ways that encourage students to become emotionally invested in them will take some effort. At minimum I will need to make more explicit the connections between theoretical explanations and the consequences of policy decisions on ordinary individuals. 

A simple exercise that might help drive the connection home is a 100-word précis in which students state why something happened and why it mattered to who it happened to. But I don’t know yet how to integrate this with the theory essays.

Presentation Fail

More on this semester’s comparative politics course:

Blind MonkeyAfter doing the in-class exercise on how to produce a concise thesis statement, I created this template for students to use when writing essays in which they apply theory to historical events. We shall see if students take advantage of it on the next essay assignment.

Student presentations have also been problematic. My instructions for this task have been:

Your team’s presentation needs to discuss which theoretical perspective (rational actor, structure, or culture) best matches the readings for your theme for this geographic region. Include specific examples from the readings to support your argument.

Teams create their presentations after their members have individually written essays that accomplish the same function, a deliberate sequence on my part. However, the presentations have been terribly organized — no clear thesis statement and few to no examples drawn from readings that actually support whatever argument students think they are communicating.

It’s possible that my directions are still too broad and that students need more step-by-step instructions; if so, the easy solution is to modify the template that I created for essays and require that teams use it when designing presentations. 

I don’t really want to do this. I prefer students to be creative in their approach to solving problems and to take responsibility for their learning. To continuously break tasks down into smaller pieces and decrease the need for effort or ingenuity risks turning students into box-checking monkeys. Yet without enough structure it is unlikely that an assignment will serve its intended purpose.

This tension reflects the difficulty in overcoming the problem of transfer. My assignments — which in this course include fourteen one-page responses to readings, five multi-page essays, and five presentations — represent multiple opportunities for each student to develop a single skill, the effective communication of an argument. Yet students don’t see this. They are blind to the possibility that a technique that they have learned to use in one context can be successfully applied in another one. After fifteen years as a professor, I still am trying to figure out how to move students from needing a list of steps to follow to being able to recognize that they already have the tools needed to figure things out for themselves. 

Mad Men of the 19th Century

Chinese MenLast week I gave a brief presentation on John Thompson’s China in one of the small classes I’m teaching this semester. For the second part of class, I gave students this team-based collaborative exercise, which I’ve named Mad Men of the 19th Century:

The year is 1878. You work for the Vanderbilt Exotic Travels Company in Newport, Rhode Island, a company that arranges luxury travel expeditions to foreign lands. The company has launched a new tour: a nine-week expedition to China.

Your team’s task is to choose two images from John Thompson’s photo compendium – one view (a landscape or street scene) and one type (a portrait of an individual) – for a brochure that promotes the tour to China. You team will need to prepare a five to seven minute sales presentation that uses either the five C’s, juxtaposition, or framing to explain why these two photos will convince people to pay $1,489 to join the tour. Teams will deliver their presentations in today’s class.

Your team’s presentation should focus on answering two questions: What sells a product? What will sell this product?

My primary goal for the exercise? Get students to explore the biases contained in what at first glance appears to be an objective visual historical record, through an activity that has more authenticity than an abstract academic essay. Since I thought of this exercise at the last minute, I had low expectations, but it went fairly well. Students did interpret the photographs chosen by their teams in meaningful ways. I did notice that students are generally unfamiliar with tasks that simulate what happens in the workplace — in this case, the use of images to communicate specific messages — which is extremely unfortunate.

Does Size Matter? The Perils of Small Classes

JawsSome of my courses this semester have such small enrollments that team-based projects and classroom activities have become problematic.

Balloting in presentation competitions is one minor example that I have apparently fixed. I regularly hold classroom competitions in which teams of students present on a topic and then select the winning team by voting with Monopoly money (see here, here, and here for more details). When voting, students come to the front of the room and place their money on placards with team numbers written on them — the only rule being that students cannot vote for their own team.

In the first two competitions in one course I noticed little variation in the sums of money received by different teams, even though some presentations were clearly superior to others. I asked the class about this unlikely result. I found out that in such a small class where everyone has interacted in some fashion with everyone else, students did not want to risk publicly embarrassing badly-performing peers or be judged as cruel, so they distributed their money evenly across teams regardless of presentation quality. My solution? Create a ballot on Google Forms through which students can anonymously select the best-performing team. After the last presentation of the day, I email students the link and they submit their responses. Students’ votes now better reflect the quality of the presentations. I also find that it’s easier to tally results with a spreadsheet on Google than to count paper money.

I don’t know a similarly-easy solution to other size-related problems. I recently used an ICONS simulation for the first time (more on that experience in a future post) in a class with only eleven students. Six nation-states comprised the simulation’s actors, so five states were represented by two students and one state by just a single student. If the latter student had been absent on either of the days I ran the simulation, or if two students from the same team had been absent, the exercise would have been wrecked.

In the same course, I had organized a significant portion of classroom time around a sequence of eight topics. For each topic, a student team was supposed to give a mini-lecture and then lead the rest of the class through an activity for some active learning-based peer-to-peer instruction. Then in the subsequent class, students take a quiz on the topic to reinforce the previously-presented material. With only eleven students, I could form only four teams, which left me with the task of delivering the content for half of the topics in the syllabus — defeating the main purpose of the exercise for fifty percent of the time.

Given that my students have priorities in life that often conflict with attending class, I now believe that teams should contain at least four or five students. With only two or three students, there is too high a probability that most or all members of the team will be absent on any particular day. This in fact happened yesterday: only a single member of two different teams attended class.

But if I increase the size of teams in a class with ten to twelve students, that means only two or three teams. Such a small number of teams is too few to expose students to multiple perspectives on a particular topic by means of competitive presentations. It is also too few to adequately incorporate peer instruction across an entire semester, unless the teams that exist are responsible for teaching multiple topics, and this increases the risk that students will be exposed several times to a terribly-performing team.

Why not return individually-completed projects and presentations? I prefer to avoid this option, because it gives students the message that collaboration is unimportant. As I’ve said before, group work matters. For example, individual writing assignments mean that I am the only person who ever reads what students write, which diminishes the authenticity of assignments and leads to lower quality work. And while it may be possible to squeeze as many as six individually-delivered presentations into a 50- or 75-minute time block, a class with six or fewer students doesn’t meet the minimum enrollment requirement at my university. It probably doesn’t at yours either.

How to present

577049957_df060d8cbf
You know what I mean, right?

Reading this post from Sarah Knowles got me thinking about public speaking, for two reasons.

Firstly, it’s a really important part of what we do as educators. And secondly, it’s something that a lot of us worry about.

Effective speaking really matters, because it’s the primary communication tool in the classroom. Whether we flip it or not, we need to be able to deliver meaningful content to students, in a form that they can understand, process and then use in their learning.

All of Sarah’s points are good ones, but to them I would add one more: It’s not what you say, it’s what people hear.

This is the subtitle of one of the many books about speaking/negotiating that sit on my shelves (and also get used, to be clear). Essentially, it’s just about reminding yourself that all your internal processes and previous experiences are not shared through your communication, until the words and forms that you do actually use. Similarly, those you communicate with will be bringing their own thoughts and experiences to what you say.

The upshot is that you not only have to be clear for yourself, but clear for others.

This sounds a bit like a truism, but it’s actually quite tricky to follow, precisely because you so dominate your thinking. To step outside of yourself and ask what it is that someone else will understand of what you say takes a degree of self-awareness and empathy.  You not only need to think about what those other people know, but also how they might feel about the subject.

To take a pertinent example, I’m in the middle of a run of events at other universities, talking about different learning & teaching matters. Sure, I’ve got ideas and opinions about what we’re discussing, but I’m having to moderate that against the context in which we sit. That means thinking about the institutional context (if we’re doing a programme validation), the personalities involved, and the ultimate objective of the exercise. With all that in mind, communication can be better framed to move us all in that direction.

But perhaps it’s easier* to put it this way: you wouldn’t talk the same way to your boss as you would your mates in the pub (probably), just as you know how to talk with your best friend, because you know how they tick. Think about why that is, and then extend it much more widely.

In short, you’re most of the way there.

 

* – And there I am, trying to think about how you’re reading this [sic]

Using Webinars in Political Science Education

As part of our continuing series of guest contributions, John FitzGibbon (Canterbury Christ Church) talks about his experience with webinars:

I’ve been using Webinars for just over a year in my teaching here at CCCU and I think it is time to evaluate them as a form of teaching practice.

What you may ask, is a Webinar?  Generally it is understood as an online ‘event’ hosted by a particular organisation and broadcast to a select group of users.  This typically takes the form of a live video broadcast.  Obviously given different disciplines there can be huge variety in content for this live video and this blog post will focus on how they can apply for Politics/International Relations and the Social Sciences more generally. But the potential wider educational impact of using Webinars is clear.

philippe-legrain
Philippe Legrain webinar

 

I  have been using them in two main formats: 1. Hosted and organised by external partners, 2. Hosted and organised by myself.  There have been mixed results with both approaches but overall the use of Webinars has been viewed positively by my students.  Additionally, it has exposed both them and myself to new teaching methods and to the power of the internet as a learning tool.  Much is made of the potential of the internet to enhance student learning but there is still the need to fit specific internet based usage into defined pedagogic strategies.  This blog post aims to tease out some of the potential use of Webinars as part of a typical Social Sciences undergraduate module.

 

External Partner Led Webinar

I  have a great working relationship with the Global Net 21 NGO.  Their goal is to link the community with politicians and other decision makers in a constructive narrative.  What they bring is technology, contacts and experience.  My students and I shot a series of videos (available here) on the issue of food scarcity.  Global Net 21 were able to edit them altogether into a coherent whole.  This takes both time and technical training which most educators simply don’t have, to make the videos look somewhat professional.  As Global Net 21 have been hosting Webinars for many years, they have developed the technology to stream two live video feeds, with a comment box for invited guests on a single web-based platform.  This allows for a diverse audience to participate remotely in the Webinar.  But perhaps the most important element that an external partner brings is contacts.  My students have been able to participate in Webinars with many MPs and former government minister Peter Hain MP.  Ordinarily it is difficult to get MPs to commit time to a Webinar but they have been happy to give time to Global Net 21.  An educator can face a struggle in getting even 30 minutes from a leading figure to participate with a class but an outside partner, particularly an NGO, brings cache.  Moreover, a well-established external partner can allow the educator and students to interact with a wide variety of participants, enhancing the learning experience and facilitating networking with more potential partners.

cccu-student-on-webtv
Video Reports from our students broadcast on a Webinar

 

The clear drawback in working with an external partner is that your pedagogical goals for the class might not always align with the outcomes the topics the partner wants to focus on.  This means compromise which generally results in discussion that may not be closely related to the module.  While an external partner with excellent technology skills and contacts can make a Webinar happen in the first place, the main cost is a lack of control.  With Webinars this means a loss of interaction.  The external partner hosts the event, asks the questions, refers or does not refer to you and generally guides the discussion where they want.  This might lead to an overlap in interests but more often than not in my experience leads to students becoming bored by a discussion lacking the required academic rigour that does not include them.

 

Educator Led Webinars

In response to this reduced level of interaction my students experienced in previous Webinars, I sought to organise my own.  Lacking the equipment and time to work with an online interactive Webinar platform I decided to just use Skype and contact potential Webinar participants myself.  Though there are many specific Webinar platforms available but they need to be bought and many universities have issues over downloading, installing and purchasing software that are more hassle than they are worth.  Using this excellent Logitech conference cam there were no technical difficulties with Skype. Participants could hear us, even questions from the back of the class room and we could hear them.  I invite individuals that I want the students to interact with meaning that there is no need for compromise on the themes to be discussed and the Webinar fitted in seamlessly with the module learning goals. For my most recent Webinar on 5th of February I circulated articles written by the individual, Philippe Legrain an expert on the European Financial Crisis, and asked the students to draft up questions for Philippe.  In the previous week we had covered the role of finance in the global economy and the first hour of class was focused on the development of the Eurozone.  I asked Philippe to participate as not only did he write an excellent book on the Eurocrisis but he has plentiful media experience and so can communicate his ideas succinctly.  For the lesson plan I envisaged the second hour of class been given over for the Webinar, allocating Philippe  20 minutes to speak on the reasons why he thought the Eurocrisis happened, and then for a 20 minute question and answer session with students.  Philippe spoke so well and with such completeness that he actually answered all the students questions.  Students recorded his discussion on their phones and several bought his book on Amazon as he was speaking. The students were extremely positive on the experience.  They were impressed to have such an authority, he had been on BBC Newsnight the week before, talk to them and answer all the questions on a deeply complex contemporary issue.

philippe-legrain-ii
Philippe Legrain Webinar Students buying his book online

 

From this I took that an educator led Webinar is far more work than bringing in an external partner.  However, it allows for a better pedagogical outcome.  This is due to greater levels of control.  Paramount in this is that the educator can chose the participant and frame the Webinar to directly encompass learning goals.  With a good Webcam and internet connection there are no technical issues.  The only significant problem is to locate a participant with the required skills, strong personality and time to be involved.

 

The Pedagogic Usefulness of Webinars

Concluding on the pedagogic usefulness of Webinars I have found them to be a potentially excellent tool for educators. An interesting finding from participating in 12 Webinars is how their informal nature lends itself to an excellent flow of discussion. This is in contrast to invited lectures where the guest gives a formal lecture involving a huge time commitment on both sides on a theme that though suggested by the educator, might deviate from the module content. A Webinar gives the opportunity to guide a guest on to themes that are directly relevant to the module and allow for students to interact more intimately with them in a less formal setting. Taking control of the process does require some degree of organisation in finding a suitable participant and finding a suitable time but they, and the accompanying technological issues, are not insurmountable. Using Webinars I have found brings new voices and insight into the classroom and facilitates student interaction with outside experts. It also encouraged me to interact with NGOs and other members of the community. The more advanced elements of Webinars, contextualizing video, require too much preparation time for an individual educator. Access to a dedicated and skilled Teaching and Learning Team would enable a much more advanced Webinar process like this to be developed but many do not have such help available.  To educators I would advise to try a Webinar. Find a suitable participant, brief them on what topics you want them to discuss, give guidance to your students to prepare questions and let the debate flow!

This post was originally posted on the Canterbury Christ Church Politics & IR blog.

Gaming the Professor

 

A final note about the series of Chasing Chaos simulations from last semester:

Candyfornia GameFor part of the final exam, I put students back into the teams from the Rwanda simulation and had each team select an article from this list:

  • Strobe Talbot, “The Making of Vladimir Putin,” Politico Magazine, 19 August 2014.
  • Dexter Filkins, “The Fight of Their Lives,” The New Yorker, 29 September 2014.
  • Youssef Cherif, “Tunisia’s Elections Amid a Middle East Cold War,” Atlantic Council, 24 October 2014.
  • Howard W. Frenchot, “China’s Dangerous Game,” The Atlantic, 13 October 2014.
  • George Soros, “Wake Up, Europe,” The New York Review of Books, 20 November 2014.
  • Ali Khedery, “Iraq’s Last Chance,” The New York Times, 15 August 2014.
  • Josh Kurlantzick, “Why Obama’s Courtship of Myanmar Backfired,” Bloomberg Businessweek, 6 November 2014.

Each team was tasked with designing a 10-12 minute presentation on the following question:

What international relations theory (constructivist, liberal, realist) and corresponding level of analysis (individual, domestic state, international system) best explain the subject of the article? Why?

I set up the delivery of the presentations as a competition. My usual practice for these competitions is to give each student an amount of Monopoly money for voting, and students are prohibited from voting for their own teams. In this case teams had unequal numbers of members, which would have created an advantage for the smallest teams, so instead I distributed the same amount of money to each team. A team could not vote for itself, but it was free to allocate its money to other teams in whatever way its members wanted.

When teams voted on the best presentation, each team put down all of its money on a different team to produce a tie among all of the teams. Clearly something was afoot — the class expected that a tie would force me to equally distribute the points for winning the competition across the whole class. Shared interest + communication = cooperation, a real-life demonstration of liberal theory!

I exercised the God option to frustrate their gambit. I announced another round of voting, with the provision that a tie would result in no points being awarded. And a clear winner quickly emerged.

This led to an interesting discussion about how the structure of a game affects the behavior of its players and how actors are affected by their environment. I was pleased to see that after a semester of simulations and theories, students were able to make this connection.

 

Field of Dreams

A follow-up to Simon’s post about field trips:

Dream FieldI too am a fan of changing the physical environment in which students learn. I’ve gone long on two occasions — twelve-day study abroad programs in Egypt — but it’s immensely complicated for the instructor. You never know when a revolution might break out. Also, because of time and money required, the practice frequently excludes students for whom such an experience would be the most beneficial.

Going short, at least in the USA, is also often problematic. I can hold an audience captive for only fifty or seventy-five minutes, depending on the day of the week that the class meets. We can’t go very far on foot or on public transportation in such a short period of time.

There is another version of the field trip that is much more convenient: the campus presentation or lecture. Yet like most of my colleagues, I expected students to attend these events for their own good, and I was dismayed when they didn’t.

Over the last two years my attitude has changed, for three reasons:

  1. If we claim that these events are opportunities for learning, then why shouldn’t they contribute toward students’ grades? I should be sending the message to students that I am not the only person who matters in their college educations.
  2. Assignments based on attending campus lectures do not in any way detract from what I do in the classroom. Students normally don’t remember much of that anyway, and getting a different perspective on the same topic, or a related one, might spark some thinking that would not otherwise occur.
  3. I place responsibility for success on students by calculating the course grade on a 1,000 point scale with assignments and quizzes that are in total worth about 1,2000 points. Campus presentations become just one more option for students to improve their grades, and they occur with such frequency that I can usually connect three or four of them to the subject of a particular course. If a student can’t attend an event because of some other commitment, it won’t automatically negatively affect the student’s performance in the course.

Since I’m a believer in writing as a way of thinking, students have to write about the content of a presentation to earn anything toward the course grade. My standard instructions for the assignment are to discuss the following in no more than two pages:

  • What was the presenter’s argument?
  • What evidence did the presenter use to support his or her argument?
  • Was the presenter’s argument convincing? Why?
  • How could the presentation be improved?

This is my way of ensuring that the student’s written product contains specific details about the presentation. I make these assignments worth ten points, or one percent, of the final grade.

Slumber Party

While lounging in my pajamas with the ALPS angels, the discussion has turned to presentations. I look at events like the Global Citizenship Program Collaboratory at Webster University as an opportunity to engage in some participant observation and learn more about what to do and not to do when presenting information to an audience. To me there is always room for improvement, and the better I get at this form of communication, the more effectively I can teach the skill to students.

Death by Power PointWe’ve posted about student presentations several times before — for example, here, here, here, and here — but I don’t think I’ve provided you with the list of resources on presentations to which I refer students. Here is it:

Last but not least, this is the best fictional depiction of an effective presentation that I’ve ever seen — “The Carousel,” from the TV show Mad Men.