Best Coffee in Town: Update 2

Another progress report on my Best Coffee in Town research project . . .

Whereas seven students chose not to complete the first StoryMap assignment, all seventeen did so for the second. Yay, scaffolding works for formative assessment! Well, no, not in this case. The URLs that seven students uploaded to the LMS didn’t work, which meant I saw the message below instead of their StoryMaps.

The instructions on the LMS for all of the StoryMap assignments contain the following statement:

You will need to submit the link to your BCiT StoryMap here. Your StoryMap must be set to share/public when published for this link to work. Review the Digital Literacy section of the syllabus. Work that I am unable to access will earn a grade of zero.

So, seven zeros, because these students didn’t bother test whether the links they uploaded actually worked.

The remaining ten students earned an average score of 12.8 out of a possible 25 points; i.e., they all failed.

The final StoryMap assignment is worth 100 points, the equivalent of a full letter grade. Will it be an exercise in learned helplessness? I hope not.

Best Coffee in Town: Update 1

 
 Creative Commons CC0 1.0 Universal

Taking a break from preparing for our next blizzard . . .

A quick progress report on my Best Coffee in Town research project, which I designed to counter AI and combat grade inflation: students, or at least some of them, submitted the first of a series of scaffolded StoryMap assignments. While this assignment constitutes only 2.5 percent of the final course grade, it forms an integral part of the project as a whole. In other words, it lets students know where they stand and where they are headed.

Of the class’s 17 students, 10 chose to complete the assignment, with an average score of 9.5 out of 25 points. In letter grade terms, everyone in the class earned an F.

Will this change as the semester progresses? I don’t know.

AI-Induced Course Improvements

I’ll be teaching a course on globalization again in the spring term. As usual, I’ve built the course around a StoryMap ethnography project, but I’m incorporating field research in response to how I’m seeing students (mis)use AI. The field research component comes from Amanda’s Best Breakfast in Town, which I used once before in 2019. This time each team of students will need to identify a Best Coffee in Town by evaluating the effects of coffee production in some other country and how and why the coffee is consumed locally. At minimum students might learn a little about the off-campus community. Best case scenario is that they talk with the people who produce the coffee and learn something about them.

Project outcomes thus now depend much more on engaging with the physical world than they used to, and I’ve changed my assessment metrics accordingly by down-weighting text-driven activities that students can offload to AI, such as the location and synthesis of published source material. Students will now need to do a better job with the harder elements of the project, which now comprise a far greater share of assignment grades — which should have the added benefit of helping me continue to combat grade inflation. To illustrate this, here is the rubric I’ll be using to score the final, complete versions of students’ StoryMaps:

Teaching in the Age of AI

I wrote an op-ed about teaching in the age of AI that was published yesterday by The Chronicle of Higher Education. If you are interested in the topic but your university’s library doesn’t subscribe to The Chronicle, you can access the essay by creating a free account at the linked page.

Diversifying the Politics Curriculum: Lessons Learned and Possibilities for Progress

This academic year, the UCL Centre for the Pedagogy of Politics (CPP) is hosting a series of online panel events. Our second event in the series was on the theme of ‘Liberating the politics curriculum: theory and practice’. In this guest post, one of the panellists at that event, Helen McCabe, together with Helen Williams and Andy Fisher, offer reflections on findings from a project at the University of Nottingham, led together with colleagues in Politics and IR and Philosophy.

Questions around why Politics curricula are so often “male”, “pale” and – consequently – “stale” have abounded in the last few years, often linked to wider calls to “decolonise” Higher Education, research, and teaching. As well as this, there has been increasing recognition of, and concern about, the award gap between white undergraduate students and those from Black and minoritised ethnic backgrounds. Closing this gap needs a multifaceted and multidimensional approach, much (though not all!) of which is out of individual academics’ control. However, some elements of a curriculum-based approach are in our control – for instance, as educators we could make significant efforts towards regularising ethnic presence on the curriculum (and diversifying it in other ways).

Making politics curricular more diverse in a variety of ways is a positive pedagogical aim, but efforts in this direction face several challenges. Many of these are practical, as we found when investigating this issue. Sharing best practice can save time, but overall, a balance needs to be found between securing sufficient institutional “buy-in” to succeed, and the whole endeavour appearing to be something being inauthentically imposed from above, causing resistance.

One reason diversifying the curricula is an important thing to try and do is that descriptive representation matters to students and for student outcomes. If we care about diversity and the attainment of all our students, we should be mainstreaming perspectives that are not the traditional white, European, middle-class, male ones. What is more, these diverse perspectives should not be an “add-on” treated in one special week. Nor should authors from specific minoritised groups be treated only as experts on issues seen to affect that group (e.g. female authors included on reading lists for the one week on feminism in a political theory course, but not in other weeks on other topics).

However, there are several barriers for engagement, which might be termed: principled, implacable and practical.

Principled challenges and how to address them. People may be put off by the terminology around “decolonising”, feeling it is either an attack on their current practice (implicating them in colonialism), or that it is not a term which ought to be used in a UK context. That is, decolonising the curriculum is a laudable endeavour in countries which were colonised (e.g. South Africa, where the movement began). But it is not appropriate in countries which were colonisers (such as the UK). These principled reasons for not engaging can be at least somewhat overcome through careful use of – and discussion around – terminology (see our collection of Useful Resources) and awareness around the internal and external politics of this kind of project.

Implacable barriers are harder to overcome. Some people do simply reject the pedagogical bases for diversifying the curriculum along ethnic (or gendered) lines. One version of this view holds that students should be introduced to a range of views, but it is the ideological spectrum which should be diverse, not authors’ demographic data. Another version sees these kinds of efforts as “gimmicky”, and does not want to engage. These barriers may simply need recognising, with related decisions taken about which battles to fight.

A different version relates to some academics’ deep-seated aversion to teaching anything on which they do not themselves feel “expert”, which limits their flexibility around what they teach. (And damages their well-being when they feel forced to teach something on which they are not, in their view, “an expert”.) Although for some this might be an excuse not to develop their teaching year-on-year, it is easy to understand why academics may be very risk-averse in terms of changing their teaching such that they feel they are teaching topics or texts for which they do not have a deep understanding, not least given student expectations to be taught “by experts”, and the negative impacts on career progression and staff well-being from negative or low student evaluations. This may be increasingly an issue as lectures are more routinely recorded, and the likelihood of one slip or apparent revelation of ignorance “going viral”, with potentially wide, and severe, consequences. (This may also underpin reluctance to “diversify” reading lists and include writers who may be seen as controversial.) For these reasons, academics may appear implacably opposed to changing their teaching in any significant way, but this position may be softened by the same sorts of solutions which also aid academics who are positive towards the idea of diversifying, but face practical challenges.

Indeed, practical barriers to are the ones most commonly cited and experienced by academics. These include: lack of relevant decision-making power; lack of time; and lack of space.

The first is most commonly experienced by early-career colleagues (including PhD students) who might be able to introduce more diverse readings into seminars, but have no control over the content of lectures, modes of assessment, or the aims and objectives of a module. The second and third are more commonly experienced by those who have the relevant power, but lack the capacity to make use of it. Academics generally do not get as much time as is really needed to update reading lists; re-design assessments, lecture slides, reading lists and other resources; or gain the required expertise on new content. Even where these efforts are recognised in an official workload planner, the time allocated is not generally sufficient. And even where there are helpful resources which might be used, there is concern about garnering satisfactory expertise to bring something into the curriculum (as noted). There is also often as concern about what has to be taken out in order to fit in something new, given the limited time available for a module (e.g. 10-12 weeks). Escaping from that problem probably takes a significant module re-design and re-think: and colleagues are already suffering from a lack of time.

All these practical concerns are significant issues, which need to be taken seriously if curricula are to be diversified in a meaningful and sustainable way. Staff need time and resources to make significant change and feel confident in delivering new material, and this in turn necessitates buy-in from people with power within the University. However, if the move to diversify the curriculum feels imposed in a “top-down” and/or “gimmicky” fashion, this is likely to be counter-productive. Indeed, power structures in academia may need to be “decolonised” before the curriculum can be.

Useful Resources:

All our resources here hosted here

This includes some “top tips” available here

And a toolkit for thinking about terms and terminology

There is also some great advice from colleagues at Sheffield Hallam available here

Podcasting in Class: Course planning for Spring 2024

As the semester winds down and final grading is in progress, I am looking ahead towards the Spring 2024 semester, when I will be teaching International Relations & Popular Culture for the first time. It is both a nerdy interest niche of mine, but I also think that field of popular culture is expanding, gaining more grounds, and operating as something relatable to our students. So, I guess – be prepared to see more of that type of content in the new year.

I have decided to incorporate a semester-long podcasting project as the students’ main research project, in which they will produce a public-facing piece of research. I imagine this is the first time most of my students will be engaging with such a project. But this is also a new assignment for me, and I am both excited and wondering what hurdles I haven’t thought of yet. I am building this on a previous guest post by John McMahon (2021) and his APSA Educate resource. Below, I have outlined the overall premise. What wisdom do you have to turn this project into something that can rival Joe Rogan’s podcasting dominance?

Continue reading “Podcasting in Class: Course planning for Spring 2024”

A Game Design Checklist

As usual, teams of students in my economic development & environmental change course are building games in a semester-long project. I created this game design checklist as an individual low-stakes assignment. I told students to share their checklists with teammates so that they could collaboratively identify faulty aspects of their team’s game and fix them. My hope is that the checklist will help ensure that students follow the design criteria that I have specified, something that has previously been a problem.

I have twenty students in this course. Seventeen completed the assignment. Of those, one uploaded a blank checklist to Canvas. Another copied and pasted my design criteria into the checklist and did not write anything specific about the game her team is building. So a total of five students, twenty-five percent of the class, earned a zero on the assignment. Looks like the pandemic of learned helplessness continues.

The Perils of Small Classes Revisited

Returning to a subject that I wrote about in 2015: when low enrollment makes collaborative assignments difficult. Last semester I taught an undergraduate course built around a team-based research project. Three teams, each focused on a different country. The course had only eleven students, resulting in two teams of four and one team of three. Not ideal, but minimally sufficient, or so I thought at the beginning of the semester.

I hadn’t planned on three students performing at the D/F level and making little to no contribution to their teams’ research projects. Compounding the problem: one-quarter to one-half of the class being absent on any given day.

The roster for one of my fall semester courses currently shows only nine students. If it does run, I might have to abandon the collaborative project I was thinking of including. Given what happened in the spring, I can’t form teams of only three students. Two teams somewhat defeats the purpose of the project.

The easy option is to simply replace team projects entirely with individual assignments, even though that’s not how the world works. Students might in fact prefer this, given the death of curiosity.

My situation is complicated by several environmental factors over which I have very little control. First, interest in the humanities and social sciences is declining nationally, exacerbated by the fact that the undergraduate enrollment at my university is quite small. The small number of students interested in learning about the subjects that I teach has steadily gotten smaller.

Second, the structure of the curriculum privileges some areas of the world and bodies of knowledge over others. The majors that are most popular with students demand 60 to 80 credits, while general education requirements present the history of human civilization as a straight line from Athens to Rome to St. Thomas Aquinas. The organization of the curriculum sends students the message that college is about checking off a list of boxes. The courses that I teach aren’t on that list.

Third, the delivery of the curriculum makes my courses less attractive to students, even if they are interested in the content. Each academic department must schedule some courses every semester at 8:00 a.m. Since I’m an early riser, I’m happy to take this time slot, but most undergraduates are not. More consequential: the false perception among students that they’ve learned more when what they’ve done to learn feels easy, a point recently made by my favorite cognitive psychologist, Daniel Willingham. Students resist active learning pedagogical methods because they feel harder than passive instruction, despite being far more effective. When given a choice between a course that I teach using active learning and a course taught by someone else that consists of lectures and multiple-choice exams, most students will choose the latter.

So that’s my situation. I have no easy solutions to the problem.

Engaging Students Through Collaborative Research Projects

Today we have a guest post from Rebecca A. Glazier at the School of Public Affairs at the University of Arkansas at Little Rock (rebecca [dot] glazier [at] gmail [dot] com) and Matthew Pietryka at Florida State University’s political science department (mpietryka [at] fsu [dot] edu).

Rebecca Glazier

Many professors are struggling to engage their students, who are often disengaged and burned out. To address these issues and improve student retention, universities are increasingly turning to edtech solutions or big data—everything from predictive analytics to chatbots in discussion boards. These remedies tend to be far removed from students’ daily lives. In contrast, as professors, we are with students in the classroom every day. And this experience often prepares us to know best how to engage our students.

Matthew Pietryka

In a new, open-access article we just published in Education Sciences, “Learning through Collaborative Data Projects: Engaging Students and Building Rapport,” we illustrate how faculty can engage students through collaborative data projects. Rather than relying on top-down university solutions, faculty can use the content of their own courses to involve students in collaborative projects that build rapport and make them feel included and engaged in the course. We see these collaborative data projects as another kind of active learning—getting students thinking outside of the textbook and involved in contributing to a project that is bigger than themselves.

We used data from more than 120 students over two semesters and our results suggest that most students find these collaborative data projects more enjoyable than typical college assignments. And students report the projects make them feel the professor is invested in their learning.

The article we wrote detailing these projects is open access. It provides advice on implementing these projects as well as the R code used to create individualized reports for students participating in the collaborative data projects. The individualized reports help develop rapport between the professor and each student. And this programmatic approach allows professors to scale up these reports to accommodate classes with hundreds of students. Building rapport and doing active learning is something considered possible only in smaller classes, but our approach demonstrates how it can be done in large classes as well—with significantly positive results.

At a time when many faculty members are struggling to engage students, we can take matters into our own hands by designing projects for our classes that draw students in and build rapport with them. It doesn’t take expensive edtech solutions or top-down directives. Mostly, it takes thoughtful pedagogy and prioritizing student connection.

Open Access article link: https://www.mdpi.com/2227-7102/12/12/897.

Recent episode on the Teaching in Higher Ed Podcast on this research: https://teachinginhighered.com/podcast/engaging-students-through-collaborative-research-projects/.