Madness to the Method

Being a fan of scientific research, I often complete surveys. I recently received a survey by email that asked me to choose between fictional medical treatment options — A and B. In each of the survey’s scenarios, figures for the risk of infection, cancer,  and surgery associated with each treatment option were provided. A screen capture of one of these scenarios in the survey is below.

The survey was sent to me by physicians at a premier public university in the USA who were acting as the principle investigators for the project, which was sponsored by a national non-profit patient advocacy organization. One assumes that the survey was seen by many sets of highly-educated eyeballs before it was distributed to the public, so I was stunned to see that the survey had a very basic methodological flaw.

Continue reading

Data Musings

MusesAs another fall semester begins, I thought I’d toss out two recent items about data.

First, an article in the New York Times describes how students are circumventing universities’ fortress-like approach to data management to get the information they need in ways that are the most useful to them. Meanwhile many universities don’t even understand what they are trying to regulate. (More on the Yale experience here.)

Second, an article in the Chronicle of Higher Education points out that attempts to tailor instruction according to data on students’ learning styles, personality types, or average ability level fail because of fundamental attribution error and the ecological fallacy.

This Is Your Brain On Learning

Fried EggsI’ve written before about the need for educators to know something about the cognitive basis for learning. Otherwise our students learn a lot less than they otherwise could. I recently stumbled upon this excellent editorial on the subject written by Arthur Graesser, a psychology professor at the University of Memphis. The editorial presents principles of learning that come from two reports that are worth reading. One of these is Organizing Instruction and Study to Improve Student Learning, a list of recommended instructional practices along with the degree of evidence that exists in support of each practice. The other is 25 Principles to Guide Pedagogy and the Design of Learning Environments.

Here are a few of the learning principles they mention:

  • Space learning over time.
  • Help students learn how to effectively manage the time they spend studying.
  • Testing enhances learning, particularly when the tests are aligned with important content.
  • Stories and example cases are typically remembered better than facts and abstract principles — information should be embedded within a narrative.
  • Motivation to learn is higher when content and skills are anchored in real world problems that matter to the student.
  • Deep learning is stimulated by problems that create cognitive disequilibrium, such as obstacles to goals, contradictions, conflict, and anomalies.

Mars Attacks


Writing = Active Learning

John C. Bean
John C. Bean

I’ve been reading Engaging Ideas: The Professor’s Guide to Integrating Writing, Critical Thinking, and Active Learning in the Classroom, by John C. Bean (2nd edition, 2011). I wish someone had given me this book while I was in graduate school. Here are a few of the many useful pieces of information that it contains:

  • Data indicates that student engagement in a course correlates to the amount of writing assigned in it. More writing, more engagement.
  • Content coverage vs. writing skills training is a false dichotomy. Students learn better if they think about content in ways other than rote memorization, and writing is a cognitively more demanding form of thinking. When writing, students use important disciplinary concepts while simultaneously practicing methods of inquiry and argumentation (p. 90).
  • More writing does not necessarily lead to more time grading for the instructor. If writing assignments are properly designed then grading time can actually decrease.
  • The end-of-semester research paper is wasted effort except for highly-skilled, upper-level undergraduates who are already familiar with disciplinary conventions (p. 91).
  • Effective writing assignments present students with a contextualized problem — a task — that immediately gives them a role to fulfill, an audience to communicate with, and a format to follow (p. 98).

My one criticism of the book is that it presents critical thinking the way that most academics do — as a single skill. In the book, critical thinking is (so far) not clearly defined or operationalized, perhaps because what academics often refer to as critical thinking is actually a whole set of cognitive processes, some of which are easier to develop than others.

Study Tips for Online Learning

OwlA while back I wrote about providing explicit study skills training in a new first-year seminar. It occurred to me that the vast majority of study skills advice is written for students who attend face-to-face courses on a physical campus. Meanwhile enrollment in online courses continues to increase. Here is a brief list of tips for online learners based on my experience teaching online for the last six years.

  • Determine whether you can realistically commit the necessary time and effort to do well in a course that is likely to move much faster than its on-campus equivalent.
  • Make sure your hardware and software meet the technological prerequisites for the course. Find out well the course begins what versions of which software you will need. Make sure installed plug-ins, extensions, and security settings are current. You can contact the university’s designated staff for assistance; the course instructor is unlikely to know what particular technological updates might be needed.
  • Have a technological emergency back-up plan. What will you do if your computing device stops working or you lose internet access at home? Not being able to access the course site or upload documents for even a few days can ruin your performance.
  • Securely store your work across multiple devices and/or the cloud. Products like Google Drive, Dropbox, and Evernote are all free. Use them. If you are not using a product that automatically updates your work, set a timer that reminds you to save what you’ve done every thirty minutes.
  • Ask the instructor for a copy of the syllabus before the course begins. Read it. Get a sense of how the course is organized.
  • If at all possible, create an ergonomically efficient working environment — screen at eye height, fingers on the keyboard with a 90 degree angle in the elbows, back straight. If your body is positioned comfortably, learning will be easier.
  • Plan to devote enough time to do well. You will not be able to ignore reading, writing, and online discussions all week and then “catch up” on Sundays. If you can’t commit the necessary time, don’t take the course.
  • If you work on the course at multiple points throughout the week, and vary your activities within each time period — by mixing reading, writing, online discussion, and research — you will learn more. Your brain will have more frequent and more efficient opportunities to strengthen memory.
  • Take notes, preferably handwritten, of what you read. I won’t go into detail here about the cognitive reasons for why writing notes by hand benefits learning, but highlighting simply doesn’t help you retain information.
  • Read strategically. Read the introduction first. Identify the main argument(s) that the author will be presenting. Read the conclusions. Then go back to find what evidence the author has presented in the body of the reading assignment to support the conclusions. Argument-conclusion-evidence is what you need to write notes about.
  • Minimize distractions. Shut down email and Facebook, turn off the TV and cell phone while working.
  • Writing requires the synthesis of information, which is more cognitively taxing than reading; therefore, it is especially important to carve out distraction-free blocs of time for this task. Reading is easier to accomplish in small chunks, so take advantage of time when you are otherwise not occupied — for example, while in a waiting room or riding a bus. Always have reading and note-taking material with you.
  • Enlist the support of family and friends. If you have children who do homework every weeknight after dinner, do yours with them. You’ll be setting the example that learning is a life-long process and they will respect you for it. Get your spouse to do more of the housework. Organize study dates with a friend at a cafe.
  • Make an effort to connect with classmates, whether through discussion or when working on collaborative assignments. The more you can create a sense of community in the course, the more you will get out of it.

Helping Students Learn How to Learn

I’ve been thinking a lot lately about what we know about how people learn. As a long-time reader and now contributor to this blog, it probably doesn’t come as a surprise that I believe active learning is one piece of the puzzle. But, as a good social scientist, I’m always looking for evidence. I’m happy to see books using cognitive psychology and neuroscience and related fields to give us more insight into how students learn.

A friend recently shared this article and I’m excited to pick up the book Make it Stick: The Science of Successful Learning and read it this summer.

The article includes a handy graphic that I plan to share with my students this fall, listing five facts to teach them how to learn. Of the five facts, the second (“Apply the new material to your own life”) and fourth (“Use your whole brain”) most closely relate to why I incorporate active learning into my teaching. I hope, that by sharing this research, I’ll purchase some “buy-in” from the students for these methods.

Adversity Indicators

Adversity PlantIf you haven’t read Who Gets to Graduate?, a New York Times article by Paul Tough, you should. The article points out that some relatively simple interventions being used at the University of Texas are associated with significant improvements in retention and graduation rates for college students who belong to minority or economically-disadvantaged groups. These are the very students who represent an increasing proportion of the total undergraduate population in the USA but are most at risk of not completing a college education.

The treatments that have been so effective are designed to strengthen students’ beliefs that they belong in college and that they have the ability to succeed in college. So logical it’s obvious, you might think, but you should ask yourself these questions:

  • How much of your university’s curricular content and delivery, especially for the courses that students encounter in the first year of college, sends the opposite message?
  • Does your university collect data so that it knows not just which students fail, but why, and at what point the downward slide begins?
  • What do you do in and outside of the classroom that encourages a sense of belonging and ability among different groups of students? Do you even know what backgrounds students might be coming from?

Teaching as a risky business

One of the very best things about working in Political Science is that almost everything can have a political angle, which in turn gives me an excuse to indulge my very catholic and eclectic tastes. An example of this turned up in the Guardian yesterday, with an interview with Gerd Gigerenzer on the occasion of his new book on risk.

The thrust of the piece wasn’t about politics or politicians, but about the way people make decisions in an illogical way. I’m always happy to stick the boot into rational choice, but it’s even better when there’s an alternative way to construct such behaviour.Gerd Gigerenzerger: 'We can teach kids to understand risk.'

Gigerenzer argues a lot for the importance of heuristics, short-cuts in understanding that provide ‘good enough’ answers, if not ‘perfect’ ones. Such satisficing is different from the Kahnemann System approach in that it doesn’t assume the rational approach is necessarily more efficient or effective. Thus, experts in a given field often can ‘see’ an answer in an intuitive way, in an extension of fuzzy-trace theory. Basically, Gladwell’s Blink, but with proper scientific underpinning.

This is interesting in all sorts of ways, but let’s confine ourselves to teaching for now. Gigerenzer’s emphasis on intuition is potentially very problematic, for it asks that we defer to expertise (as being likely ‘right’) and that this does not need to be unpacked (instead one becomes an expert), which rather goes against the grain of much education.

Even in an active learning scenario, the capacity to internalise knowledge and practice does not necessarily have to be matched by an ability to explain (which might be an issue come assessment time), while satisficing suggests that we have to be prepared to accept a wider variety of acceptable responses to challenges. Certainly, in many universities the idea that one should not push for maximising behaviour causes difficulties when looking for the best student assessment outcomes.

However, Gigerenzer does offer an important dimension that we need to consider in our teaching.

Firstly, it reminds us that people are not rational. That’s important for our subject area: why do politicians make ‘bad’ decisions? But it’s also important for our students and ourselves: everyone is likely to go for ‘good enough’ behaviour, so how do we make the situation require that such behaviour is of a sufficient standard?

Secondly, it emphasises the vital importance of critical thinking. Without a strong grounding in such basic techniques, students will not be able to depend that ability to intuitively grasp and conceptualise what they are presented with and make an appropriate judgement. Such skills become then not transferable, but universal.

Thirdly, it reminds us that understanding is as important as knowledge. Facts and figure – the old learning-by-rote method – are meaningless without an ability to use them. This goes beyond critical thinking, into the development of a world-view and models of conceptualisation. These can then receive new knowledge and join it to what it already there.

In short, people are sense-making creatures, even if that sense is not quite ‘right’, so it is incumbent upon us to help students develop their sense as far as we can.

Learning About Learning

I’ve mentioned the cognitive scientist Daniel Willingham previously — here and here — as a great resource for instructors who want to learn something about how people actually learn. A social psychologist/lunch partner informed me about this archive of columns that Daniel Willingham has written for the Washington Post. The columns present recent research findings about what affects students’ learning.

It is unfortunate that most university faculty (outside of psychology departments) are never exposed to this kind of information and that the design of courses and curricula doesn’t take it into account.

Working A Room

In Simon’s post about first impressions, he references the need to “own the space” when disseminating information to others — especially people one has never interacted with before.

ChappelleIt would be nice if every doctoral program required students to take an acting class so they learn to walk around, gesture with the hands, vary voice tone, etc.  That’s what I mean by “work a room.”  At my first “real” conference, where I presented post-PhD as a full-time visiting assistant professor, I saw one person deliver her talk while not moving anything below the waist. Another presenter, in contrast, was excellent — she strode across the entire room, connecting with her audience. I asked her afterward if she was a lawyer with courtroom experience, and she said yes.

This is making me remember my classroom experiences as an undergraduate, some of which now make me cringe. Looking back, most of my professors who were terrible at working a room were in the humanities/social sciences rather than in the hard sciences and engineering.

In contrast, at an event on Egypt, I’ve seen people who are frequently assumed to have great hard skills but terrible soft skills  — executives from companies like Google and Microsoft — give the most amazing presentations I’ve ever witnessed. Their ability to communicate to an audience of strangers was far superior to what I’ve seen among the vast majority of academics I’ve encountered over the years. It was a real shock to me — I had thought my ability to communicate was fairly good compared to my peers — I don’t deliver presentations by reading a paper word for word in a monotone — but now I know I have a lot of work to do.

While it is obvious that different subjects and teaching environments can require different strategies of engagement, but there are few techniques that that I’ve learned through trial and error over the years that help me make my presentations more engaging than they otherwise might be:

While being an effective presenter helps us out professionally by making us and our work more interesting to colleagues, it also enables students to learn more while in our classrooms.