Jump To Content

What Works: Giving Feedback to Learners



Like it or not, certain ways of giving learners feedback HELP them learn.
Certain other ways HINDER their learning.

Will Thalheimer has just made available for free two reports on his extensive research on what works - and what doesn't work - when it comes to giving learners feedback.

He summarized the main points recently on his blog:

  1. The most important thing to remember about feedback is that it is generally beneficial for learners.
  2. The second most important thing to remember about feedback is that it should be corrective. Typically, this means that feedback ought to specify what the correct answer is. When learners are still building understanding, however, this could also mean that learners might benefit from additional statements describing the “whys” and “wherefores.”
  3. The third most important thing to remember about feedback is that it must be paid attention to in a manner that is conducive to learning.
  4. Feedback works by correcting errors, whether those errors are detected or hidden.
  5. Feedback works through two separate mechanisms: (a) supporting learners in correctly understanding concepts, and (b) supporting learners in retrieval.
  6. To help learners build understanding, feedback should diagnose learners’ incorrect mental models and specifically correct those misconceptions, thereby enabling additional correct retrieval practice opportunities.
  7. To prepare learners for future long-term retrieval and fluency, learners need practice in retrieving. For this purpose, retrieval practice is generally more important than feedback.
  8. Elaborative feedback may be more beneficial as learners build understanding, whereas brief feedback may be more beneficial as learners practice retrieval.
  9. Immediate feedback prevents subsequent confusion and limits the likelihood for continued inappropriate retrieval practice.
  10. Delayed feedback creates a beneficial spacing effect.
  11. When in doubt about the timing of feedback, you can (a) give immediate feedback and then a subsequent delayed retrieval opportunity, (b) delay feedback slightly, and/or (c) just be sure to give some kind of feedback.
  12. Feedback should usually be provided before learners get another chance to retrieve incorrectly again.
  13. Provide feedback on correct responses when:
    a. Learners experience difficulty in responding to questions or decisions.
    b. Learners respond correctly with less-than-high confidence.
    c. All the information learned is of critical importance.
    d. Learners are relatively new to the subject material.
    e. The concepts are very complex.
  14. Provide feedback on incorrect responses:
    a. Almost always.
    b. Except:
    i. When feedback would disrupt the learning event.
    ii. When it would be better to wait to provide feedback.
  15. When learners seek out and/or encounter relevant learning material either before or after feedback, this can modify the benefits of the feedback itself.
  16. When learners are working to support retrieval or fluency, short-circuiting their retrieval practice attempts by enabling them to access feedback in advance of retrieval can seriously hurt their learning results.
  17. When learners retrieve incorrectly and get subsequent well-designed feedback, they still have not retrieved successfully; so they need at least one additional opportunity to retrieve—preferably after a delay.
  18. On-the-job support from managers, mentors, coaches, learning administrators, or performance-support tools can be considered a potentially powerful form of feedback.
  19. Training follow-through software—that keeps track of learners’ implementation goals—provides another opportunity for feedback.
  20. Feedback can affect future learning by focusing learners on certain aspects of learning material at the expense of other aspects of learning material. Learners may take the hint from the feedback to guide their attention in subsequent learning efforts.
  21. Extra acknowledgements (when learners are correct) and extra handholding (when learners are wrong) are generally not effective (depending on the learners). In fact, when feedback encourages learners to think about how well they appear to be doing, future learning can suffer as learners aim to look good instead of working to build rich mental models of the learning concepts.


Those of us who have been studying human performance improvement for decades would easily pay Will upwards of $35 for a hard backed copy of his latest work, but he's making it available for free to anyone who would like to read the full reports.


Download them here:



What do you think about these findings?

A couple of them really bowl me over. I'll be reading and testing them against my own experience in the weeks and months ahead.

Good social science is such a valuable thing! Sadly, it's been all too rare in education.


csrd
  • Authority 302
Post Body
csrd said:

Downloaded and thanks to both of you.

Feedback consciousness makes a learner a serious student. It is self-help to growth.

  • Quote
  • Posted 6 months ago.
mawstools
  • Authority 470
Post Body
mawstools said:

One of these findings that is interesting to watch working here in LearnHub is #10: Delayed feedback creates a beneficial spacing effect.

  • Quote
  • Posted 6 months ago.
Enkerli
  • Authority 106
Post Body
Enkerli said:

Those reports do sound interesting and I’m glad that there’s an acknowledgement that some feedback may only work with certain students. For some reason, I get the impression that these items have mostly to do with situations in which learners are separate from a person giving feedback (such as a teacher). In fact, I even get the feeling that many of them relate quite directly to ESL and other L2-related fields. For instance, the advice about not interrupting the learning event seems directly related to the advice of not correcting an L2 speaker while s/he speaks. There are many occasions during which the “learning event” has very vague limits and it might be especially hard to determine if feedback is appropriately timed, given that advice. Do the reports contain something about different types of feedback such as oral, gestural, auditory, numeric, written…? Altogether, these items sound quite reasonable. I hope they won’t be transformed into “rules of thumb” or even official rules but they can certainly help provide support for some methods teachers and learners are using to give feedback to one another.

  • Quote
  • Posted 6 months ago.
mawstools
  • Authority 470
Post Body
mawstools said in response to:
Enkerli
Enkerli’s post:
Citation Body

Those reports do sound interesting and I’m glad that there’s an acknowledgement that some feedback may only work with certain students. For some reason, I get the impression that these items have mostly to do with situations in which learners are separate from a person giving feedback (such as a teacher). In fact, I even get the feeling that many of them relate quite directly to ESL and other L2-related fields. For instance, the advice about not interrupting the learning event seems directly related to the advice of not correcting an L2 speaker while s/he speaks. There are many occasions during which the “learning event” has very vague limits and it might be especially hard to determine if feedback is appropriately timed, given that advice. Do the reports contain something about different types of feedback such as oral, gestural, auditory, numeric, written…? Altogether, these items sound quite reasonable. I hope they won’t be transformed into “rules of thumb” or even official rules but they can certainly help provide support for some methods teachers and learners are using to give feedback to one another.

Enkerli, I’m just reading the reports myself. They are compiled from many areas in which data has been kept, not just language learning, but all kinds of learning. Will, himself, says he recommends that folks think of them as benchmarks against which we measure our own experience, not rules. No scientist would ask anyone to use research as rules (grin)... and he’s a fine one.

I recommend you take a look at his blog and read the comments that others are leaving on the entry where he announced the report, for a bigger perspective. The link to the blog is above in the lesson.

And, I’d love to hear more of your thinking, as you read more in this area… It seems to me vitally important that we think about how we’re shaping learning in a site that calls itself a “Learn Hub.”

  • Quote
  • Posted 6 months ago.
Enkerli
  • Authority 106
Post Body
Enkerli said in response to:
mawstools
mawstools’ post:
Citation Body

Enkerli, I’m just reading the reports myself. They are compiled from many areas in which data has been kept, not just language learning, but all kinds of learning. Will, himself, says he recommends that folks think of them as benchmarks against which we measure our own experience, not rules. No scientist would ask anyone to use research as rules (grin)... and he’s a fine one.

I recommend you take a look at his blog and read the comments that others are leaving on the entry where he announced the report, for a bigger perspective. The link to the blog is above in the lesson.

And, I’d love to hear more of your thinking, as you read more in this area… It seems to me vitally important that we think about how we’re shaping learning in a site that calls itself a “Learn Hub.”

“I recommend you take a look at his blog and read the comments that others are leaving on the entry where he announced the report, for a bigger perspective.”

Skimmed them before, went back after reading your reply. Many comments are about Will’s decision to provide those files for free. As an Open Access advocate, I’m quite sensitive to these issues. But, in my part of the academic world, “giving away” research results seems like the logical thing to do in most situations. As much of the research in fields I’m more accustomed to is publicly-funded, I simply expect that the results are made available to the public. In fact, I associate “publishing” (in peer-reviewed journals, in books, on blogs) to “making something public.” But that’s probably because I don’t spend enough time in the “private sphere.”

The exchange of comments between Will and Mark is getting somewhere, in part because of the way the report is positioned. I sense that Mark has perceived something similar to what I’ve perceived, in some educational contexts where results of research are conceived as revelations and are integrated as they are in a program, a reform, a workshop, a retreat. I call it the “studies have shown” attitude and I have serious qualms about it. Probably because I sometimes dwell in a tower made of ivory.

“And, I’d love to hear more of your thinking, as you read more in this area…”

Well… I did read more about feedback, in the past. And I did skim Will’s report. Would you have suggestions for some openly available resource on the topic of feedback in, say, cooperative learning?

“recommends that folks think of them as benchmarks against which we measure our own experience, not rules”

Fair enough. But I’m still afraid that some people (say, in a teaching resource centre) will use them as rules or as support for the “studies have shown” attitude.

Anyhoo… Assuming the summary on Will’s blog (reproduced here) does give a fairly good idea of what Will’s major findings are (and, skimming the report, I get the impression it does)...

I can easily imagine how Will’s benchmarks would “work” in contexts of direct instruction with clear criteria for evaluating retention and understanding. Language learning is an obvious example, for me. Job training is more foreign to learning contexts in which I’ve participated but these benchmarks seem appropriate there too.

But, honestly, I have a hard time grokking what they bring to, say, seminar learning sessions on broad sets of issues, let alone to more cooperative learning contexts. In fact, I can’t help but think that these benchmarks strengthen the position of the “feedback-giver” and make the learning context more formal and more “directional” (one-to-many, instead of many-to-many). I’m personally interested in learning that is cooperative, flexible, collaborative, informal, open, and culturally aware. Not sure I hear Will’s specific points as directly useful to me.

Also, while skimming the report itself, I didn’t notice much about the feedback learners give one another, give themselves individually, receive through the task itself, give to someone with a different role, or receive informally. These all seem quite important, to me. Granted, my idea of feedback comes in part from theory of performance and ethnography of communication.

What I might like to see would be a discussion (with multiple participants) about different ways to receive and provide feedback on learning, using a wide array of micro-level descriptions as well as macro-level characterizations of diverse learning contexts. It’d be especially useful if the primary focus were on cooperative learning. Surely, these must exist. But I can’t rely on Web searches to find them.

  • Quote
  • Posted 6 months ago.
mawstools
  • Authority 470
Post Body
mawstools said:

How about starting up a discussion like the one you’d like to have the results of? I am finding this community here at LearnHub to be a fascinating place to initiate discussions on topics I want to learn about cooperatively.

This is a great place to probe the “private” sphere … the nebulous NON-ACADEMIC space where people are learning INFORMALLY together.

That’s precisely my motivation for posting this resource here ;-) and we’re starting the process, aren’t we?

Want to bring it up higher in the architecture so others can SEE better what we’re talking about and join in the conversation… or would you like me to? This is a topic I’m VERY interested in!

  • Quote
  • Posted 6 months ago.
Enkerli
  • Authority 106
Post Body
Enkerli said in response to:
mawstools
mawstools’ post:
Citation Body

How about starting up a discussion like the one you’d like to have the results of? I am finding this community here at LearnHub to be a fascinating place to initiate discussions on topics I want to learn about cooperatively.

This is a great place to probe the “private” sphere … the nebulous NON-ACADEMIC space where people are learning INFORMALLY together.

That’s precisely my motivation for posting this resource here ;-) and we’re starting the process, aren’t we?

Want to bring it up higher in the architecture so others can SEE better what we’re talking about and join in the conversation… or would you like me to? This is a topic I’m VERY interested in!

That could work. Especially if it’s well-contextualized. Not that I’m so attached to the topic but I think it’d be an interesting one to bring to discussion. Diverse forms of feedback in diverse learning contexts. What has worked or not worked in diverse situations. What are we trying to achieve. What roles are assumed through feedback-giving.

  • Quote
  • Posted 6 months ago.
mawstools
  • Authority 470
Post Body
mawstools said:

Would you like to post a new discussion here, then, or elsewhere? Or would you like me to start it?

  • Quote
  • Posted 6 months ago.
Enkerli
  • Authority 106
Post Body
Enkerli said in response to:
mawstools
mawstools’ post:
Citation Body

Would you like to post a new discussion here, then, or elsewhere? Or would you like me to start it?

It might be a good idea if you posted a discussion since my approach to the topic is still as a semi-outsider. It’s easier for me to get involved once things have already started.

  • Quote
  • Posted 6 months ago.
mawstools
  • Authority 470
Post Body
mawstools said:

I will be happy to start up a discussion soon. I have an onsite commitment for the next couple of days and will get back to this first of the week. Thanks so much for pushing forward on this!

  • Quote
  • Posted 6 months ago.
  • Your comment will be modifiable for 10 minutes after posted.

Page Author

Avatar
mawstools
Name
mawstools

From Here You Can…

Information

Most Recent Related Content

This work is public domain.