Moodle

'workshop-like' teacher assessment methods (rubrics, accumulative, etc) for assignments

Details

  • Type: New Feature New Feature
  • Status: Closed Closed
  • Priority: Major Major
  • Resolution: Fixed
  • Affects Version/s: 1.1.1
  • Fix Version/s: 2.2
  • Component/s: Assignment, Gradebook
  • Labels:
  • Environment:
    All
  • Affected Branches:
    MOODLE_11_STABLE
  • Fixed Branches:
    MOODLE_22_STABLE

Description

the assessment methods in the workshop module are lovely (the accumulative or rubric-based scales), and I would like to use them on assignments that either do not need the complexity of the workshop's 4-stage peer review, or use them with offline work (ie. work viewed in class that doesn't exist electronically)

Issue Links

Activity

Hide
John Isner added a comment -

This is a great idea. Better still, make it possible to compose an Assessment Form with other gradable activies like Assignment. But even as a simple stand-alone activity, Assessment Form would be valuable addition.

Show
John Isner added a comment - This is a great idea. Better still, make it possible to compose an Assessment Form with other gradable activies like Assignment. But even as a simple stand-alone activity, Assessment Form would be valuable addition.
Hide
Lauren Keinath added a comment -

This would be a fantastic addition. I have a considerable number of faculty who would welcome this. If this could be incorporated with other Assignment types, as John suggests, it would be extremely useful. Just my 2 cents.

Show
Lauren Keinath added a comment - This would be a fantastic addition. I have a considerable number of faculty who would welcome this. If this could be incorporated with other Assignment types, as John suggests, it would be extremely useful. Just my 2 cents.
Hide
Rob Monk added a comment -

This is a vital feature. Schools in Victoria ar being encouraged to use rubrics for assessment. Teachers pet hate with Rubrics is the paper warefare they create. The ability to assess an assignment in Moodle, either an online or offline task, using an online rubric would be sensational.
It should not to too hard to program.

Can you move that priority up a bit higher.

Show
Rob Monk added a comment - This is a vital feature. Schools in Victoria ar being encouraged to use rubrics for assessment. Teachers pet hate with Rubrics is the paper warefare they create. The ability to assess an assignment in Moodle, either an online or offline task, using an online rubric would be sensational. It should not to too hard to program. Can you move that priority up a bit higher.
Hide
joe mccarthy-holand added a comment -

I would love to be able to do this simply, Many of my colegues have asked for something simular

Show
joe mccarthy-holand added a comment - I would love to be able to do this simply, Many of my colegues have asked for something simular
Hide
Ray Lawrence added a comment -

+ 10 on this. It's the perfect companion to outcomes.

John, "Assessment Form" ? Would the above added to offline assignment not do the job?

Show
Ray Lawrence added a comment - + 10 on this. It's the perfect companion to outcomes. John, "Assessment Form" ? Would the above added to offline assignment not do the job?
Hide
Art Lader added a comment -

Would be a great feature.

Show
Art Lader added a comment - Would be a great feature.
Hide
Steven Reiter added a comment -

I am working for the department of Computer Science at the University of Alberta and one of my projects for the summer is to add rubrics to the assignments module on our system. After reading these comments and discussing the desired functionality with those that have requested it here, it would seem that adding the Rubrics to the base class (applying it to all assignment types), as Ray suggested, would be best.

I will submit the changes when we get somewhere with it.

Show
Steven Reiter added a comment - I am working for the department of Computer Science at the University of Alberta and one of my projects for the summer is to add rubrics to the assignments module on our system. After reading these comments and discussing the desired functionality with those that have requested it here, it would seem that adding the Rubrics to the base class (applying it to all assignment types), as Ray suggested, would be best. I will submit the changes when we get somewhere with it.
Hide
Lance Groesbeck added a comment -

I think this would be a great idea.

Show
Lance Groesbeck added a comment - I think this would be a great idea.
Hide
Marylan Hightree added a comment -

Many of our instructors use rubrics for their assignments. We are recent adopters of Moodle, and would really appreciate this feature in Moodle.

Show
Marylan Hightree added a comment - Many of our instructors use rubrics for their assignments. We are recent adopters of Moodle, and would really appreciate this feature in Moodle.
Hide
Spencer Creasey added a comment -

Over the past year, my team and I completed a quite thorough version of this for 1.8.3 as a replacement "assignment" module. It was stable but never put into production at our university. Instead of releasing it, I'm upgrading it to work with the newest 1.9.x version of Moodle (I'd rather not support 2 versions ^^ ) – then I'll release it.

I'll post any updates as I move this along.

Show
Spencer Creasey added a comment - Over the past year, my team and I completed a quite thorough version of this for 1.8.3 as a replacement "assignment" module. It was stable but never put into production at our university. Instead of releasing it, I'm upgrading it to work with the newest 1.9.x version of Moodle (I'd rather not support 2 versions ^^ ) – then I'll release it. I'll post any updates as I move this along.
Hide
Grant Beevers added a comment -

Spencer - this is fantastic - have been looking for something like this. Look forward to the release.

Show
Grant Beevers added a comment - Spencer - this is fantastic - have been looking for something like this. Look forward to the release.
Hide
Dale William Quattrin added a comment -

This is great!! I will be trying to implement as soon as it is available.

Show
Dale William Quattrin added a comment - This is great!! I will be trying to implement as soon as it is available.
Hide
Martin Dougiamas added a comment -

Can we have a full description/spec posted here? I'm uncertain how it's different from using outcomes.

Show
Martin Dougiamas added a comment - Can we have a full description/spec posted here? I'm uncertain how it's different from using outcomes.
Hide
Spencer Creasey added a comment -

Whew! I've posted the latest version of my Assignment Module replacement with rubrics here:

http://moodle.org/mod/data/view.php?d=13&rid=1642

Show
Spencer Creasey added a comment - Whew! I've posted the latest version of my Assignment Module replacement with rubrics here: http://moodle.org/mod/data/view.php?d=13&rid=1642
Hide
Vernellia Randall added a comment -

Peer and self assessment should be integrated into assignments. They are an important pedadogogical tool that I know that many people use extensively across many types of assignment.

Show
Vernellia Randall added a comment - Peer and self assessment should be integrated into assignments. They are an important pedadogogical tool that I know that many people use extensively across many types of assignment.
Hide
Tammy Maginity added a comment -

THIS WOULD BE AWESOME!

My staff are required to use moodle and do at least two totally online assignments. The biggest complaint is that once the file gets to the teacher, it is difficult to grade online. They want to be able to give comments (more than the quickgrade) and get it back to the student easily. This is time consuming. If there were a way to create an online rubric that the teacher could use online and comment on that would automatically be on the student account (without the need to upload back to student) would be absolutely awesome. I teach at MSU and we have that type of portfolio where the student uploads the file to the assignment in the portfolio. I can open it and view it. I can use the rubric to score it and give comments and that is saved back to the student portfolio where they can see that.

I would love to have that for my K-12 building. This should be more than a minor status. This would be huge!

Show
Tammy Maginity added a comment - THIS WOULD BE AWESOME! My staff are required to use moodle and do at least two totally online assignments. The biggest complaint is that once the file gets to the teacher, it is difficult to grade online. They want to be able to give comments (more than the quickgrade) and get it back to the student easily. This is time consuming. If there were a way to create an online rubric that the teacher could use online and comment on that would automatically be on the student account (without the need to upload back to student) would be absolutely awesome. I teach at MSU and we have that type of portfolio where the student uploads the file to the assignment in the portfolio. I can open it and view it. I can use the rubric to score it and give comments and that is saved back to the student portfolio where they can see that. I would love to have that for my K-12 building. This should be more than a minor status. This would be huge!
Hide
David Mudrak added a comment -

In Moodle 2.0, Workshop module can be set up so that it behaves like a simple Assignment module, just having the advanced grading methods available (rubrics etc). Basically there are three checkboxes for every workshop instance that the teacher can use to turn the feature on/off
[ ] use self assessment
[ ] use peer assessment
[ ] use assessment of example submissions

If all these are off, you have quite simple Assignment-like module with the possibility to use your own assessment form. So instead of incorporating Workshop features into Assignment, you can use the simplified mode of Workshop that actually works similar to the Assignment (covering all three subtypes - Online text, Single upload and partially Advanced upload).

Show
David Mudrak added a comment - In Moodle 2.0, Workshop module can be set up so that it behaves like a simple Assignment module, just having the advanced grading methods available (rubrics etc). Basically there are three checkboxes for every workshop instance that the teacher can use to turn the feature on/off [ ] use self assessment [ ] use peer assessment [ ] use assessment of example submissions If all these are off, you have quite simple Assignment-like module with the possibility to use your own assessment form. So instead of incorporating Workshop features into Assignment, you can use the simplified mode of Workshop that actually works similar to the Assignment (covering all three subtypes - Online text, Single upload and partially Advanced upload).
Hide
Anthony Borrow added a comment -

David - I recently received a message from Richard Webb regarding functionality that was geared toward the assignment module; however, it really seems to me that it might fit better conceptually into the workshop module. As I understand it, it pertains to defining a rubric which can be used to assess an assignment. The code for the assignment version was shared at http://moodle.org/mod/data/view.php?d=13&rid=1642 and I figured it might be good to be aware of the functionality there and how your work with the workshop module may provide similar capabilities. Peace - Anthony

Show
Anthony Borrow added a comment - David - I recently received a message from Richard Webb regarding functionality that was geared toward the assignment module; however, it really seems to me that it might fit better conceptually into the workshop module. As I understand it, it pertains to defining a rubric which can be used to assess an assignment. The code for the assignment version was shared at http://moodle.org/mod/data/view.php?d=13&rid=1642 and I figured it might be good to be aware of the functionality there and how your work with the workshop module may provide similar capabilities. Peace - Anthony
Hide
David Mudrak added a comment -

Anthony, thanks for the link. I guess this fully overlaps with the rubric grading strategy in workshop.

Show
David Mudrak added a comment - Anthony, thanks for the link. I guess this fully overlaps with the rubric grading strategy in workshop.
Hide
David Mudrak added a comment -

This will be resolved by MDL-23557. I suggest to close this issue.

Show
David Mudrak added a comment - This will be resolved by MDL-23557. I suggest to close this issue.
Hide
Mark Drechsler added a comment -

I thought I'd throw a comment in here since it is becoming a hot topic among a few clients of mine.

Although the brilliant new Workshop module does provide the ability to use rubric grading (a thousand thanks again to David for his work on it), what would be really neat would be to have the concept of re-using rubrics across multiple assessment types. At the moment, if I create a workshop with a complex rubric and I want to use that rubric again then I need to re-create it many times. Would be great if the marking form was a separate entity that I could grab as needed, plug in to an assignment, glossary or forum, and have the marks sent through to the gradebook.

I know this is probably going way beyond the initial discussion, but I thought I'd throw in the idea before this ticket (which surely must be among the oldest remaining open ones) is put to sleep.

Thoughts welcome!

Mark.

Show
Mark Drechsler added a comment - I thought I'd throw a comment in here since it is becoming a hot topic among a few clients of mine. Although the brilliant new Workshop module does provide the ability to use rubric grading (a thousand thanks again to David for his work on it), what would be really neat would be to have the concept of re-using rubrics across multiple assessment types. At the moment, if I create a workshop with a complex rubric and I want to use that rubric again then I need to re-create it many times. Would be great if the marking form was a separate entity that I could grab as needed, plug in to an assignment, glossary or forum, and have the marks sent through to the gradebook. I know this is probably going way beyond the initial discussion, but I thought I'd throw in the idea before this ticket (which surely must be among the oldest remaining open ones) is put to sleep. Thoughts welcome! Mark.
Hide
Anthony Borrow added a comment -

Mark - Thanks for your input. Being able to bring over a set of rubrics sounds like it would be a useful feature. I am curious if and how a particular rubric item might related to outcomes. I've not played much with the new workshop module yet to see how outcomes are dealt with. I suspect they are not so much related to the rubric as much as to the submission itself. I thought it might be interesting though if we had an outcome whereby students were expected to be able to recognize something (say subject/verb agreement) and the teacher could give credit to the students evaluating another's work to indicate that they had mastered that. I realize that such functionality with complicate the grading mechanism since the teacher would be grading the evaluators as well as those making the submissions. I am just curious if that type of functionality might be helpful to teachers. Perhaps my idea would be better discussed in the forums. Peace - Anthony

Show
Anthony Borrow added a comment - Mark - Thanks for your input. Being able to bring over a set of rubrics sounds like it would be a useful feature. I am curious if and how a particular rubric item might related to outcomes. I've not played much with the new workshop module yet to see how outcomes are dealt with. I suspect they are not so much related to the rubric as much as to the submission itself. I thought it might be interesting though if we had an outcome whereby students were expected to be able to recognize something (say subject/verb agreement) and the teacher could give credit to the students evaluating another's work to indicate that they had mastered that. I realize that such functionality with complicate the grading mechanism since the teacher would be grading the evaluators as well as those making the submissions. I am just curious if that type of functionality might be helpful to teachers. Perhaps my idea would be better discussed in the forums. Peace - Anthony
Hide
Anthony Borrow added a comment -

p.s. - I also wonder to what degree the original intent of this may have been resolved by outcomes. An assignment can have various outcomes which the teacher rates functionally giving the assignments a rubric like structure.

Show
Anthony Borrow added a comment - p.s. - I also wonder to what degree the original intent of this may have been resolved by outcomes. An assignment can have various outcomes which the teacher rates functionally giving the assignments a rubric like structure.
Hide
Mark Drechsler added a comment -

Hi Anthony,

Revisiting this one after a break.

For me, outcomes are measuring something which I should be considering as generic across courses (such as writing clarity) whereas an element of a rubric is something I want to use specific to, say, a series of assignments in my specific field, and which are combined together to give me a final score for the assignment. This is exactly what the Workshop does, but I can't un-plug that rubric from the workshop and then re-use it in other assignments in my course, which would be ideal.

Hope that makes sense,

Mark.

Show
Mark Drechsler added a comment - Hi Anthony, Revisiting this one after a break. For me, outcomes are measuring something which I should be considering as generic across courses (such as writing clarity) whereas an element of a rubric is something I want to use specific to, say, a series of assignments in my specific field, and which are combined together to give me a final score for the assignment. This is exactly what the Workshop does, but I can't un-plug that rubric from the workshop and then re-use it in other assignments in my course, which would be ideal. Hope that makes sense, Mark.
Hide
Rob Monk added a comment -

I agree with Mark. The mechanism for using a rubric in the new workshop module is good but it is awkward to use after that.
When I set an assignment I want to be able to either click the "out of" or "scales" option or click a "use a rubric" option. This would take me into something like the workshop rubric setup which seems OK but with someone who knows something about UI design could be made better. I have in mind a "scoring rubric" This would be very popular with users.

Show
Rob Monk added a comment - I agree with Mark. The mechanism for using a rubric in the new workshop module is good but it is awkward to use after that. When I set an assignment I want to be able to either click the "out of" or "scales" option or click a "use a rubric" option. This would take me into something like the workshop rubric setup which seems OK but with someone who knows something about UI design could be made better. I have in mind a "scoring rubric" This would be very popular with users.
Hide
Anthony Borrow added a comment -

Just to be clear, the use of a rubric is really not too much more that allowing multiple grades to be assigned and calculated. As an example, a writing assignment could be graded on:

Creativity: 0-10 pts
Spelling and grammar: 0-20 pts
Organization: 0-20 pts

One thought I had was that rather than duplicating the complexity of the grade book with weighted grades and trying to say that Creativity is worth 20%, Spelling and grammar worth 40%, Organization worth 40% is probably something we want to avoid; however, we need to think about how grades will be calculated for rubrics which often times may be scales rather than points. As Martin stated earlier, we really need to work toward developing a good spec for what this would look like and how it will work. Otherwise, I fear there is a bit of a danger that folks will have very different ideas about what is expected and end up rather frustrated. Part of that will be differentiating the grading rubrics from outcomes. My thought is that by using a rather specific example we may be able to come to some agreement.

Peace - Anthony

Show
Anthony Borrow added a comment - Just to be clear, the use of a rubric is really not too much more that allowing multiple grades to be assigned and calculated. As an example, a writing assignment could be graded on: Creativity: 0-10 pts Spelling and grammar: 0-20 pts Organization: 0-20 pts One thought I had was that rather than duplicating the complexity of the grade book with weighted grades and trying to say that Creativity is worth 20%, Spelling and grammar worth 40%, Organization worth 40% is probably something we want to avoid; however, we need to think about how grades will be calculated for rubrics which often times may be scales rather than points. As Martin stated earlier, we really need to work toward developing a good spec for what this would look like and how it will work. Otherwise, I fear there is a bit of a danger that folks will have very different ideas about what is expected and end up rather frustrated. Part of that will be differentiating the grading rubrics from outcomes. My thought is that by using a rather specific example we may be able to come to some agreement. Peace - Anthony
Hide
Mark Drechsler added a comment -

I'm happy to help out with the spec if it will make this become a reality - good to hear that its on the roadmap for 2.1

Show
Mark Drechsler added a comment - I'm happy to help out with the spec if it will make this become a reality - good to hear that its on the roadmap for 2.1
Hide
Michael Blake added a comment -

This issue is affecting MP clients. Please give it priority.

Show
Michael Blake added a comment - This issue is affecting MP clients. Please give it priority.
Hide
David Mudrak added a comment -

Re-triaging according the internal 2.2 Roadmap document, to be picked by the assigned dev team later

Show
David Mudrak added a comment - Re-triaging according the internal 2.2 Roadmap document, to be picked by the assigned dev team later
Hide
David Mudrak added a comment -
Show
David Mudrak added a comment - Please see http://moodle.org/mod/forum/discuss.php?d=184393
Hide
Isabelle Langeveld added a comment -

David, there does not seem to be much activity on this feature. It would be so great to have it working!

Show
Isabelle Langeveld added a comment - David, there does not seem to be much activity on this feature. It would be so great to have it working!
Hide
David Mudrak added a comment -

Isabelle, I believe we will be able to close this once MDL-29108 lands in Moodle 2.2.

Show
David Mudrak added a comment - Isabelle, I believe we will be able to close this once MDL-29108 lands in Moodle 2.2.
Hide
David Mudrak added a comment -

For your information, the preview of the rubrics support in Moodle 2.2 is available for pre-testing at http://creeper.moodle.net/

Sorry there is no user documentation yet but that is on our todo list.

Show
David Mudrak added a comment - For your information, the preview of the rubrics support in Moodle 2.2 is available for pre-testing at http://creeper.moodle.net/ Sorry there is no user documentation yet but that is on our todo list.
Hide
David Mudrak added a comment -

Advanced grading methods framework becaming part of Moodle 2.2. Closing this now. Thanks for being patient

Show
David Mudrak added a comment - Advanced grading methods framework becaming part of Moodle 2.2. Closing this now. Thanks for being patient