Moodle Community Sites
  1. Moodle Community Sites
  2. MDLSITE-1515

Plugins: Evaluate review criteria, sets, and awards to be used

    Details

    • Type: Task Task
    • Status: Open
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Component/s: moodle.org/plugins
    • Labels:
      None

      Description

      I'm looking to respond to a question from Gavin about how to do reviews. It seems prudent that we discuss and come to some agreement about an initial vision for how to use sets, awards, and review criteria so there is not redundancy and clarity about how these various pieces are best used. Peace - Anthony

        Gliffy Diagrams

          Activity

          Hide
          Martin Dougiamas added a comment -

          The way it works is that there are various criteria for reviewing against, and we can control who uses what criteria via cohorts. Each criteria has a 1-10 rating and text.

          Currently it is set up with

          • General review
          • Security review
          • Accessibility review
          • Usability review

          and currently Gavin is assigned to the cohort of "General" reviewers, so he can only do general reviews currently.

          The idea was that we would have experts in the each of the criteria doing reviews on those, but we don't have any experts for security, accessibility and usability yet.

          Show
          Martin Dougiamas added a comment - The way it works is that there are various criteria for reviewing against, and we can control who uses what criteria via cohorts. Each criteria has a 1-10 rating and text. Currently it is set up with General review Security review Accessibility review Usability review and currently Gavin is assigned to the cohort of "General" reviewers, so he can only do general reviews currently. The idea was that we would have experts in the each of the criteria doing reviews on those, but we don't have any experts for security, accessibility and usability yet.
          Hide
          Martin Dougiamas added a comment -

          I think Sets should be used only for grouping plugins together (ie if they rely on each other, or work together). eg SCORM Cloud has a course format and an activity.

          Awards I've yet to think about.

          Show
          Martin Dougiamas added a comment - I think Sets should be used only for grouping plugins together (ie if they rely on each other, or work together). eg SCORM Cloud has a course format and an activity. Awards I've yet to think about.
          Hide
          Bruno Vernier added a comment -

          for starters, can't we have a simple anecdotal review system? we already have the tab "Reviews" but it seems there is no way to input even simple textarea anecdotal reviews for any plugin

          Show
          Bruno Vernier added a comment - for starters, can't we have a simple anecdotal review system? we already have the tab "Reviews" but it seems there is no way to input even simple textarea anecdotal reviews for any plugin
          Hide
          Anthony Borrow added a comment -

          Martin - In terms of process, for general reviewers how do we want to go about vetting them? Chad Outten - http://moodle.org/user/profile.php?id=93233 - has expressed interest in writing some reviews. For general reviews, might we say that any Particularly Helpful Moodler - http://moodle.org/user/index.php?id=5&group=1 - requesting to be a reviewer could also be added to the list of general reviewers? Peace - Anthony

          p.s. I've added Michael as a watcher to this issue as well

          Show
          Anthony Borrow added a comment - Martin - In terms of process, for general reviewers how do we want to go about vetting them? Chad Outten - http://moodle.org/user/profile.php?id=93233 - has expressed interest in writing some reviews. For general reviews, might we say that any Particularly Helpful Moodler - http://moodle.org/user/index.php?id=5&group=1 - requesting to be a reviewer could also be added to the list of general reviewers? Peace - Anthony p.s. I've added Michael as a watcher to this issue as well
          Hide
          Anthony Borrow added a comment - - edited

          Stuart Mealor - http://moodle.org/user/profile.php?id=21336 - is also interested in reviewing. I was going to go ahead and add Stuart and Chad by assigning the Plugin reviewers role via http://moodle.org/admin/roles/assign.php?contextid=50&roleid=14 but the page did not show any potential users. I'll attach a screen shot. Peace - Anthony

          Show
          Anthony Borrow added a comment - - edited Stuart Mealor - http://moodle.org/user/profile.php?id=21336 - is also interested in reviewing. I was going to go ahead and add Stuart and Chad by assigning the Plugin reviewers role via http://moodle.org/admin/roles/assign.php?contextid=50&roleid=14 but the page did not show any potential users. I'll attach a screen shot. Peace - Anthony
          Hide
          Anthony Borrow added a comment -

          How do we search potential users?

          Show
          Anthony Borrow added a comment - How do we search potential users?
          Hide
          Anthony Borrow added a comment -

          Stuart also has http://dev.moodlebites.com/ which has installed many plugins. I'm not sure how extensively the code may have been reviewed before being placed on the site but passing some type of review by a Partner may be worthy of an award of some type. I've asked Stuart to think about the various types of awards that might be appropriate and to share his comments here in the tracker. Peace - Anthony

          Show
          Anthony Borrow added a comment - Stuart also has http://dev.moodlebites.com/ which has installed many plugins. I'm not sure how extensively the code may have been reviewed before being placed on the site but passing some type of review by a Partner may be worthy of an award of some type. I've asked Stuart to think about the various types of awards that might be appropriate and to share his comments here in the tracker. Peace - Anthony
          Hide
          Stuart R Mealor added a comment -

          Yeah, I'm happy to review - maybe in the 'General review' or 'Usability review' areas if these are still relevant? Mods that are on: http://dev.moodlebites.com/ are ones that have installed 'easily' and 'do what they say on the tin'. Anything that fails to work is taken off immediately (Course hidden) until such time as it works. I guess this is in itself a 'quality review' (at least in terms of the LAMP environment we are using).

          Show
          Stuart R Mealor added a comment - Yeah, I'm happy to review - maybe in the 'General review' or 'Usability review' areas if these are still relevant? Mods that are on: http://dev.moodlebites.com/ are ones that have installed 'easily' and 'do what they say on the tin'. Anything that fails to work is taken off immediately (Course hidden) until such time as it works. I guess this is in itself a 'quality review' (at least in terms of the LAMP environment we are using).
          Hide
          Anthony Borrow added a comment -

          Martin - Would you (or Jordan) mind trying to assign Stuart as a reviewer? I was unable to because I could not see anyway to limit down the available users which may be a 2.2 bug for sites with a large number of users (see screen shot above) for how it appeared to me. Peace - Anthony

          Show
          Anthony Borrow added a comment - Martin - Would you (or Jordan) mind trying to assign Stuart as a reviewer? I was unable to because I could not see anyway to limit down the available users which may be a 2.2 bug for sites with a large number of users (see screen shot above) for how it appeared to me. Peace - Anthony
          Hide
          Martin Dougiamas added a comment -

          Yep, looks like a new regression in Moodle

          Show
          Martin Dougiamas added a comment - Yep, looks like a new regression in Moodle
          Hide
          Marina Glancy added a comment -

          Created a bug for it MDL-31072 but have to wait for Jordan

          Show
          Marina Glancy added a comment - Created a bug for it MDL-31072 but have to wait for Jordan
          Hide
          Aparup Banerjee added a comment -

          Hi

          (sorry for the spam, just wanted to watch lots of currently open issues)

          Show
          Aparup Banerjee added a comment - Hi (sorry for the spam, just wanted to watch lots of currently open issues)
          Hide
          Aparup Banerjee added a comment -

          Hi All,
          I just did some looking up and some roles seem to have been set for the 'reviewer' role.
          I am wondering what is the status with the reviewing system now. Has anyone tried any reviews? How does it work for you?

          Are there any issues now hindering any reviewing? if so, i think we can create sub-tasks here to improve this.

          Show
          Aparup Banerjee added a comment - Hi All, I just did some looking up and some roles seem to have been set for the 'reviewer' role. I am wondering what is the status with the reviewing system now. Has anyone tried any reviews? How does it work for you? Are there any issues now hindering any reviewing? if so, i think we can create sub-tasks here to improve this.
          Hide
          Helen Foster added a comment -

          Just noting a couple of things from chatting with Apu:

          Here's a link to a recent discussion about plugin reviews: http://moodle.org/mod/forum/discuss.php?d=210176

          Show
          Helen Foster added a comment - Just noting a couple of things from chatting with Apu: There seems to be no problems with adding reviews We just need to provide information for everyone about our reviewer selection process e.g. http://docs.moodle.org/dev/Plugin_reviews (similar to http://docs.moodle.org/dev/Plugin_validation ) and then publicise it and add a link to it from the plugins directory Here's a link to a recent discussion about plugin reviews: http://moodle.org/mod/forum/discuss.php?d=210176
          Hide
          David Mudrak added a comment -

          Bulk assigning open plugins directory issues to myself.

          Show
          David Mudrak added a comment - Bulk assigning open plugins directory issues to myself.
          Hide
          Anthony Borrow added a comment -

          So there is some good history here about trying to find and manage folks who could be trusted reviewers (not approvers) of Moodle Plugins. The goal is to build up a small community of users for both of those roles. Peace - Anthony

          Show
          Anthony Borrow added a comment - So there is some good history here about trying to find and manage folks who could be trusted reviewers (not approvers) of Moodle Plugins. The goal is to build up a small community of users for both of those roles. Peace - Anthony
          Hide
          Stuart R Mealor added a comment -

          I'm happy to get involved in these again, but was holding off while there seemed to be some changes in the organisation of this. So is it 'business as usual' again? I'll be evaluating numerous plugins during December to select for use during 2015 with Moodle 2.7 and 2.8. Stu.

          Show
          Stuart R Mealor added a comment - I'm happy to get involved in these again, but was holding off while there seemed to be some changes in the organisation of this. So is it 'business as usual' again? I'll be evaluating numerous plugins during December to select for use during 2015 with Moodle 2.7 and 2.8. Stu.
          Hide
          Anthony Borrow added a comment -

          Stuart - Plugins are especially a work in progress but David is working on wrapping his head around the whole Plugins ecosystem so knowing of your interest and generosity to help out is itself helpful as we work to move things forward a bit. Peace - Anthony

          Show
          Anthony Borrow added a comment - Stuart - Plugins are especially a work in progress but David is working on wrapping his head around the whole Plugins ecosystem so knowing of your interest and generosity to help out is itself helpful as we work to move things forward a bit. Peace - Anthony
          Hide
          Anthony Borrow added a comment -

          P.s. - Have you seen David's excellent write ups on the featured plugin of the month?

          Show
          Anthony Borrow added a comment - P.s. - Have you seen David's excellent write ups on the featured plugin of the month?

            People

            • Votes:
              2 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:

                Development