Moodle Community Sites
  1. Moodle Community Sites
  2. MDLSITE-1515

Plugins: Evaluate review criteria, sets, and awards to be used

    Details

    • Type: Task Task
    • Status: Open
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Component/s: moodle.org/plugins
    • Labels:
      None
    • Rank:
      19804

      Description

      I'm looking to respond to a question from Gavin about how to do reviews. It seems prudent that we discuss and come to some agreement about an initial vision for how to use sets, awards, and review criteria so there is not redundancy and clarity about how these various pieces are best used. Peace - Anthony

        Activity

        Hide
        Martin Dougiamas added a comment -

        The way it works is that there are various criteria for reviewing against, and we can control who uses what criteria via cohorts. Each criteria has a 1-10 rating and text.

        Currently it is set up with

        • General review
        • Security review
        • Accessibility review
        • Usability review

        and currently Gavin is assigned to the cohort of "General" reviewers, so he can only do general reviews currently.

        The idea was that we would have experts in the each of the criteria doing reviews on those, but we don't have any experts for security, accessibility and usability yet.

        Show
        Martin Dougiamas added a comment - The way it works is that there are various criteria for reviewing against, and we can control who uses what criteria via cohorts. Each criteria has a 1-10 rating and text. Currently it is set up with General review Security review Accessibility review Usability review and currently Gavin is assigned to the cohort of "General" reviewers, so he can only do general reviews currently. The idea was that we would have experts in the each of the criteria doing reviews on those, but we don't have any experts for security, accessibility and usability yet.
        Hide
        Martin Dougiamas added a comment -

        I think Sets should be used only for grouping plugins together (ie if they rely on each other, or work together). eg SCORM Cloud has a course format and an activity.

        Awards I've yet to think about.

        Show
        Martin Dougiamas added a comment - I think Sets should be used only for grouping plugins together (ie if they rely on each other, or work together). eg SCORM Cloud has a course format and an activity. Awards I've yet to think about.
        Hide
        Bruno Vernier added a comment -

        for starters, can't we have a simple anecdotal review system? we already have the tab "Reviews" but it seems there is no way to input even simple textarea anecdotal reviews for any plugin

        Show
        Bruno Vernier added a comment - for starters, can't we have a simple anecdotal review system? we already have the tab "Reviews" but it seems there is no way to input even simple textarea anecdotal reviews for any plugin
        Hide
        Anthony Borrow added a comment -

        Martin - In terms of process, for general reviewers how do we want to go about vetting them? Chad Outten - http://moodle.org/user/profile.php?id=93233 - has expressed interest in writing some reviews. For general reviews, might we say that any Particularly Helpful Moodler - http://moodle.org/user/index.php?id=5&group=1 - requesting to be a reviewer could also be added to the list of general reviewers? Peace - Anthony

        p.s. I've added Michael as a watcher to this issue as well

        Show
        Anthony Borrow added a comment - Martin - In terms of process, for general reviewers how do we want to go about vetting them? Chad Outten - http://moodle.org/user/profile.php?id=93233 - has expressed interest in writing some reviews. For general reviews, might we say that any Particularly Helpful Moodler - http://moodle.org/user/index.php?id=5&group=1 - requesting to be a reviewer could also be added to the list of general reviewers? Peace - Anthony p.s. I've added Michael as a watcher to this issue as well
        Hide
        Anthony Borrow added a comment - - edited

        Stuart Mealor - http://moodle.org/user/profile.php?id=21336 - is also interested in reviewing. I was going to go ahead and add Stuart and Chad by assigning the Plugin reviewers role via http://moodle.org/admin/roles/assign.php?contextid=50&roleid=14 but the page did not show any potential users. I'll attach a screen shot. Peace - Anthony

        Show
        Anthony Borrow added a comment - - edited Stuart Mealor - http://moodle.org/user/profile.php?id=21336 - is also interested in reviewing. I was going to go ahead and add Stuart and Chad by assigning the Plugin reviewers role via http://moodle.org/admin/roles/assign.php?contextid=50&roleid=14 but the page did not show any potential users. I'll attach a screen shot. Peace - Anthony
        Hide
        Anthony Borrow added a comment -

        How do we search potential users?

        Show
        Anthony Borrow added a comment - How do we search potential users?
        Hide
        Anthony Borrow added a comment -

        Stuart also has http://dev.moodlebites.com/ which has installed many plugins. I'm not sure how extensively the code may have been reviewed before being placed on the site but passing some type of review by a Partner may be worthy of an award of some type. I've asked Stuart to think about the various types of awards that might be appropriate and to share his comments here in the tracker. Peace - Anthony

        Show
        Anthony Borrow added a comment - Stuart also has http://dev.moodlebites.com/ which has installed many plugins. I'm not sure how extensively the code may have been reviewed before being placed on the site but passing some type of review by a Partner may be worthy of an award of some type. I've asked Stuart to think about the various types of awards that might be appropriate and to share his comments here in the tracker. Peace - Anthony
        Hide
        Stuart R Mealor added a comment -

        Yeah, I'm happy to review - maybe in the 'General review' or 'Usability review' areas if these are still relevant? Mods that are on: http://dev.moodlebites.com/ are ones that have installed 'easily' and 'do what they say on the tin'. Anything that fails to work is taken off immediately (Course hidden) until such time as it works. I guess this is in itself a 'quality review' (at least in terms of the LAMP environment we are using).

        Show
        Stuart R Mealor added a comment - Yeah, I'm happy to review - maybe in the 'General review' or 'Usability review' areas if these are still relevant? Mods that are on: http://dev.moodlebites.com/ are ones that have installed 'easily' and 'do what they say on the tin'. Anything that fails to work is taken off immediately (Course hidden) until such time as it works. I guess this is in itself a 'quality review' (at least in terms of the LAMP environment we are using).
        Hide
        Anthony Borrow added a comment -

        Martin - Would you (or Jordan) mind trying to assign Stuart as a reviewer? I was unable to because I could not see anyway to limit down the available users which may be a 2.2 bug for sites with a large number of users (see screen shot above) for how it appeared to me. Peace - Anthony

        Show
        Anthony Borrow added a comment - Martin - Would you (or Jordan) mind trying to assign Stuart as a reviewer? I was unable to because I could not see anyway to limit down the available users which may be a 2.2 bug for sites with a large number of users (see screen shot above) for how it appeared to me. Peace - Anthony
        Hide
        Martin Dougiamas added a comment -

        Yep, looks like a new regression in Moodle

        Show
        Martin Dougiamas added a comment - Yep, looks like a new regression in Moodle
        Hide
        Marina Glancy added a comment -

        Created a bug for it MDL-31072 but have to wait for Jordan

        Show
        Marina Glancy added a comment - Created a bug for it MDL-31072 but have to wait for Jordan
        Hide
        Aparup Banerjee added a comment -

        Hi

        (sorry for the spam, just wanted to watch lots of currently open issues)

        Show
        Aparup Banerjee added a comment - Hi (sorry for the spam, just wanted to watch lots of currently open issues)
        Hide
        Aparup Banerjee added a comment -

        Hi All,
        I just did some looking up and some roles seem to have been set for the 'reviewer' role.
        I am wondering what is the status with the reviewing system now. Has anyone tried any reviews? How does it work for you?

        Are there any issues now hindering any reviewing? if so, i think we can create sub-tasks here to improve this.

        Show
        Aparup Banerjee added a comment - Hi All, I just did some looking up and some roles seem to have been set for the 'reviewer' role. I am wondering what is the status with the reviewing system now. Has anyone tried any reviews? How does it work for you? Are there any issues now hindering any reviewing? if so, i think we can create sub-tasks here to improve this.
        Hide
        Helen Foster added a comment -

        Just noting a couple of things from chatting with Apu:

        Here's a link to a recent discussion about plugin reviews: http://moodle.org/mod/forum/discuss.php?d=210176

        Show
        Helen Foster added a comment - Just noting a couple of things from chatting with Apu: There seems to be no problems with adding reviews We just need to provide information for everyone about our reviewer selection process e.g. http://docs.moodle.org/dev/Plugin_reviews (similar to http://docs.moodle.org/dev/Plugin_validation ) and then publicise it and add a link to it from the plugins directory Here's a link to a recent discussion about plugin reviews: http://moodle.org/mod/forum/discuss.php?d=210176

          People

          • Votes:
            2 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:

              Development