Uploaded image for project: 'Moodle'
  1. Moodle
  2. MDL-62191

Add bulk actions for analytics' insights

    XMLWordPrintable

    Details

    • Testing Instructions:
      Hide

      Prerequisites (sorry in advance, this is long)
      Run these steps before upgrading

      1. Check out and install an earlier moodle version (e.g. 3.7)
      2. Log in as admin
      3. Enable 'enablecompletion' in site admin > advanced features
      4. Setup your timezone correctly in site admin > location > location settings
      5. Set up a course so that:
        • full & shortname: finished course
        • topics format
        • completion is enabled
        • startdate to right now (including hour and minute)
      6. Enrol 2 users as students in the course
      7. Enrol the logged in admin user as a teacher in the course
      8. Create a page activity in a course section different than section 0
      9. Log in as one of the students you enrolled (let's call him student1) and access the page activity
      10. Set the course end date to right now
      11. Click on the courses admin cog and select Course completion
      12. Set Condition: Manual completion by others to Teacher role
      13. Go to course admin > more... > reports > course completion
      14. Flag student1 as approved (tick the box in the Approval column)
      15. Run cron so that the course completion status of the student is updated
      16. Go to site admin > development > make test course
      17. Create a S size course with full and short name "ongoing course"
      18. Go to the course and edit its settings so that:
        • topics format
        • completion is enabled
        • startdate to right now (including hour and minute)
        • enddate tomorrow or any date later than that
      19. Enrol the logged in admin user as a teacher in the course
      20. Create a page activity in a course section different than section 0
      21. Click on the courses admin cog and select Course completion
      22. Set Condition: Manual completion by others to Teacher role
      23. Go to site admin > analytics > analytics settings and disable the 'onlycli' option
      24. Go to site admin > analytics > analytics models
      25. Click on new model > create model
      26. Set the following values in the form:
        1. Tick 'enabled'
        2. Target: Students at risk of not meeting the course completion conditions
        3. Indicators: Page cognitive
        4. Time-splitting method: Single range
        5. Default value for predictions processor
        6. Save changes
      27. Click on Actions > Execute scheduled analysis for the model you just created and click on continue once the analysis is finished
      28. Open the JS console and set the inspector so that it stops on exceptions
        • On Firefox: Debugger > Breakpoints > Pause on exceptions
        • On Chrome: Sources tab > click "Pause on exceptions" (Make sure to leave "Pause on caught exceptions" unticked)
      29. You should be now back in the analytics models page, you SHOULD see a dropdown menu in the insights column of the model you created above, select "ongoing course"
        • If you don't see the dropdown (it can happen randomly, this is fine) 'Actions > Clear predictions' and 'Actions > Execute scheduled analysis' again until you see it. If you don't see if after say... 5 tries check the 'Invalid analysables report' to confirm that the course you created is not invalid.
      30. You SHOULD see a long list of students identified as at-risk
      31. Select Actions > Not useful for one of the students
      32. Upgrade moodle
      33. Log in as admin and go to site admin > analytics > analytics models
      34. Select ongoing course in the Insights column for the model you created before
      35. You SHOULD see the following buttons on the top and bottom of the page:  Send message, Accept, Not applicable and Incorrectly flagged, they SHOULD be disabled by default
      36. Check a couple of the checkboxes next to student names, now check the checkbox on the table header, it is a toggle for all the checkboxes below, check that it works as a usual toggle checkbox, leave it unchecked once done
      37. Check two or three students (remember their names) and click on "Accept" on the top part of the page
      38. You SHOULD see a confirmation message, confirm it, those students SHOULD NOT be there anymore
      39. Reload the page, check that those students do not appear now
      40. Check two or three students (remember their names) and click on "Incorrectly Flagged" on the bottom part of the page
      41. You SHOULD see a confirmation message, confirm it, those students SHOULD NOT be there anymore
      42. Reload the page, check that those students do not appear now
      43. Check two or three students (remember their names) and click on "Not applicable" on the bottom part of the page
      44. You SHOULD see a confirmation message, confirm it, those students SHOULD NOT be there anymore
      45. Reload the page, check that those students do not appear now
      46. Check two or three students (remember their names) and click on "Send message" on the top part of the page, write a message and press "Send message to N people"
      47. You SHOULD see a notification on the top of the page: "Message sent to N people", the students SHOULD NOT be removed from the list of students and their checkboxes SHOULD remain checked
      48. Go to site admin > analytics > analytics models and click on Actions > Effectiveness report (or Actions Insights report if MDL-66628 has been integrated)
      49. There SHOULD NOT be any executed action with name Not useful
      Show
      Prerequisites (sorry in advance, this is long) Run these steps before upgrading Check out and install an earlier moodle version (e.g. 3.7) Log in as admin Enable 'enablecompletion' in site admin > advanced features Setup your timezone correctly in site admin > location > location settings Set up a course so that: full & shortname: finished course topics format completion is enabled startdate to right now (including hour and minute) Enrol 2 users as students in the course Enrol the logged in admin user as a teacher in the course Create a page activity in a course section different than section 0 Log in as one of the students you enrolled (let's call him student1) and access the page activity Set the course end date to right now Click on the courses admin cog and select Course completion Set Condition: Manual completion by others to Teacher role Go to course admin > more... > reports > course completion Flag student1 as approved (tick the box in the Approval column) Run cron so that the course completion status of the student is updated Go to site admin > development > make test course Create a S size course with full and short name "ongoing course" Go to the course and edit its settings so that: topics format completion is enabled startdate to right now (including hour and minute) enddate tomorrow or any date later than that Enrol the logged in admin user as a teacher in the course Create a page activity in a course section different than section 0 Click on the courses admin cog and select Course completion Set Condition: Manual completion by others to Teacher role Go to site admin > analytics > analytics settings and disable the 'onlycli' option Go to site admin > analytics > analytics models Click on new model > create model Set the following values in the form: Tick 'enabled' Target: Students at risk of not meeting the course completion conditions Indicators: Page cognitive Time-splitting method: Single range Default value for predictions processor Save changes Click on Actions > Execute scheduled analysis for the model you just created and click on continue once the analysis is finished Open the JS console and set the inspector so that it stops on exceptions On Firefox: Debugger > Breakpoints > Pause on exceptions On Chrome: Sources tab > click " Pause on exceptions " (Make sure to leave " Pause on caught exceptions " unticked) You should be now back in the analytics models page, you SHOULD see a dropdown menu in the insights column of the model you created above, select "ongoing course" If you don't see the dropdown (it can happen randomly, this is fine) 'Actions > Clear predictions' and 'Actions > Execute scheduled analysis' again until you see it. If you don't see if after say... 5 tries check the 'Invalid analysables report' to confirm that the course you created is not invalid. You SHOULD see a long list of students identified as at-risk Select Actions > Not useful for one of the students Upgrade moodle Log in as admin and go to site admin > analytics > analytics models Select ongoing course in the Insights column for the model you created before You SHOULD see the following buttons on the top and bottom of the page:  Send message, Accept, Not applicable and Incorrectly flagged, they SHOULD be disabled by default Check a couple of the checkboxes next to student names, now check the checkbox on the table header, it is a toggle for all the checkboxes below, check that it works as a usual toggle checkbox, leave it unchecked once done Check two or three students (remember their names) and click on "Accept" on the top part of the page You SHOULD see a confirmation message, confirm it, those students SHOULD NOT be there anymore Reload the page, check that those students do not appear now Check two or three students (remember their names) and click on "Incorrectly Flagged" on the bottom part of the page You SHOULD see a confirmation message, confirm it, those students SHOULD NOT be there anymore Reload the page, check that those students do not appear now Check two or three students (remember their names) and click on "Not applicable" on the bottom part of the page You SHOULD see a confirmation message, confirm it, those students SHOULD NOT be there anymore Reload the page, check that those students do not appear now Check two or three students (remember their names) and click on "Send message" on the top part of the page, write a message and press "Send message to N people" You SHOULD see a notification on the top of the page: "Message sent to N people", the students SHOULD NOT be removed from the list of students and their checkboxes SHOULD remain checked Go to site admin > analytics > analytics models and click on Actions > Effectiveness report (or Actions Insights report if MDL-66628 has been integrated) There SHOULD NOT be any executed action with name Not useful
    • Affected Branches:
      MOODLE_35_STABLE, MOODLE_38_STABLE
    • Fixed Branches:
      MOODLE_38_STABLE
    • Pull from Repository:
    • Pull Master Branch:
      MDL-62191_master

      Description

      It is possible for a teacher to receive many notifications of insights at once from learning analytics. The teacher should be able to select some or all of the insights and take action in bulk, e.g. send message, acknowledge, mark as not useful, etc. A confirmation screen is recommended before executing bulk actions.

        Attachments

          Issue Links

            Activity

              People

              • Votes:
                1 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:
                  Fix Release Date:
                  18/Nov/19

                  Time Tracking

                  Estimated:
                  Original Estimate - 0 minutes
                  0m
                  Remaining:
                  Remaining Estimate - 0 minutes
                  0m
                  Logged:
                  Time Spent - 2 weeks, 2 days, 2 hours, 17 minutes
                  2w 2d 2h 17m