Uploaded image for project: 'Moodle'
  1. Moodle
  2. MDL-65175

Specify a time-splitting method when evaluating a model using the web UI

    XMLWordPrintable

    Details

    • Testing Instructions:
      Hide

      Prerequisites

      1. Log in as admin
      2. Ensure your timezone is correct.
      3. Go to site admin > analytics > analytics settings and disable onlycli
      4. Go to site admin > analytics > analytics models
      5. Press Create model and select Students at risk of not meeting the course completion conditions, Read actions amount and Any write action as indicators and Quarters as time-splitting method. Save changes.
      6. Set up a course so that:
        • It has a couple of students minimum. No enrolment time start nor time end.
        • The admin user is enrolled as a manager in the course
        • The course start date is a past date and it is prior to the student enrolments timecreated.
        • The course end date is a past date (it can be 1 minute ago if necessary) and it is after the student enrolments timecreated
        • There is less than 1 year of difference between the course start and the course end
        • Course completion is enabled with "Manual completion by others" (manager role) as criterion
        • Add the completion status block (Editing mode on > Add block > Course completion status)
        • Access the course completion block (report/completion/index.php?course=COURSEID) and approve one user (a blue tick mark should appear in one of the boxes)
        • Go to a CLI and execute

          php admin/cli/cron.php


          so that the completion status at course level is updated and the user flagged as completed (the 2nd blue tick should appear in the course completion block now)

      Test 1

      1. Click on Evaluate for Students at risk of not meeting the course completion conditions model
      2. You SHOULD see a modal window where you can select a time-splitting method. The options should include a Current time-splitting method option and a All time-splitting methods option, as well as other time-spliting methods.
        • Upcoming week SHOULD NOT be one of the options
      3. Select current time-splitting method and press Evaluate. You SHOULD see the results page and you SHOULD only see Results using Quarters time-splitting method. Click on continue.
      4. Click on Evaluate for Students at risk of not meeting the course completion conditions model
      5. Now select All time-splitting methods and press Evaluate
      6. You SHOULD see many Results using... headings
      7. Click on Evaluate for Students at risk of not meeting the course completion conditions model
      8. Now select a time-splitting method and press Evaluate
      9. You SHOULD see a heading with Results using $timesplitting, where $timesplitting is the time-splitting method you selected
      10. Return to the models list page and click on Edit for Students at risk of not meeting the course completion conditions model
      11. Remove the time-splitting method selection and leave the field empty. Save changes.
      12. Click on Evaluate for Students at risk of not meeting the course completion conditions model and expand the selector
      13. You SHOULD NOT see a Current time-splitting method option

      Test 2

      1. Click on Edit for Students at risk of not meeting the course completion conditions model
      2. Tick Enabled and select Quarters time-splitting method
      3. Click on Get predictions for Students at risk of not meeting the course completion conditions model
      4. Export Students at risk of not meeting the course completion conditions configuration (Export > Export configuration or 'Export configuration' directly. It depends on MDL-64779 being integrated before this issue. Include the weights if you have the option. They are included by default if you don't have the option)
      5. Delete your Students at risk of not meeting the course completion conditions model (Actions > Delete)
      6. Import the zip file you just downloaded
      7. Click on Evaluate for the new Students at risk of not meeting the course completion conditions model
      8. You SHOULD have two options and Evaluate the trained model should be selected by default. You SHOULD NOT see any drop down menu
      9. Press Evaluate the model configuration
      10. You SHOULD now see the time-splitting method selector
      11. Select back Evaluate the trained model and press Evaluate
      12. You SHOULD see a Results using Quarters time-splitting method heading
      Show
      Prerequisites Log in as admin Ensure your timezone is correct. Go to site admin > analytics > analytics settings and disable onlycli Go to site admin > analytics > analytics models Press Create model and select Students at risk of not meeting the course completion conditions , Read actions amount and Any write action as indicators and Quarters as time-splitting method. Save changes. Set up a course so that: It has a couple of students minimum. No enrolment time start nor time end. The admin user is enrolled as a manager in the course The course start date is a past date and it is prior to the student enrolments timecreated. The course end date is a past date (it can be 1 minute ago if necessary) and it is after the student enrolments timecreated There is less than 1 year of difference between the course start and the course end Course completion is enabled with "Manual completion by others" (manager role) as criterion Add the completion status block (Editing mode on > Add block > Course completion status) Access the course completion block (report/completion/index.php?course=COURSEID) and approve one user (a blue tick mark should appear in one of the boxes) Go to a CLI and execute php admin/cli/cron.php so that the completion status at course level is updated and the user flagged as completed (the 2nd blue tick should appear in the course completion block now) Test 1 Click on Evaluate for Students at risk of not meeting the course completion conditions model You SHOULD see a modal window where you can select a time-splitting method. The options should include a Current time-splitting method option and a All time-splitting methods option, as well as other time-spliting methods. Upcoming week SHOULD NOT be one of the options Select current time-splitting method and press Evaluate . You SHOULD see the results page and you SHOULD only see Results using Quarters time-splitting method . Click on continue. Click on Evaluate for Students at risk of not meeting the course completion conditions model Now select All time-splitting methods and press Evaluate You SHOULD see many Results using... headings Click on Evaluate for Students at risk of not meeting the course completion conditions model Now select a time-splitting method and press Evaluate You SHOULD see a heading with Results using $timesplitting , where $timesplitting is the time-splitting method you selected Return to the models list page and click on Edit for Students at risk of not meeting the course completion conditions model Remove the time-splitting method selection and leave the field empty. Save changes. Click on Evaluate for Students at risk of not meeting the course completion conditions model and expand the selector You SHOULD NOT see a Current time-splitting method option Test 2 Click on Edit for Students at risk of not meeting the course completion conditions model Tick Enabled and select Quarters time-splitting method Click on Get predictions for Students at risk of not meeting the course completion conditions model Export Students at risk of not meeting the course completion conditions configuration (Export > Export configuration or 'Export configuration' directly. It depends on MDL-64779 being integrated before this issue. Include the weights if you have the option. They are included by default if you don't have the option) Delete your Students at risk of not meeting the course completion conditions model (Actions > Delete) Import the zip file you just downloaded Click on Evaluate for the new Students at risk of not meeting the course completion conditions model You SHOULD have two options and Evaluate the trained model should be selected by default. You SHOULD NOT see any drop down menu Press Evaluate the model configuration You SHOULD now see the time-splitting method selector Select back Evaluate the trained model and press Evaluate You SHOULD see a Results using Quarters time-splitting method heading
    • Affected Branches:
      MOODLE_37_STABLE
    • Fixed Branches:
      MOODLE_37_STABLE
    • Pull from Repository:
    • Pull Master Branch:
      MDL-65175_master

      Description

      We have a growing number of time-splitting methods and not all of them are suitable for all models. At the moment the 'Evaluation' option in the web interface evaluates a model using all the default time-splitting methods for model's evaluation (there is a site setting for it).

      The CLI interface for model's evaluation include an option to specify a time-splitting method, but this option is not available in the web interface. This issue is about adding this option.

        Attachments

        1. image-2019-04-11-16-12-00-578.png
          image-2019-04-11-16-12-00-578.png
          225 kB
        2. Screenshot_1.png
          Screenshot_1.png
          158 kB
        3. Screenshot_2.png
          Screenshot_2.png
          107 kB
        4. screenshot-1.png
          screenshot-1.png
          310 kB

          Issue Links

            Activity

              People

              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:
                  Fix Release Date:
                  20/May/19

                  Time Tracking

                  Estimated:
                  Original Estimate - 0 minutes
                  0m
                  Remaining:
                  Remaining Estimate - 0 minutes
                  0m
                  Logged:
                  Time Spent - 1 day, 51 minutes
                  1d 51m