Specify a time-splitting method when evaluating a model using the web UI

Prerequisites

1. Log in as admin
2. Ensure your timezone is correct.
3. Go to site admin > analytics > analytics settings and disable onlycli
4. Go to site admin > analytics > analytics models
5. Press Create model and select Students at risk of not meeting the course completion conditions, Read actions amount and Any write action as indicators and Quarters as time-splitting method. Save changes.
6. Set up a course so that:
   • It has a couple of students minimum. No enrolment time start nor time end.
   • The admin user is enrolled as a manager in the course
   • The course start date is a past date and it is prior to the student enrolments timecreated.
   • The course end date is a past date (it can be 1 minute ago if necessary) and it is after the student enrolments timecreated
   • There is less than 1 year of difference between the course start and the course end
   • Course completion is enabled with "Manual completion by others" (manager role) as criterion
   • Add the completion status block (Editing mode on > Add block > Course completion status)
   • Access the course completion block (report/completion/index.php?course=COURSEID) and approve one user (a blue tick mark should appear in one of the boxes)
   • Go to a CLI and execute

     php admin/cli/cron.php

     
     so that the completion status at course level is updated and the user flagged as completed (the 2nd blue tick should appear in the course completion block now)

Test 1

1. Click on Evaluate for Students at risk of not meeting the course completion conditions model
2. You SHOULD see a modal window where you can select a time-splitting method. The options should include a Current time-splitting method option and a All time-splitting methods option, as well as other time-spliting methods.
   • Upcoming week SHOULD NOT be one of the options
3. Select current time-splitting method and press Evaluate. You SHOULD see the results page and you SHOULD only see Results using Quarters time-splitting method. Click on continue.
4. Click on Evaluate for Students at risk of not meeting the course completion conditions model
5. Now select All time-splitting methods and press Evaluate
6. You SHOULD see many Results using... headings
7. Click on Evaluate for Students at risk of not meeting the course completion conditions model
8. Now select a time-splitting method and press Evaluate
9. You SHOULD see a heading with Results using $timesplitting, where $timesplitting is the time-splitting method you selected
10. Return to the models list page and click on Edit for Students at risk of not meeting the course completion conditions model
11. Remove the time-splitting method selection and leave the field empty. Save changes.
12. Click on Evaluate for Students at risk of not meeting the course completion conditions model and expand the selector
13. You SHOULD NOT see a Current time-splitting method option

Test 2

1. Click on Edit for Students at risk of not meeting the course completion conditions model
2. Tick Enabled and select Quarters time-splitting method
3. Click on Get predictions for Students at risk of not meeting the course completion conditions model
4. Export Students at risk of not meeting the course completion conditions configuration (Export > Export configuration or 'Export configuration' directly. It depends on MDL-64779 being integrated before this issue. Include the weights if you have the option. They are included by default if you don't have the option)
5. Delete your Students at risk of not meeting the course completion conditions model (Actions > Delete)
6. Import the zip file you just downloaded
7. Click on Evaluate for the new Students at risk of not meeting the course completion conditions model
8. You SHOULD have two options and Evaluate the trained model should be selected by default. You SHOULD NOT see any drop down menu
9. Press Evaluate the model configuration
10. You SHOULD now see the time-splitting method selector
11. Select back Evaluate the trained model and press Evaluate
12. You SHOULD see a Results using Quarters time-splitting method heading