Uploaded image for project: 'Moodle QA'
  1. Moodle QA
  2. MDLQA-12911 Moodle 3.7 QA
  3. MDLQA-13456

CLONE - Admins can change analytics settings and setup different machine learning backends

    XMLWordPrintable

    Details

      Description

      We are interested in hearing your feedback and suggestions for improvement. Feel free to post your thoughts in https://moodle.org/course/view.php?id=17233

      Testing environment:

      1. This test requires a system with Python installed and the option to run phpunit tests.

      Other info:

      1. Uninstall moodlemlbackend python package if you have it installed

      Test:

      1. Log in as an admin
      2. Go to 'Site administration > Server > System paths' and ensure 'pathtopython' is not set
      3. Go to 'Analytics settings' in the Site administration and enable 'Analytics processes execution via command line only'.
      4. Log in as a manager and go to 'Analytics models' in the Site administration.
      5. Verify that a message is displayed stating that Models evaluations via the web interface is disabled.
      6. Verify that 'Get predictions' and 'Evaluate' are not available for any model in the 'Actions' menu.
      7. Log in as admin again and go to 'Analytics settings' and disable 'Analytics processes execution via command line only'.
      8. Set 'Time splitting methods' to Tenths and 'Tenths accumulative'.
      9. Log in as a manager again and go to 'Analytics models'.
      10. Verify that a message is displayed stating that evaluating models and generating predictions may involve heavy processing and it is recommended to run these actions via command line interface.
      11. Verify that 'Get predictions' is available in "No teaching" model action menu and 'Evaluate' is available in the 'Students at risk of dropping out' Actions menu.
      12. For 'Students at risk of dropping out' select 'Edit' in the 'Actions' column.
      13. Verify that the available options for 'Time-splitting method' are Tenths and 'Tenths accumulative'.
      14. Log in as admin again and go to 'Analytics settings' and reset 'Time splitting methods' to its default value: Quarters, 'Quarters accumulative' and 'Single range' and save.
      15. Set the predictions processor to 'Python machine learning backend' and save again.
      16. Verify that an error message is displayed saying that Python binary path is not defined.
      17. Go to 'System paths' and set pathtopython to your path. (You can just set it to 'python' if the binary directory is in your $PATH.)
      18. Return to 'Analytics settings' and verify that 'PHP machine learning backend' is still be the selected option. (The system shouldn't allow you to change it until all Python's ml backend requirements are satisfied).
      19. Change it again to 'Python machine learning backend'.
      20. Verify that a message saying that moodlemlbackend python package is not installed is displayed.
      21. Install moodlemlbackend python package (pip install moodlemlbackend; for more info, see the section 'Predictions processor' in the Analytics models documentation).
      22. Return to 'Analytics settings', save changes again and verify that the changes are saved correctly.
      23. Run all phpunit tests for analytics:

        vendor/bin/phpunit --testsuite core_analytics_testsuite


        Note that you will need to set $CFG->pathtopython in your config.php.

      24. Verify all tests for analytics pass and none are skipped.

        Attachments

          Activity

            People

            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: