Moodle
  1. Moodle
  2. MDL-26912

Create a SCORM Test Harness to automatically run the SCORM ADL tests on the latest Moodle code

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.9.11, 2.0.2
    • Fix Version/s: None
    • Component/s: SCORM
    • Affected Branches:
      MOODLE_19_STABLE, MOODLE_20_STABLE

      Description

      Running the SCORM ADL tests is currently a time consuming task and requires a specific environment to be set up, this project involves setting up a way to automatically run the tests on the latest Moodle code on an MS Windows machine running IE 8 or higher. Ideally this should be able to run on 1.9Stable and 2.0Stable code bases.

      Project Deliverables:

      • Script that automates the 1.2 tests and produces an html file with the results of the tests (pass/fail)
      • Script that automates some of the ADL SCORM 2004 tests on Moodle (it may not be possible to script all of the 2004 ADL tests due to existing failures)
      • Documentation for how to install the scripts on a windows machine and have them run on an automated cycle.
      • Based on the results of the SCORM 2004 test harness the student is expected to address some of the 2004 failures by creating bugs in the Moodle Tracker and submitting a patch to resolve the issues reported.
        More detailed requirements will be provided to the successful student.

      Requirements for applicants wishing to be considered for the project:

      Bonus points for applicants:

      • The test log/screen-shots of running the SCORM 2004 tests (not many will be successful as Moodle is NOT 2004 compliant)

      More information:

        Gliffy Diagrams

          Issue Links

            Activity

            Hide
            Hubert Chathi added a comment -

            I would recommend looking at Selenium and PHPUnit (which includes Selenium integration).

            Show
            Hubert Chathi added a comment - I would recommend looking at Selenium and PHPUnit (which includes Selenium integration).
            Hide
            Dan Marsden added a comment -

            Thanks Hubert - Selenium was my first pick too, I'd deliberately left it open for the application process as afaik Selenium doesn't have an IE plugin that allows easy recording of tests (The SCORM harness only works in IE) - I was interested to see if the student found another product/solution that might be easier to implement - (nothing I've seen that I would select over Selenium yet) - Mayank is going to give an initial go at this using Selenium but I'm flexible about the product if he finds something easier to manipulate for IE.

            Show
            Dan Marsden added a comment - Thanks Hubert - Selenium was my first pick too, I'd deliberately left it open for the application process as afaik Selenium doesn't have an IE plugin that allows easy recording of tests (The SCORM harness only works in IE) - I was interested to see if the student found another product/solution that might be easier to implement - (nothing I've seen that I would select over Selenium yet) - Mayank is going to give an initial go at this using Selenium but I'm flexible about the product if he finds something easier to manipulate for IE.
            Hide
            Mayank Gupta added a comment -

            Hello, I will have a look at PHPUnit.
            For easy recording of tests in IE and an alternate for Selenium IDE (limited to Mozilla Firefox) I found a tool- TestMaker Object Designer.
            The Designer is published under the GPL License and should work well for recording tests, I have not used it though.

            Show
            Mayank Gupta added a comment - Hello, I will have a look at PHPUnit. For easy recording of tests in IE and an alternate for Selenium IDE (limited to Mozilla Firefox) I found a tool- TestMaker Object Designer . The Designer is published under the GPL License and should work well for recording tests, I have not used it though.
            Hide
            Dan Marsden added a comment -

            good spotting! - that looks exactly like what I was hoping someone might find - an easy way of recording Selenium based tests directly in IE - hopefully it will make the recording of the tests a lot easier.

            Show
            Dan Marsden added a comment - good spotting! - that looks exactly like what I was hoping someone might find - an easy way of recording Selenium based tests directly in IE - hopefully it will make the recording of the tests a lot easier.
            Hide
            Dan Marsden added a comment -

            Hi Mayank, just going through your instructions on the wiki - the 1.2 ADL test files you link to aren't quite right - they both have an extra folder that contains the imsmanifest - can you please fix those files up?
            https://github.com/mayankgupta/moodle_scorm_test_harness/blob/master/ADL1.2/LMSTestCourseZipPackages/LMSTestCourse01.zip?raw=true
            https://github.com/mayankgupta/moodle_scorm_test_harness/blob/master/ADL1.2/LMSTestCourseZipPackages/LMSTestCourse02.zip?raw=true

            thanks!

            Show
            Dan Marsden added a comment - Hi Mayank, just going through your instructions on the wiki - the 1.2 ADL test files you link to aren't quite right - they both have an extra folder that contains the imsmanifest - can you please fix those files up? https://github.com/mayankgupta/moodle_scorm_test_harness/blob/master/ADL1.2/LMSTestCourseZipPackages/LMSTestCourse01.zip?raw=true https://github.com/mayankgupta/moodle_scorm_test_harness/blob/master/ADL1.2/LMSTestCourseZipPackages/LMSTestCourse02.zip?raw=true thanks!
            Hide
            Dan Marsden added a comment -

            also - the docs you have written mention junit 4.9b2 - have you tested with 4.9b3 or just 4.9b2?

            and the selenium server in the docs states 2.0.0 - aren't you using 2.3.0?

            thanks!

            Show
            Dan Marsden added a comment - also - the docs you have written mention junit 4.9b2 - have you tested with 4.9b3 or just 4.9b2? and the selenium server in the docs states 2.0.0 - aren't you using 2.3.0? thanks!
            Hide
            Mayank Gupta added a comment -

            Hi Dan, sorry I did not realize there was an extra folder while zipping the contents. Shall fix this immediately.

            I have not tested it with 4.9b3 as of now, but it should work.

            While writing the test scripts I had used Selenium 2.0.0, I will update it to Selenium 2.0.0+.

            Thanks,
            Mayank.

            Show
            Mayank Gupta added a comment - Hi Dan, sorry I did not realize there was an extra folder while zipping the contents. Shall fix this immediately. I have not tested it with 4.9b3 as of now, but it should work. While writing the test scripts I had used Selenium 2.0.0, I will update it to Selenium 2.0.0+. Thanks, Mayank.
            Hide
            Dan Marsden added a comment -

            adding link to MDLSITE bug that relates to setting up test courses on qa.moodle.net so we can regularly run the tests against a "known" updated source!

            Show
            Dan Marsden added a comment - adding link to MDLSITE bug that relates to setting up test courses on qa.moodle.net so we can regularly run the tests against a "known" updated source!

              People

              • Votes:
                1 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: