Moodle
  1. Moodle
  2. MDL-26912

Create a SCORM Test Harness to automatically run the SCORM ADL tests on the latest Moodle code

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.9.11, 2.0.2
    • Fix Version/s: None
    • Component/s: SCORM
    • Affected Branches:
      MOODLE_19_STABLE, MOODLE_20_STABLE
    • Rank:
      16539

      Description

      Running the SCORM ADL tests is currently a time consuming task and requires a specific environment to be set up, this project involves setting up a way to automatically run the tests on the latest Moodle code on an MS Windows machine running IE 8 or higher. Ideally this should be able to run on 1.9Stable and 2.0Stable code bases.

      Project Deliverables:

      • Script that automates the 1.2 tests and produces an html file with the results of the tests (pass/fail)
      • Script that automates some of the ADL SCORM 2004 tests on Moodle (it may not be possible to script all of the 2004 ADL tests due to existing failures)
      • Documentation for how to install the scripts on a windows machine and have them run on an automated cycle.
      • Based on the results of the SCORM 2004 test harness the student is expected to address some of the 2004 failures by creating bugs in the Moodle Tracker and submitting a patch to resolve the issues reported.
        More detailed requirements will be provided to the successful student.

      Requirements for applicants wishing to be considered for the project:

      Bonus points for applicants:

      • The test log/screen-shots of running the SCORM 2004 tests (not many will be successful as Moodle is NOT 2004 compliant)

      More information:

        Issue Links

          Activity

          Hide
          Hubert Chathi added a comment -

          I would recommend looking at Selenium and PHPUnit (which includes Selenium integration).

          Show
          Hubert Chathi added a comment - I would recommend looking at Selenium and PHPUnit (which includes Selenium integration).
          Hide
          Dan Marsden added a comment -

          Thanks Hubert - Selenium was my first pick too, I'd deliberately left it open for the application process as afaik Selenium doesn't have an IE plugin that allows easy recording of tests (The SCORM harness only works in IE) - I was interested to see if the student found another product/solution that might be easier to implement - (nothing I've seen that I would select over Selenium yet) - Mayank is going to give an initial go at this using Selenium but I'm flexible about the product if he finds something easier to manipulate for IE.

          Show
          Dan Marsden added a comment - Thanks Hubert - Selenium was my first pick too, I'd deliberately left it open for the application process as afaik Selenium doesn't have an IE plugin that allows easy recording of tests (The SCORM harness only works in IE) - I was interested to see if the student found another product/solution that might be easier to implement - (nothing I've seen that I would select over Selenium yet) - Mayank is going to give an initial go at this using Selenium but I'm flexible about the product if he finds something easier to manipulate for IE.
          Hide
          Mayank Gupta added a comment -

          Hello, I will have a look at PHPUnit.
          For easy recording of tests in IE and an alternate for Selenium IDE (limited to Mozilla Firefox) I found a tool- TestMaker Object Designer.
          The Designer is published under the GPL License and should work well for recording tests, I have not used it though.

          Show
          Mayank Gupta added a comment - Hello, I will have a look at PHPUnit. For easy recording of tests in IE and an alternate for Selenium IDE (limited to Mozilla Firefox) I found a tool- TestMaker Object Designer . The Designer is published under the GPL License and should work well for recording tests, I have not used it though.
          Hide
          Dan Marsden added a comment -

          good spotting! - that looks exactly like what I was hoping someone might find - an easy way of recording Selenium based tests directly in IE - hopefully it will make the recording of the tests a lot easier.

          Show
          Dan Marsden added a comment - good spotting! - that looks exactly like what I was hoping someone might find - an easy way of recording Selenium based tests directly in IE - hopefully it will make the recording of the tests a lot easier.
          Hide
          Dan Marsden added a comment -

          Hi Mayank, just going through your instructions on the wiki - the 1.2 ADL test files you link to aren't quite right - they both have an extra folder that contains the imsmanifest - can you please fix those files up?
          https://github.com/mayankgupta/moodle_scorm_test_harness/blob/master/ADL1.2/LMSTestCourseZipPackages/LMSTestCourse01.zip?raw=true
          https://github.com/mayankgupta/moodle_scorm_test_harness/blob/master/ADL1.2/LMSTestCourseZipPackages/LMSTestCourse02.zip?raw=true

          thanks!

          Show
          Dan Marsden added a comment - Hi Mayank, just going through your instructions on the wiki - the 1.2 ADL test files you link to aren't quite right - they both have an extra folder that contains the imsmanifest - can you please fix those files up? https://github.com/mayankgupta/moodle_scorm_test_harness/blob/master/ADL1.2/LMSTestCourseZipPackages/LMSTestCourse01.zip?raw=true https://github.com/mayankgupta/moodle_scorm_test_harness/blob/master/ADL1.2/LMSTestCourseZipPackages/LMSTestCourse02.zip?raw=true thanks!
          Hide
          Dan Marsden added a comment -

          also - the docs you have written mention junit 4.9b2 - have you tested with 4.9b3 or just 4.9b2?

          and the selenium server in the docs states 2.0.0 - aren't you using 2.3.0?

          thanks!

          Show
          Dan Marsden added a comment - also - the docs you have written mention junit 4.9b2 - have you tested with 4.9b3 or just 4.9b2? and the selenium server in the docs states 2.0.0 - aren't you using 2.3.0? thanks!
          Hide
          Mayank Gupta added a comment -

          Hi Dan, sorry I did not realize there was an extra folder while zipping the contents. Shall fix this immediately.

          I have not tested it with 4.9b3 as of now, but it should work.

          While writing the test scripts I had used Selenium 2.0.0, I will update it to Selenium 2.0.0+.

          Thanks,
          Mayank.

          Show
          Mayank Gupta added a comment - Hi Dan, sorry I did not realize there was an extra folder while zipping the contents. Shall fix this immediately. I have not tested it with 4.9b3 as of now, but it should work. While writing the test scripts I had used Selenium 2.0.0, I will update it to Selenium 2.0.0+. Thanks, Mayank.
          Hide
          Dan Marsden added a comment -

          adding link to MDLSITE bug that relates to setting up test courses on qa.moodle.net so we can regularly run the tests against a "known" updated source!

          Show
          Dan Marsden added a comment - adding link to MDLSITE bug that relates to setting up test courses on qa.moodle.net so we can regularly run the tests against a "known" updated source!

            People

            • Votes:
              1 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: