Moodle

Create a SCORM Test Harness to automatically run the SCORM ADL tests on the latest Moodle code

Details

  • Type: New Feature New Feature
  • Status: Open Open
  • Priority: Major Major
  • Resolution: Unresolved
  • Affects Version/s: 1.9.11, 2.0.2
  • Fix Version/s: DEV backlog
  • Component/s: SCORM
  • Affected Branches:
    MOODLE_19_STABLE, MOODLE_20_STABLE

Description

Running the SCORM ADL tests is currently a time consuming task and requires a specific environment to be set up, this project involves setting up a way to automatically run the tests on the latest Moodle code on an MS Windows machine running IE 8 or higher. Ideally this should be able to run on 1.9Stable and 2.0Stable code bases.

Project Deliverables:

  • Script that automates the 1.2 tests and produces an html file with the results of the tests (pass/fail)
  • Script that automates some of the ADL SCORM 2004 tests on Moodle (it may not be possible to script all of the 2004 ADL tests due to existing failures)
  • Documentation for how to install the scripts on a windows machine and have them run on an automated cycle.
  • Based on the results of the SCORM 2004 test harness the student is expected to address some of the 2004 failures by creating bugs in the Moodle Tracker and submitting a patch to resolve the issues reported.
    More detailed requirements will be provided to the successful student.

Requirements for applicants wishing to be considered for the project:

Bonus points for applicants:

  • The test log/screen-shots of running the SCORM 2004 tests (not many will be successful as Moodle is NOT 2004 compliant)

More information:

Issue Links

This issue is blocked by:
MDLSITE-1595 Add ADL test courses to QA site Minor Resolved
This issue has been marked as being related by:
MDL-28728 allow student to clear SCORM attempt Minor Closed

Activity

Ascending order - Click to sort in descending order
Hide
Permalink
Hubert Chathi added a comment -

I would recommend looking at Selenium and PHPUnit (which includes Selenium integration).

Show
Hubert Chathi added a comment - I would recommend looking at Selenium and PHPUnit (which includes Selenium integration).
Hide
Permalink
Dan Marsden added a comment -

Thanks Hubert - Selenium was my first pick too, I'd deliberately left it open for the application process as afaik Selenium doesn't have an IE plugin that allows easy recording of tests (The SCORM harness only works in IE) - I was interested to see if the student found another product/solution that might be easier to implement - (nothing I've seen that I would select over Selenium yet) - Mayank is going to give an initial go at this using Selenium but I'm flexible about the product if he finds something easier to manipulate for IE.

Show
Dan Marsden added a comment - Thanks Hubert - Selenium was my first pick too, I'd deliberately left it open for the application process as afaik Selenium doesn't have an IE plugin that allows easy recording of tests (The SCORM harness only works in IE) - I was interested to see if the student found another product/solution that might be easier to implement - (nothing I've seen that I would select over Selenium yet) - Mayank is going to give an initial go at this using Selenium but I'm flexible about the product if he finds something easier to manipulate for IE.
Hide
Permalink
Mayank Gupta added a comment -

Hello, I will have a look at PHPUnit.
For easy recording of tests in IE and an alternate for Selenium IDE (limited to Mozilla Firefox) I found a tool- TestMaker Object Designer.
The Designer is published under the GPL License and should work well for recording tests, I have not used it though.

Show
Mayank Gupta added a comment - Hello, I will have a look at PHPUnit. For easy recording of tests in IE and an alternate for Selenium IDE (limited to Mozilla Firefox) I found a tool- TestMaker Object Designer. The Designer is published under the GPL License and should work well for recording tests, I have not used it though.
Hide
Permalink
Dan Marsden added a comment -

good spotting! - that looks exactly like what I was hoping someone might find - an easy way of recording Selenium based tests directly in IE - hopefully it will make the recording of the tests a lot easier.

Show
Dan Marsden added a comment - good spotting! - that looks exactly like what I was hoping someone might find - an easy way of recording Selenium based tests directly in IE - hopefully it will make the recording of the tests a lot easier.
Hide
Permalink
Dan Marsden added a comment -

Hi Mayank, just going through your instructions on the wiki - the 1.2 ADL test files you link to aren't quite right - they both have an extra folder that contains the imsmanifest - can you please fix those files up?
https://github.com/mayankgupta/moodle_scorm_test_harness/blob/master/ADL1.2/LMSTestCourseZipPackages/LMSTestCourse01.zip?raw=true
https://github.com/mayankgupta/moodle_scorm_test_harness/blob/master/ADL1.2/LMSTestCourseZipPackages/LMSTestCourse02.zip?raw=true

thanks!

Show
Dan Marsden added a comment - Hi Mayank, just going through your instructions on the wiki - the 1.2 ADL test files you link to aren't quite right - they both have an extra folder that contains the imsmanifest - can you please fix those files up? https://github.com/mayankgupta/moodle_scorm_test_harness/blob/master/ADL1.2/LMSTestCourseZipPackages/LMSTestCourse01.zip?raw=true https://github.com/mayankgupta/moodle_scorm_test_harness/blob/master/ADL1.2/LMSTestCourseZipPackages/LMSTestCourse02.zip?raw=true thanks!
Hide
Permalink
Dan Marsden added a comment -

also - the docs you have written mention junit 4.9b2 - have you tested with 4.9b3 or just 4.9b2?

and the selenium server in the docs states 2.0.0 - aren't you using 2.3.0?

thanks!

Show
Dan Marsden added a comment - also - the docs you have written mention junit 4.9b2 - have you tested with 4.9b3 or just 4.9b2? and the selenium server in the docs states 2.0.0 - aren't you using 2.3.0? thanks!
Hide
Permalink
Mayank Gupta added a comment -

Hi Dan, sorry I did not realize there was an extra folder while zipping the contents. Shall fix this immediately.

I have not tested it with 4.9b3 as of now, but it should work.

While writing the test scripts I had used Selenium 2.0.0, I will update it to Selenium 2.0.0+.

Thanks,
Mayank.

Show
Mayank Gupta added a comment - Hi Dan, sorry I did not realize there was an extra folder while zipping the contents. Shall fix this immediately. I have not tested it with 4.9b3 as of now, but it should work. While writing the test scripts I had used Selenium 2.0.0, I will update it to Selenium 2.0.0+. Thanks, Mayank.
Hide
Permalink
Dan Marsden added a comment -

adding link to MDLSITE bug that relates to setting up test courses on qa.moodle.net so we can regularly run the tests against a "known" updated source!

Show
Dan Marsden added a comment - adding link to MDLSITE bug that relates to setting up test courses on qa.moodle.net so we can regularly run the tests against a "known" updated source!

People

Vote (1)
Watch (6)

Dates

  • Created:
    Updated:
Atlassian JIRA (v4.4.3#663-r165197) | Report a problem
Powered by a free Atlassian JIRA open source license for Moodle. Try JIRA - bug tracking software for your team.