Non-core contributed modules

Review UQAM updates to webctimport tool

Details

  • Type: New Feature New Feature
  • Status: Resolved Resolved
  • Priority: Minor Minor
  • Resolution: Fixed
  • Affects Version/s: 1.8, 1.9
  • Fix Version/s: 1.8, 1.9
  • Component/s: Tool: WebCTImport
  • Labels:
    None
  • Affected Branches:
    MOODLE_18_STABLE, MOODLE_19_STABLE
  • Fixed Branches:
    MOODLE_18_STABLE, MOODLE_19_STABLE

Description

I have attached the UQAM version of the webctimport tool which includes a number of enhancements to the original version currently in CVS.

I believe Jerome has some additional patches to add to this code.

As per the UQAM website, the description of some of the major improvements are:

1. Use Sablotron to get UTF-8 XML.(WebCT doestn't handle utf8 properly so it's better to use ISO8859-1 first and translate afterwards)
2. Remove unuseful strong element in section titles.
3. Remove bug due to simple quote in calendar event titles.
4. Mapping between WebCT general feedback and Moodle general feedfack (questions).
5. Add better fit between WebCT and Moodle test parameters ;
6. Some more improvements for calculted questions.
7. Assignment submissions parameters.
8. Default chat description.

Lets review this code and commit it into CVS when it is ready, then we can work towards an updated release of the tool.

Attachments

  1. Text File
    diff-questioncategories.txt
    20/May/08 11:34 PM
    3 kB
    Jerome Charaoui
  2. HTML File
    TestMigrationCourse_ImportLog.htm
    01/Jul/08 2:01 PM
    1.77 MB
    Sonya Brown
  3. Zip Archive
    TestMigrationCourse_WebCT_Backup.zip
    01/Jul/08 1:59 PM
    691 kB
    Sonya Brown

Issue Links

This issue blocks:
CONTRIB-363 Make webctimport module compatible with Moodle 1.9 Minor Resolved

Activity

Ascending order - Click to sort in descending order
Hide
Permalink
Jerome Charaoui added a comment -

I'm attaching a patch that properly creates question categories. Without it questions are added but aren't visible in the course. It's been tested for about 40 courses and seems to work without problems.

Show
Jerome Charaoui added a comment - I'm attaching a patch that properly creates question categories. Without it questions are added but aren't visible in the course. It's been tested for about 40 courses and seems to work without problems.
Hide
Permalink
Jerome Charaoui added a comment -

Linking to the original issue posted in the tracker.

Show
Jerome Charaoui added a comment - Linking to the original issue posted in the tracker.
Hide
Permalink
Ashley Holman added a comment -

A few issues I have found when testing this:

  • in parse-webct-xml.php, function save_files, call to undefined function "mk_dir". Tried changing to mkdir but am getting many warnings eg.

Warning: mkdir() [function.mkdir]: No such file or directory in /var/www/html/moodle19/moodle/webctimport/parse-webct-xml.php on line 188
Warning: copy(/var/www/html/moodle19/moodledata/27//evaluations/UCDS_quiz_Nov_13.txt) [function.copy]: failed to open stream: No such file or directory in /var/www/html/moodle19/moodle/webctimport/parse-webct-xml.php on line 192
Warning: mkdir() [function.mkdir]: No such file or directory in /var/www/html/moodle19/moodle/webctimport/parse-webct-xml.php on line 188

  • Attempted to delete a course from Moodle after creating it with the import tool. Deleting the course fails when attempting to remove questions, with "This question does not exist", leaving a corrupted course remaining which cannot be removed.
  • Lots of code commented in French and part of the user interface in French. Would someone be able to provide a translation into English and perhaps we should be using language files to support different languages?
  • several instances of php short tags, ie. <? needs to be <?php
Show
Ashley Holman added a comment - A few issues I have found when testing this:
  • in parse-webct-xml.php, function save_files, call to undefined function "mk_dir". Tried changing to mkdir but am getting many warnings eg.
Warning: mkdir() [function.mkdir]: No such file or directory in /var/www/html/moodle19/moodle/webctimport/parse-webct-xml.php on line 188 Warning: copy(/var/www/html/moodle19/moodledata/27//evaluations/UCDS_quiz_Nov_13.txt) [function.copy]: failed to open stream: No such file or directory in /var/www/html/moodle19/moodle/webctimport/parse-webct-xml.php on line 192 Warning: mkdir() [function.mkdir]: No such file or directory in /var/www/html/moodle19/moodle/webctimport/parse-webct-xml.php on line 188
  • Attempted to delete a course from Moodle after creating it with the import tool. Deleting the course fails when attempting to remove questions, with "This question does not exist", leaving a corrupted course remaining which cannot be removed.
  • Lots of code commented in French and part of the user interface in French. Would someone be able to provide a translation into English and perhaps we should be using language files to support different languages?
  • several instances of php short tags, ie. <? needs to be <?php
Hide
Permalink
Jerome Charaoui added a comment -

In our version of parse-webct-xml.php, we removed the functions list_files and saveFiles. Instead we copy the whole directory tree of course files from WebCT to Moodle. However this requires a specific WebCT folder to be available on the Moodle system (the path of which is hardcoded in our installation), so I don't think it's a great solution for every situation. In this case we should simply improve the copying of files and folders available in the WebCT course export. One of the issue we have to deal with though is how to recognize folders from simple files.

The second problem is probably linked to the following issue : MDL-14376 (Error deleting course containing a Cloze-type question). It's not a webctimport problem specifically.

In terms of translation I can help translation from Fr to En, but we should also evaluate which comments are relevant and which are not.

Show
Jerome Charaoui added a comment - In our version of parse-webct-xml.php, we removed the functions list_files and saveFiles. Instead we copy the whole directory tree of course files from WebCT to Moodle. However this requires a specific WebCT folder to be available on the Moodle system (the path of which is hardcoded in our installation), so I don't think it's a great solution for every situation. In this case we should simply improve the copying of files and folders available in the WebCT course export. One of the issue we have to deal with though is how to recognize folders from simple files. The second problem is probably linked to the following issue : MDL-14376 (Error deleting course containing a Cloze-type question). It's not a webctimport problem specifically. In terms of translation I can help translation from Fr to En, but we should also evaluate which comments are relevant and which are not.
Hide
Permalink
Pierre Pichet added a comment -

"One of the issue we have to deal with though is how to recognize folders from simple files. "
use is_dir ? Tells whether the filename is a directory

"Use Sablotron to get UTF-8 XML."
What I have found is that the webct files are not utf8 coded but WINDOWS-1252 that use some of the upper (128+) first bits to encode some characters. As all the internal moodle code use ordinary ascii the parameter values obtained from the database are in ascii nd not utf8 (i.e. they don't use 2BYTES encoding.
For example qtype 'calculated'. This why the code is written in ascii files and you can use i.e. if ($q->qtype == 'calculated') ...
I did not have problem when just converting XML parameters that could contain text.
So I am not sure that global converting is the good way to do it unless you have test it with complex language text in another language than english.

"Some more improvements for calculted questions."
The only changes in calculated questions are related to the new question parameters in 1.9 like general feedback because the internal moodle calculated parameters have not changed. I will look more closely about that.

Is anybody can get some complex course files that could be used for testing with the teacher agreement to do so?

Show
Pierre Pichet added a comment - "One of the issue we have to deal with though is how to recognize folders from simple files. " use is_dir ? Tells whether the filename is a directory "Use Sablotron to get UTF-8 XML." What I have found is that the webct files are not utf8 coded but WINDOWS-1252 that use some of the upper (128+) first bits to encode some characters. As all the internal moodle code use ordinary ascii the parameter values obtained from the database are in ascii nd not utf8 (i.e. they don't use 2BYTES encoding. For example qtype 'calculated'. This why the code is written in ascii files and you can use i.e. if ($q->qtype == 'calculated') ... I did not have problem when just converting XML parameters that could contain text. So I am not sure that global converting is the good way to do it unless you have test it with complex language text in another language than english. "Some more improvements for calculted questions." The only changes in calculated questions are related to the new question parameters in 1.9 like general feedback because the internal moodle calculated parameters have not changed. I will look more closely about that. Is anybody can get some complex course files that could be used for testing with the teacher agreement to do so?
Hide
Permalink
Jerome Charaoui added a comment -

I have access to some complex WebCT courses that will need to be transferred. I will try to have the teacher's approval to use them as testing material.

Show
Jerome Charaoui added a comment - I have access to some complex WebCT courses that will need to be transferred. I will try to have the teacher's approval to use them as testing material.
Hide
Permalink
Pierre Pichet added a comment -

We are modifying the tool for Moodle 1.8 ,19 , but for which WebCT version 4 or 6 ?

Show
Pierre Pichet added a comment - We are modifying the tool for Moodle 1.8 ,19 , but for which WebCT version 4 or 6 ?
Hide
Permalink
Pierre Pichet added a comment -

I have some courses for WebCT 4.0 that were used at UQAM, could thay be usefull

Show
Pierre Pichet added a comment - I have some courses for WebCT 4.0 that were used at UQAM, could thay be usefull
Hide
Permalink
Jerome Charaoui added a comment -

Here we used WebCT 4.1 CE. I think we should concentrate on WebCT4.x, though I don't know if there are any major differences in the IMS export format between 4.0 and 4.1 CE.

Show
Jerome Charaoui added a comment - Here we used WebCT 4.1 CE. I think we should concentrate on WebCT4.x, though I don't know if there are any major differences in the IMS export format between 4.0 and 4.1 CE.
Hide
Permalink
Pierre Pichet added a comment -

So my courses could be used to test .
I will test using a version that used UQAM process of files without any previous conversion.
Most of the questions problems are related with the added fields like feedback from 1.6 to 1.9.
We should used the default question of the import process which will give us the good default values allowing for the changes between 1.6 , 1.7 1.8 and 1.9.

Show
Pierre Pichet added a comment - So my courses could be used to test . I will test using a version that used UQAM process of files without any previous conversion. Most of the questions problems are related with the added fields like feedback from 1.6 to 1.9. We should used the default question of the import process which will give us the good default values allowing for the changes between 1.6 , 1.7 1.8 and 1.9.
Hide
Permalink
Sonya Brown added a comment -

Hi all,

I've created a comprehensive WebCT 4.1 test course containing all of the WebCT tools/features possible. I've attached the WebCT course backup file and the exported zip file for import into Moodle. I'm happy to share this, so perhaps it could be used as a benchmark for testing the import tool. There were several errors/issues with the imported Moodle course which I've outlined below (I will do a full analysis later). I've also attached a log from the webctimport tool including PHP warnings/errors (debugging turned on).

Note: Password for quiz is "password"

  • Syllabus was not migrated (error during creation of resource)
  • Database - Only "Test images" database was imported. Database titled "Another Database" is missing
  • Topics and activities not ordered as in WebCT
  • Text block attributes (ie, colour etc) not as in WebCT
  • Student Presentation has not been migrated
  • Glossary and Student Tips are added to the first topic in the Moodle course, rather than their respective 'Organizer Page' topics as set out in the WebCT course
  • Question bank does not contain the migrated questions
  • Question sets are not added to quizzes as in WebCT
  • Calculated and Short Answer questions producing an error, which results in quizzes containing these questions not loading
  • Multi Choice questions with no answer, produce an error
  • Self Test produces errors and fails to load
  • Lower text block in Organizer Page is created above activities/resources rather than below as in WebCT
  • Content Module, Quizzes/Surveys tool, Assignment tool - Upper and Lower text blocks are not migrated
  • Quizzes/Surveys tool, link to the first "Quiz" in the topic gets created as a label, rather than a link to the actual Quiz. Note: "Quiz" is already linked from "Organizer Page 2"
  • All gradable activities are not added to the gradebook, therefore gradebook does not contain any columns

Things to consider:

  • Assignments are created as "Upload a single file". More flexibility is provided by "Advanced uploading of files". Could they be created using "Advanced uploading of files" instead?
  • Files attached to assignments, are not migrated. Could these files be added to site files, and linked via HTML in description?
  • As of 1.9 moodle has custom grade items, could custom WebCT columns be migrated?
Show
Sonya Brown added a comment - Hi all, I've created a comprehensive WebCT 4.1 test course containing all of the WebCT tools/features possible. I've attached the WebCT course backup file and the exported zip file for import into Moodle. I'm happy to share this, so perhaps it could be used as a benchmark for testing the import tool. There were several errors/issues with the imported Moodle course which I've outlined below (I will do a full analysis later). I've also attached a log from the webctimport tool including PHP warnings/errors (debugging turned on). Note: Password for quiz is "password"
  • Syllabus was not migrated (error during creation of resource)
  • Database - Only "Test images" database was imported. Database titled "Another Database" is missing
  • Topics and activities not ordered as in WebCT
  • Text block attributes (ie, colour etc) not as in WebCT
  • Student Presentation has not been migrated
  • Glossary and Student Tips are added to the first topic in the Moodle course, rather than their respective 'Organizer Page' topics as set out in the WebCT course
  • Question bank does not contain the migrated questions
  • Question sets are not added to quizzes as in WebCT
  • Calculated and Short Answer questions producing an error, which results in quizzes containing these questions not loading
  • Multi Choice questions with no answer, produce an error
  • Self Test produces errors and fails to load
  • Lower text block in Organizer Page is created above activities/resources rather than below as in WebCT
  • Content Module, Quizzes/Surveys tool, Assignment tool - Upper and Lower text blocks are not migrated
  • Quizzes/Surveys tool, link to the first "Quiz" in the topic gets created as a label, rather than a link to the actual Quiz. Note: "Quiz" is already linked from "Organizer Page 2"
  • All gradable activities are not added to the gradebook, therefore gradebook does not contain any columns
Things to consider:
  • Assignments are created as "Upload a single file". More flexibility is provided by "Advanced uploading of files". Could they be created using "Advanced uploading of files" instead?
  • Files attached to assignments, are not migrated. Could these files be added to site files, and linked via HTML in description?
  • As of 1.9 moodle has custom grade items, could custom WebCT columns be migrated?
Hide
Permalink
Sonya Brown added a comment -

WebCT 4.1 course export for testing

Show
Sonya Brown added a comment - WebCT 4.1 course export for testing
Hide
Permalink
Sonya Brown added a comment -

WebCT 4.1 course backup for testing

Show
Sonya Brown added a comment - WebCT 4.1 course backup for testing
Hide
Permalink
Sonya Brown added a comment -

Import log of TestMigrationCourse_WebCT_Export.zip

Show
Sonya Brown added a comment - Import log of TestMigrationCourse_WebCT_Export.zip
Hide
Permalink
Ashley Holman added a comment -

Sonya is a colleague of mine here at NetSpot and I've been working with her on importing the test course that she posted. The import was done into Moodle 1.9.1 using the UQAM version of the tool + the patch posted by Jerome (diff-questioncategories.txt).

Jerome/Pierre - I would be interested to hear your comments on some of the problems we came across, in particular the errors that are stopping quizzes from working, and also the lack of any categories in the question bank. There also seems to be some issues with how the organiser pages and content modules are getting layed out as Moodle topics, but at least these can be fixed by teachers through the standard editing functions.

You should be able to use the TestMigrationCourse_WebCT_Backup.zip to restore the course into WebCT, and the TestMigrationCourse_WebCT_Export.zip can be used by the import tool.

There is also one other issue we have found: the image database is missing an image (only one of two images gets imported) and there is also a 2nd database in the WebCT course which is not imported at all.

Let me know if you guys are happy to use this course as a benchmark for testing the tool. Feel free to make changes/additions to the course and post another backup file.

Cheers
Ashley

Show
Ashley Holman added a comment - Sonya is a colleague of mine here at NetSpot and I've been working with her on importing the test course that she posted. The import was done into Moodle 1.9.1 using the UQAM version of the tool + the patch posted by Jerome (diff-questioncategories.txt). Jerome/Pierre - I would be interested to hear your comments on some of the problems we came across, in particular the errors that are stopping quizzes from working, and also the lack of any categories in the question bank. There also seems to be some issues with how the organiser pages and content modules are getting layed out as Moodle topics, but at least these can be fixed by teachers through the standard editing functions. You should be able to use the TestMigrationCourse_WebCT_Backup.zip to restore the course into WebCT, and the TestMigrationCourse_WebCT_Export.zip can be used by the import tool. There is also one other issue we have found: the image database is missing an image (only one of two images gets imported) and there is also a 2nd database in the WebCT course which is not imported at all. Let me know if you guys are happy to use this course as a benchmark for testing the tool. Feel free to make changes/additions to the course and post another backup file. Cheers Ashley
Hide
Permalink
Ashley Holman added a comment -

The UQAM contributions are now in CVS - resolving this issue.

Show
Ashley Holman added a comment - The UQAM contributions are now in CVS - resolving this issue.

People

Vote (1)
Watch (7)

Dates

  • Created:
    Updated:
    Resolved:
Atlassian JIRA (v4.4.3#663-r165197) | Report a problem
Powered by a free Atlassian JIRA open source license for Moodle. Try JIRA - bug tracking software for your team.