Uploaded image for project: 'Moodle'
  1. Moodle
  2. MDL-38189 META Backup/restore issues with large courses
  3. MDL-41722

Backup: Very large course times out on user interface pages

XMLWordPrintable

    • Icon: Sub-task Sub-task
    • Resolution: Fixed
    • Icon: Major Major
    • 2.6
    • 2.6
    • Backup
    • MOODLE_26_STABLE
    • MOODLE_26_STABLE
    • MDL-41722-master
    • Hide

      Note: This test script uses the 'L' course, which already worked, because (even after these fixes) it still isn't 100% possible to back up the XL course due to the zip file issue. Also it would take like two hours. So the test script is basically checking that backup still works OK for a more normal-sized course after these changes.

      1. If you don't already have one, create the 'L' size test course.
      2. Go to that course and start a backup. Use default settings.
      3. Continue through the backup process until it completes successfully.

      EXPECTED: Backup completes OK. During long pauses while displaying each page, a progress bar 'Preparing page display' appears temporarily, and then disappears. For the backup page, the existing progress bar obviously appears too.

      Note: On my dev server, stage 2 took 20 seconds (according to performance info in footer), stage 3 took 45 seconds, and the actual backup took 440 seconds.

      Show
      Note: This test script uses the 'L' course, which already worked, because (even after these fixes) it still isn't 100% possible to back up the XL course due to the zip file issue. Also it would take like two hours. So the test script is basically checking that backup still works OK for a more normal-sized course after these changes. 1. If you don't already have one, create the 'L' size test course. 2. Go to that course and start a backup. Use default settings. 3. Continue through the backup process until it completes successfully. EXPECTED: Backup completes OK. During long pauses while displaying each page, a progress bar 'Preparing page display' appears temporarily, and then disappears. For the backup page, the existing progress bar obviously appears too. Note: On my dev server, stage 2 took 20 seconds (according to performance info in footer), stage 3 took 45 seconds, and the actual backup took 440 seconds.

      I am now testing backup and restore using the XL test course, which is designed to be larger than any course currently on the OU system. (1,000 sections, 50,000 users, etc.)

      (The course really is quite large; it won't display unless you increase default memory limit to 256M, and then it takes 50 seconds to show course view, even after it's got cached data. Not sure how much of this is 'latest activity' block killing it, mind.)

      With this course, the first screen was a bit slow but did complete just in time (110s); then the 'Schema settings' page times out:

      Fatal error: Maximum execution time of 120 seconds exceeded in /fs1/www_root/sm449/coremoodle/lib/pear/HTML/QuickForm.php on line 622 Call Stack: 0.0005 274712 1.

      {main}

      () /fs1/www_root/sm449/coremoodle/backup/backup.php:0 25.8027 220982496 2. base_ui->display() /fs1/www_root/sm449/coremoodle/backup/backup.php:116 25.8027 220982584 3. base_ui_stage->display() /fs1/www_root/sm449/coremoodle/backup/util/ui/base_ui.class.php:150 25.8027 220982664 4. backup_ui_stage_schema->initialise_stage_form() /fs1/www_root/sm449/coremoodle/backup/util/ui/base_ui_stage.class.php:123 26.0266 228089856 5. base_moodleform->add_settings() /fs1/www_root/sm449/coremoodle/backup/util/ui/backup_ui_stage.class.php:267 127.4544 256789072 6. base_moodleform->add_html_formatting() /fs1/www_root/sm449/coremoodle/backup/util/ui/base_moodleform.class.php:169 127.4544 256789256 7. HTML_QuickForm->addElement() /fs1/www_root/sm449/coremoodle/backup/util/ui/base_moodleform.class.php:232 127.4546 256791184 8. array_keys() /fs1/www_root/sm449/coremoodle/lib/pear/HTML/QuickForm.php:622

      I think the backup needs similar changes to those I did for restore, which allow it to potentially display a 'Preparing page display' progress bar if there is a massive amount of data to process before displaying the form.

        1. xl_backup_step_timings.zip
          576 kB
        2. xl-restore-time.png
          xl-restore-time.png
          12 kB

            quen Sam Marshall
            quen Sam Marshall
            Tim Hunt Tim Hunt
            Dan Poltawski Dan Poltawski
            Jason Fowler Jason Fowler
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved:

                Error rendering 'clockify-timesheets-time-tracking-reports:timer-sidebar'. Please contact your Jira administrators.