Details
-
Bug
-
Status: Closed
-
Minor
-
Resolution: Fixed
-
3.5.5, 3.6.2, 3.7
-
MOODLE_35_STABLE, MOODLE_36_STABLE, MOODLE_37_STABLE
-
MOODLE_35_STABLE, MOODLE_36_STABLE
-
MDL-64979-master -
- If necessary, run the Behat init.
- Add the following line to /index.php - I put it just before $PAGE->set_pagetype('site-index'); - about line 107:
- $PAGE->requires->js_init_code('M.util.js_pending("stupid"); setTimeout(function()
{ M.util.js_complete("stupid"); }
, 15000);');
- This will make it delay for 15 seconds before Behat thinks the page is ready. We are simulating what it feels like to use a slow machine.
- $PAGE->requires->js_init_code('M.util.js_pending("stupid"); setTimeout(function()
{ M.util.js_complete("stupid"); }
- Run Behat with the following scenario: blocks/private_files/tests/behat/block_private_files_frontpage.feature, second scenario 'Upload a file to the private files block from the frontpage'. (You can do this by name, by adding a tag to the file and using the tag, or in your IDE, it doesn't matter.)
- You'll see an error message about JavaScript being very slow and taking more than 10 seconds.
- Edit your config.php and add the following line:
- $CFG->behat_increasetimeout = 3;
- This will make all the timeouts 3 times longer, e.g. 30 seconds.
- Re-run the Behat test
- It should now pass.
If necessary, run the Behat init. Add the following line to /index.php - I put it just before $PAGE->set_pagetype('site-index'); - about line 107: $PAGE->requires->js_init_code('M.util.js_pending("stupid"); setTimeout(function() { M.util.js_complete("stupid"); } , 15000);'); This will make it delay for 15 seconds before Behat thinks the page is ready. We are simulating what it feels like to use a slow machine. Run Behat with the following scenario: blocks/private_files/tests/behat/block_private_files_frontpage.feature, second scenario 'Upload a file to the private files block from the frontpage'. (You can do this by name, by adding a tag to the file and using the tag, or in your IDE, it doesn't matter.) You'll see an error message about JavaScript being very slow and taking more than 10 seconds. Edit your config.php and add the following line: $CFG->behat_increasetimeout = 3; This will make all the timeouts 3 times longer, e.g. 30 seconds. Re-run the Behat test It should now pass.
Description
When running on slow machines (e.g. using Windows, or with hard disk instead of SDD, or insufficient RAM), Behat tests can be unreliable because some of the timeouts are not long enough.
The timeouts in Behat tests are defined in behat_base.php. They are fixed at 2 seconds, 6 seconds, or 10 seconds.
I propose adding a config.php option $CFG->behat_increasetimeout = 3;
This would increase all three time limits by the specified factor (so setting it to 3 makes the timeouts 6/18/30 which is enough at least for our machines, maybe not if somebody tries to run it on a VIC-20).
