Requirements web server and CLI using PHP 7.0.x (behat will tell you if both are ok or there are any differences) Preparation Copy the attached 67009.feature file into the lib/tests/behat/ directory. Init behat (with the flag: -a ) Run behat with flags: --tags '@mdl67009' Verify that you get 3 failures (one for each suite/theme: default, clean, more). Edit config.php and add: $CFG->behat_pause_on_fail = true; Run behat again, with same flags: --tags '@mdl67009' Verify that you get the execution paused 3 times (press <<enter>> after every one) with message: Scenario failed. Paused for inspection. Press Enter/Return to continue. Exception follows: Link matching locator "Participants" not found. Verify that after the 3rd <<enter>> the execution ends and the 3 failures are reported exactly like they where in points 3 & 4, more exactly: a list, 001, 002, 003 of failures and then, at the end the standard execution summary with failed scenarios, steps, time...