Initialise behat Modify badges/tests/behat/award_badge.feature and make some step fail. delete all files in /tmp/behat_rerun_cache run behat with badges/tests/behat/award_badge.feature check /tmp/behat_rerun_cache and there should be only 1 failing scenario. run behat with above feature and --rerun option Ensure it only runs with core theme. Initialize behat --run-with-theme Run behat again with above feature run behat with above feature and --rerun option Ensure it runs with core and more theme. TEST MDL-55853 Run composer install on php56 and php70