There is reasonable Behat coverage, but it would be good to also test manually: Setup Install any qtype plugin from the plugins DB (e.g. https://moodle.org/plugins/qtype_oumultiresponse ). Note: If using MDK mdk plugin install qtype_oumultiresponse Create a test course. Go to the question bank for that course. Create a question Q1 of that installed question type. Create a question Q2 of a standard type like true-false. Delete the folder of the question type plugin. e.g. in your moodle root folder: " rm -rf question/type/oumultiresponse " Upgrade your Moodle site " php admin/cli/upgrade " Testing Go to the course's question bank. Open the action menu for Q1. Verify that only the Delete and Manage tags actions are shown. Choose the Manage tags action. Add a tag and click Save changes. Verify that this works with no errors, and the tag is then shown in the question list. Choose the delete action. Note you will see a debugging notice. This is expected behaviour. Please ignore it. Click delete in the confirm message. (Again, ignore the debugging notice if it appears.) Verify that the question is removed from the question list. Verify that for Q2, all 6 of the usual actions are present in the action menu.