NOTE: This test requires admin access. If you would like to use the QA testing site for running the test, please see the QA testing guide for details of how to request admin access. Begin just after the hourly reset to give yourself plenty of time to complete the test!

If not testing on QA: LTI Advantage requires your site to be reachable from the internet. If not, Install ngrok to expose your moodle setup externally. Refer here for additional guidelines

Pre-requisite

1. Have a course with an instructor and at least one student
2. Have the Robotest Test app installed
   1. As site administrator, navigate to Site Admin > Plugins > Activity Modules > External Tool > Manage Tools
   2. In the box that says tool url enter: https://robotest.theedtech.dev/register
   3. Click the Add LTI Advantage button
   4. The test tool should open with a trace of the communication with Moodle, all should be green (thumbs up).
   5. Click the close button - the test app UI should disappear and the list of tools refreshing
   6. Verify the Robotest app has been added and is not yet activated
   7. Click the Activate button
3. For LTI 1.1 we use saLTIre (https://saltire.lti.app/)
   1. As site administrator, navigate to Site Admin > Plugins > Activity Modules > External Tool > Manage Tools -> Configure Tool Manually
   2. Tool URL: https://saltire.lti.app/tool
   3. Set as LTI 1.1
   4. Key: any value
   5. Secret: secret
   6. Under "Privacy" section "Accept grades from the tool" set to "As specified in Deep Linking definition or Delegate to teacher"

LTI Advantage Support for Submission Review

We enter the course as instructor, add a couple of links, one supporting submission review, one not. Then verify the launches from the gradebook.

Since multiple or single import have slightly different logic, we import both using multiple and single item.

1. Enter a course as instructor
2. Go to "More > LTI External tools"
3. Make sure both tools are set to "Show in activity chooser". If not, please set them accordingly.
4. Go back to the course home
5. Turn editing on
6. Add an activity and select Robotest:
   1. Click the Select Content button
   2. Select a single item: "A single Graded Activity with Submission Review Full"
   3. Back in Moodle, modify the title to prefix it with SINGLE, as to remember that link was imported as a single item import
   4. Submit
7. Now let's import multiples: Add an activity and select Robotest again:
   1. Click the Select Content button
   2. Select "One of Each"
   3. Back to Moodle, verify all the links listed in Robotest are going to be imported (should be 4 of them, 3 graded)
   4. Submit
8. Now let's check the Submission review actually works by going to the gradebook: navigate to grades
   1. Verify that each cell for the graded imported links has a ellipsis menu (...)
   2. For each of those links, click on the ellipsis menu (...) and select "Grade analysis" for the student cell
      1. Verify the launch is successful
      2. For submission review launch, it should mention it's a submission review (The 2nd header row should say 'Submission Review Launch')
      3. Verify the for_user field (User id found) is indicated as successfully populated. Note that it should be the id of the student for which the grade was clicked on.
9. Let's verify the regular launches are still... regular launches
   1. Navigate to the Course main page (where the topics are listed)
   2. Click on one of the Robotest activity
   3. In Robotest, verify the type of launch is Resource Link Launch (The 2nd header row should start with ('Resource Link Launch')

Let's verify Submission Review from a Student viewpoint now:

1. Enter course as a Student
2. Click on one of the imported links, one starting with Graded with Sub. Review (IFrame)
   1. Verify the launch is a successful and  the type of launch is Resource Link Launch (The 2nd header row should start with ('Resource Link Launch')
   2. It should have sent a grade back (one row should have a green title saying 'Score Post without error ')
3. Navigate back the Moodle Course home (by clicking on the course name in the Moodle UI)
4. Click on Grade
5. On the list of activities, find the one you clicked on in step 2
   1. Verify it has a grade
6. Open the grade item's context menu and select "grade analysis"
   1. Verify the launch type is submission review (The 2nd header row should say 'Submission Review Launch')
   2. Verify the User Id value and the For User Id have the same numeric value

LTI 1.1 Regular Launch

While this feature is not intended for 1.1 launches, by the way Moodle External Tool is built, there is no way to prevent the ellipsis menu (...) to show up. So since it shows, it should work (the link should launch successfully).

1. As a teacher, go to the course
2. Click to add an activity or resource, selecting "Saltire" from the activity chooser
3. Make the activity gradable (check "Allow Saltire to add grades in the gradebook") and set maximum points to some non-0 value (e.g. 100)
4. Save
5. Open the gradebook
6. Verify a column exists for the saltire activity
7. Click on the ellipsis menu (...) and select "Grade analysis" for the student cell
8. Verify the tool launches successfully