Moodle QA

A teacher can set one of 4 possible options for grading multiple attempts of a SCORM activity

Details

  • Type: Functional Test Functional Test
  • Status: Passed Passed
  • Affects Version/s: Moodle 2.0
  • Fix Version/s: Moodle 2.0 QA1
  • Component/s: SCORM, Teacher
  • Labels:
    None

Description

This test requires a SCORM 1.2 package which can handle multiple attempts (see http://docs.moodle.org/en/SCORM_FAQ#Handling_of_Multiple_Attempts ).
Ensure 'Auto continue' is set to "No".

1. Login as a teacher, edit the settings for the SCORM activity, set the grading method to 'Highest grade', the number of attempts to unlimited and the attempts grading (an advanced setting) to 'Highest attempt'.
2. Login as student1, attempt the activity 3 times and check that the grade recorded in the gradebook is the highest attempt score.
3. Login as the teacher, edit the settings for the activity and set the attempts grading to 'Average attempt'.
4. Login as student2, attempt the activity 3 times and check that the grade recorded in the gradebook is the average of all attempts.
5. Login as the teacher, edit the settings for the activity and set the attempts grading to 'First attempt'.
6. Login as student3, attempt the activity 3 times and check that the grade recorded in the gradebook is the score for the first attempt.
7. Login as the teacher, edit the settings for the activity and set the attempts grading to 'Last attempt'.
8. Login as student4, attempt the activity 3 times and check that the grade recorded in the gradebook is the score for the last attempt.

Issue Links

Activity

Hide
Teresa Gibbison added a comment -

Failed as per rather long winded comments on MDLQA-231 with an outlines of the results. I don't think the scores were calculated correctly but would love someone else to decipher them!

Show
Teresa Gibbison added a comment - Failed as per rather long winded comments on MDLQA-231 with an outlines of the results. I don't think the scores were calculated correctly but would love someone else to decipher them!
Hide
Helen Foster added a comment -

Teresa, thanks for running this test. I'm going to reset it now, since MDL-23492 is marked as fixed. Please see Dan's comment in MDL-23492 for further information on SCORM activity grading.

Show
Helen Foster added a comment - Teresa, thanks for running this test. I'm going to reset it now, since MDL-23492 is marked as fixed. Please see Dan's comment in MDL-23492 for further information on SCORM activity grading.
Hide
Helen Foster added a comment -

Teresa, I've just added you as a watcher, as I'm wondering whether I made a mistake resetting the test if you failed it after Dan resolved MDL-23492? If so, please add a comment to MDL-23492 requesting that it is re-opened and mark this test as failed (again!) Apologies for my mistake.

Show
Helen Foster added a comment - Teresa, I've just added you as a watcher, as I'm wondering whether I made a mistake resetting the test if you failed it after Dan resolved MDL-23492? If so, please add a comment to MDL-23492 requesting that it is re-opened and mark this test as failed (again!) Apologies for my mistake.
Hide
Teresa Gibbison added a comment -

See comments in MDLQA-231 re me not knowing what the scores should be... they all still look like the highest attempt...

Show
Teresa Gibbison added a comment - See comments in MDLQA-231 re me not knowing what the scores should be... they all still look like the highest attempt...
Hide
Helen Foster added a comment -

It seems that this test, as for MDLQA-231, requires a particular SCORM package in order to be able to run the test properly. Thus I'm going to post in the SCORM module forum to ask whether anyone can help provide SCORM packages for testing. If we don't obtain one soon, I will copy these comments, then remove this test from Moodle 2.0 QA Cycle 1. Once we have a SCORM package, the test can be added to the next QA cycle.

Show
Helen Foster added a comment - It seems that this test, as for MDLQA-231, requires a particular SCORM package in order to be able to run the test properly. Thus I'm going to post in the SCORM module forum to ask whether anyone can help provide SCORM packages for testing. If we don't obtain one soon, I will copy these comments, then remove this test from Moodle 2.0 QA Cycle 1. Once we have a SCORM package, the test can be added to the next QA cycle.
Hide
Teresa Gibbison added a comment -

adding Dan as a watcher - have created MDL-23751 (complete with video of testing!) as strange crashing behaviour during second SCORM attempt.

Show
Teresa Gibbison added a comment - adding Dan as a watcher - have created MDL-23751 (complete with video of testing!) as strange crashing behaviour during second SCORM attempt.
Hide
Amy Groshek added a comment -

I have tested this issue using Ostyn's prodding SCO. My process was as follows:

For 2 student users:
Access Prodding SCO

  1. Initialize();
  2. set value cmi.core.score.raw
  3. Commit();
  4. set value cmi.core.lesson_status to either "completed" or "passed" (the two both work interchangeably to indicate completed attempt)
  5. LMSFinish();

Sally Student's attempts cmi.core.score.raw:
40, 40, 40

Sam Student's attempts cmi.core.score.raw:
25, 50, 100

With the Attempts Grading setting set to Highest Grade, reporting to the gradebook was correct. 40 for Sally, 100 for Sam.
With the Attempts Grading setting set to Average Attempt, reporting to the gradebook was unchanged from Highest Grade.
With the Attempts Grading setting set to First Attempt, reporting to the gradebook was unchanged from Highest Grade.
With the Attempts Grading setting set to Last Attempt, reporting to the gradebook was unchanged from Highest Grade.

I also logged in as Sam student to look at the SCORM results view for student users. When grading method was set to last attempt, Sam's grade in this view was shown as "50", which would seem to indicate that it's not actually rendering up the "last" score recorded. This is very obvious as the view shows a list of all 3 attempts.

Show
Amy Groshek added a comment - I have tested this issue using Ostyn's prodding SCO. My process was as follows: For 2 student users: Access Prodding SCO
  1. Initialize();
  2. set value cmi.core.score.raw
  3. Commit();
  4. set value cmi.core.lesson_status to either "completed" or "passed" (the two both work interchangeably to indicate completed attempt)
  5. LMSFinish();
Sally Student's attempts cmi.core.score.raw: 40, 40, 40 Sam Student's attempts cmi.core.score.raw: 25, 50, 100 With the Attempts Grading setting set to Highest Grade, reporting to the gradebook was correct. 40 for Sally, 100 for Sam. With the Attempts Grading setting set to Average Attempt, reporting to the gradebook was unchanged from Highest Grade. With the Attempts Grading setting set to First Attempt, reporting to the gradebook was unchanged from Highest Grade. With the Attempts Grading setting set to Last Attempt, reporting to the gradebook was unchanged from Highest Grade. I also logged in as Sam student to look at the SCORM results view for student users. When grading method was set to last attempt, Sam's grade in this view was shown as "50", which would seem to indicate that it's not actually rendering up the "last" score recorded. This is very obvious as the view shows a list of all 3 attempts.
Hide
Dan Marsden added a comment -

Hi Amy,

thanks for testing - one of the things that might be confusing here is that changing the grade method won't change any grades already pushed to the gradebook. - The grading method will only be used next time a user makes another attempt.

I think we have some code lying around here that we wrote for one of our clients that updated gradebook entries based on the SCORM settings but we never tidied this up and put it in core... can you please re-test using new attempts each time you change the grading method and see if that works?

There should probably be an open feature request in the tracker to improve this..... I'll try to remember to dig out the code that we had to update grades......

thanks,

Dan

Show
Dan Marsden added a comment - Hi Amy, thanks for testing - one of the things that might be confusing here is that changing the grade method won't change any grades already pushed to the gradebook. - The grading method will only be used next time a user makes another attempt. I think we have some code lying around here that we wrote for one of our clients that updated gradebook entries based on the SCORM settings but we never tidied this up and put it in core... can you please re-test using new attempts each time you change the grading method and see if that works? There should probably be an open feature request in the tracker to improve this..... I'll try to remember to dig out the code that we had to update grades...... thanks, Dan
Hide
Dan Marsden added a comment -

hmmm.... ignore that last comment, looking at the code it looks like we did add the grade updating functions.... I'll have a closer look at this.

Show
Dan Marsden added a comment - hmmm.... ignore that last comment, looking at the code it looks like we did add the grade updating functions.... I'll have a closer look at this.
Hide
Teresa Gibbison added a comment -

I can't continue to test this at all now due to the 404 error when navigating to another page - see MDL-23751 for details (just watch the 30sec video posted today!) .

Show
Teresa Gibbison added a comment - I can't continue to test this at all now due to the 404 error when navigating to another page - see MDL-23751 for details (just watch the 30sec video posted today!) .
Hide
Amy Groshek added a comment -

Dan, awesome that you caught that. Will wait to see what you find out. Because attempts grading is cumulative, it really makes the most sense if a change to that setting resets what's in the gradebook...

Regards,
A

Show
Amy Groshek added a comment - Dan, awesome that you caught that. Will wait to see what you find out. Because attempts grading is cumulative, it really makes the most sense if a change to that setting resets what's in the gradebook... Regards, A
Hide
Teresa Gibbison added a comment -

TOC duplication error fixed - now waiting for the 404 error to be fixed. Would love to be able to test this using the 'normal' web interface students would use.

Show
Teresa Gibbison added a comment - TOC duplication error fixed - now waiting for the 404 error to be fixed. Would love to be able to test this using the 'normal' web interface students would use.
Hide
Helen Foster added a comment -

Thanks everyone for your help with testing. I'm rewording the test a little based on Dan's comments. (Dan, please let me know if it requires further rewording.)

Show
Helen Foster added a comment - Thanks everyone for your help with testing. I'm rewording the test a little based on Dan's comments. (Dan, please let me know if it requires further rewording.)
Hide
Dan Marsden added a comment -

we think all the outstanding issues on this have been fixed and this should now pass correctly. - thanks to everyone who has helped track the issues down.

Show
Dan Marsden added a comment - we think all the outstanding issues on this have been fixed and this should now pass correctly. - thanks to everyone who has helped track the issues down.
Hide
Helen Foster added a comment -

Thanks Dan, just resetting the test...

Show
Helen Foster added a comment - Thanks Dan, just resetting the test...
Hide
Teresa Gibbison added a comment -

YEAH!!

Show
Teresa Gibbison added a comment - YEAH!!
Hide
Teresa Gibbison added a comment -

adding note about auto continue due to comments in MDL-23751 from Dan about this not working correctly for a while.

Show
Teresa Gibbison added a comment - adding note about auto continue due to comments in MDL-23751 from Dan about this not working correctly for a while.

People

Vote (0)
Watch (4)

Dates

  • Created:
    Updated:
    Resolved: