Details

    • Type: Functional Test Functional Test
    • Status: Passed
    • Affects Version/s: Moodle 2.1
    • Fix Version/s: Moodle 2.1
    • Component/s: Quiz, Student, Teacher
    • Labels:
      None

      Description

      This test requires a quiz containing several questions.

      1. Login as a teacher, edit the settings for the quiz and set how questions behave to 'Adaptive mode'.
      2. Login as a student1 and attempt the quiz, answering the questions wrongly.
      3. Check that you are immediately allowed to try questions again and that a penalty is subtracted for each wrong attempt.
      4. Login as the teacher again, edit the settings for the quiz and set how questions behave to 'Adaptive mode (no penalties)'.
      5. Login as a student2 and attempt the quiz, answering the questions wrongly.
      6. Check that you are immediately allowed to try questions again with no penalties for wrong attempts.

        Issue Links

          Activity

          Hide
          Steve Turley added a comment -

          The problems with this test are a little broader than the test itself. I'll document the problems with this test first and then the more general ones:

          This test actually eventually does what its supposed to, but the reason I failed it is that it sends incorrect messages to the student.

          If you set up an adaptive question and answer it correctly the first time (I used a multiple choice question), it marks it correct, but gives the student a message saying "this submission attracted a penalty of 0.3333." In fact the penalty was not actually assessed, but the student might think that was the case.

          If the student initially answered the question incorrectly, it correctly assesses the penalty and gives the right message. However, when the question is answered correctly on a subsequent try it still tells the student a penalty was attracted (even though it says the answer was correct). As in the previous case, it doesn't really extract the penalty, it only says it did.

          Another test I did was to submit the answer to a question in adaptive mode without first clicking on the check button. Moodle correctly proceeds to grade the question, but the Summary of attempt screen lists the question status as "Not yet answered." This could confuse and worry students as well. If the student proceeds to submit the quiz anyway, the question is appropriately graded.

          This final problem happens for a number of other choices in the "How questions behave" drop-down menu as well. I noticed it with Adaptive Mode (nopenalties) and Immediate feedback as well. It isn't a problem in deferred feedback mode. There is correctly reports the status "Answer saved."

          Show
          Steve Turley added a comment - The problems with this test are a little broader than the test itself. I'll document the problems with this test first and then the more general ones: This test actually eventually does what its supposed to, but the reason I failed it is that it sends incorrect messages to the student. If you set up an adaptive question and answer it correctly the first time (I used a multiple choice question), it marks it correct, but gives the student a message saying "this submission attracted a penalty of 0.3333." In fact the penalty was not actually assessed, but the student might think that was the case. If the student initially answered the question incorrectly, it correctly assesses the penalty and gives the right message. However, when the question is answered correctly on a subsequent try it still tells the student a penalty was attracted (even though it says the answer was correct). As in the previous case, it doesn't really extract the penalty, it only says it did. Another test I did was to submit the answer to a question in adaptive mode without first clicking on the check button. Moodle correctly proceeds to grade the question, but the Summary of attempt screen lists the question status as "Not yet answered." This could confuse and worry students as well. If the student proceeds to submit the quiz anyway, the question is appropriately graded. This final problem happens for a number of other choices in the "How questions behave" drop-down menu as well. I noticed it with Adaptive Mode (nopenalties) and Immediate feedback as well. It isn't a problem in deferred feedback mode. There is correctly reports the status "Answer saved."
          Hide
          Michael de Raadt added a comment -

          Thanks to Steve and others for testing this issue.

          The issue has now been reset after some bug fixing and will be ready for retesting this evening (Tue 21 June) after 7pm (Perth time = 11am GMT).

          Michael;

          Show
          Michael de Raadt added a comment - Thanks to Steve and others for testing this issue. The issue has now been reset after some bug fixing and will be ready for retesting this evening (Tue 21 June) after 7pm (Perth time = 11am GMT). Michael;
          Hide
          Michael de Raadt added a comment -

          This test needs to be reworded slightly. The Adaptive mode and Apply penalties settings have been combined.

          Show
          Michael de Raadt added a comment - This test needs to be reworded slightly. The Adaptive mode and Apply penalties settings have been combined.
          Hide
          Helen Foster added a comment -

          Steve, many thanks for your detailed feedback. As you mention, there are further options in the "How questions behave" drop-down menu. Writing QA tests for them is on my to-do list! Anyway, hoping you can re-run this test following the bug fixes, as I think you must now be an adaptive mode expert!

          PS Updating the test description (also the test master copy) as suggested by Michael.

          Show
          Helen Foster added a comment - Steve, many thanks for your detailed feedback. As you mention, there are further options in the "How questions behave" drop-down menu. Writing QA tests for them is on my to-do list! Anyway, hoping you can re-run this test following the bug fixes, as I think you must now be an adaptive mode expert! PS Updating the test description (also the test master copy) as suggested by Michael.
          Hide
          moronke Fajobi added a comment -

          i do not see any differenc in setting the quiz to adaptive mode with penalties or adaptive mode without penalties.

          when it was set to adaptive mode with penalties, no deduction was made from the student's score.

          Show
          moronke Fajobi added a comment - i do not see any differenc in setting the quiz to adaptive mode with penalties or adaptive mode without penalties. when it was set to adaptive mode with penalties, no deduction was made from the student's score.
          Hide
          Helen Foster added a comment -

          Moronke, thanks for running this test and for your feedback. I've copied and pasted your comment into MDL-28024 so it can be investigated by our Quiz module maintainer Tim.

          Show
          Helen Foster added a comment - Moronke, thanks for running this test and for your feedback. I've copied and pasted your comment into MDL-28024 so it can be investigated by our Quiz module maintainer Tim.
          Hide
          Eloy Lafuente (stronk7) added a comment -

          Developers have worked on the problems found during the last run of this test (see linked bug for details) and it has been reset. Please test it again!

          I'm reassigning this to Helen based in the conversation some hours ago @ HQ. Thanks a lot for you work testing this Moronke!

          Show
          Eloy Lafuente (stronk7) added a comment - Developers have worked on the problems found during the last run of this test (see linked bug for details) and it has been reset. Please test it again! I'm reassigning this to Helen based in the conversation some hours ago @ HQ. Thanks a lot for you work testing this Moronke!
          Hide
          Chad Outten added a comment -

          steps 1-6 pass ok. using moodle 2.1 beta (20110624).

          Show
          Chad Outten added a comment - steps 1-6 pass ok. using moodle 2.1 beta (20110624).
          Hide
          Michael de Raadt added a comment -

          Great work. Thanks Chad.

          Michael;

          Show
          Michael de Raadt added a comment - Great work. Thanks Chad. Michael;

            People

            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: