Uploaded image for project: 'Moodle'
  1. Moodle
  2. MDL-32188

Improve how CBM behaviours work

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 2.2.2
    • Fix Version/s: 2.6
    • Component/s: Questions, Quiz
    • Labels:
    • Testing Instructions:
      Hide

      Note that the unit tests will provide quite a good test of quite of lot of this.

      A. Test upgrade

      1. Before you start, create a quiz using CBM, and make at least one attempt as a student.
      2. Upgrade should add a maxfraction column to question_attempts table.

      B. Deferred feedback with CBM - single question

      1. Preview a multiple-choice question using Deferred feedback with CBM behaviour. Set max mark to 1.
      2. Initially it should say Base mark 1 in the grey info area.
      3. If you loook in the technical info, it should say minfaction -6 and max fraction 3.
      4. There should be a help icon by the certainty choices. Check it out.
      5. Answer the question, getting it right and wrong with various levels of certainty (including forgetting to set one.) Check the 'CBM mark' in the grey info area against what the help says should happen.

      C. Immediate feedback with CBM - single question

      Repeat B, but for the 'Immediate feedback with CBM' behaviour.

      D. Use in a quiz

      1. Now create a quiz using either of the CBM behaviours. (It is enough to test just one.) Ensure that all the review options are turned on.
      2. Add several multiple choice questions (ideally about 10), and set some of them to have a Max mark different from 1.
      3. Attempt the quiz as a student, and get various questions right or wrong with different levels of certainty, and submit.
      4. On the review page, at the top, there should be some interesting statistics about how you did. Ensure they look OK.
      5. Make several more attempts. In terms of the judgement, you should be able to get it to say 'No questions', 'under-confident', 'a bit under-confident', 'OK', 'a bit over-confident' and 'over-confident'.
      6. As teacher, change the reivew options to remove 'Marks', but leave everything else on.
      7. Go back to the review page for an attempt as a student. The detailed score statistics should now not be shown.

      E. Re-grading old attempts.

      1. Go to the quiz you attempted in A.
      2. Look at the Results -> Grades report. The grades should not have changed.
      3. Re-grade the attempt. The grades will now change to the new values.
      4. Review the attempt, and check that is OK.

      F. Developer info

      1. Read question/engine/upgrade.txt and question/behaviour/upgrade.txt and check they make sense.

      G. Verify no regressions

      We might just rely on the 2.6 QA testing cycle for this, but do a spot check of some other parts of the quiz UI, and some other question behaviours, to make sure nothing is badly broken.

      H. ... and finally

      1. If you get this far, you deserve a beer.
      Show
      Note that the unit tests will provide quite a good test of quite of lot of this. A. Test upgrade Before you start, create a quiz using CBM, and make at least one attempt as a student. Upgrade should add a maxfraction column to question_attempts table. B. Deferred feedback with CBM - single question Preview a multiple-choice question using Deferred feedback with CBM behaviour. Set max mark to 1. Initially it should say Base mark 1 in the grey info area. If you loook in the technical info, it should say minfaction -6 and max fraction 3. There should be a help icon by the certainty choices. Check it out. Answer the question, getting it right and wrong with various levels of certainty (including forgetting to set one.) Check the 'CBM mark' in the grey info area against what the help says should happen. C. Immediate feedback with CBM - single question Repeat B, but for the 'Immediate feedback with CBM' behaviour. D. Use in a quiz Now create a quiz using either of the CBM behaviours. (It is enough to test just one.) Ensure that all the review options are turned on. Add several multiple choice questions (ideally about 10), and set some of them to have a Max mark different from 1. Attempt the quiz as a student, and get various questions right or wrong with different levels of certainty, and submit. On the review page, at the top, there should be some interesting statistics about how you did. Ensure they look OK. Make several more attempts. In terms of the judgement, you should be able to get it to say 'No questions', 'under-confident', 'a bit under-confident', 'OK', 'a bit over-confident' and 'over-confident'. As teacher, change the reivew options to remove 'Marks', but leave everything else on. Go back to the review page for an attempt as a student. The detailed score statistics should now not be shown. E. Re-grading old attempts. Go to the quiz you attempted in A. Look at the Results -> Grades report. The grades should not have changed. Re-grade the attempt. The grades will now change to the new values. Review the attempt, and check that is OK. F. Developer info Read question/engine/upgrade.txt and question/behaviour/upgrade.txt and check they make sense. G. Verify no regressions We might just rely on the 2.6 QA testing cycle for this, but do a spot check of some other parts of the quiz UI, and some other question behaviours, to make sure nothing is badly broken. H. ... and finally If you get this far, you deserve a beer.
    • Affected Branches:
      MOODLE_22_STABLE
    • Fixed Branches:
      MOODLE_26_STABLE
    • Pull from Repository:
    • Pull Master Branch:
      MDL-32188 - this is work-in-progress

      Description

      Tony Gardner-Medwin had documented the required changes at http://moodle.org/mod/forum/discuss.php?d=192263#p844233 and http://moodle.org/mod/forum/discuss.php?d=192263#p840673 and http://www.tmedwin.net/cbm/moodle/.

      These changes are essential to make CBM in Moodle actually usable.

        Attachments

          Issue Links

            Activity

              People

              • Votes:
                3 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:
                  Fix Release Date:
                  18/Nov/13