Moodle
  1. Moodle
  2. MDL-6353

The interface for putting page breaks into quizzes is confusing

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.6.1, 1.7
    • Fix Version/s: 2.0
    • Component/s: Quiz
    • Labels:
      None
    • Affected Branches:
      MOODLE_16_STABLE, MOODLE_17_STABLE
    • Fixed Branches:
      MOODLE_20_STABLE
    • Rank:
      34295

      Description

      The quiz settings page has a 'questions per page' option where you can select an integer, or 'unlimited'. This gives the impression that quizzes are automatically paginated.

      Well, if the option 'shuffle questions' is turned on, then they are automatically paginated.

      But if the shuffle option is off, then they are actually manually paginated. The quiz 'questions per page' option then only has an effect when a new question is added. On the quiz editing page, there is a tick-box 'show page breaks' that can be turned on. If you do, you can then see where the page breaks are and move them up and down. With the check-box on, there is also a dropdown that can be used for repaginating the quiz. That is only only effective way to change the questions per page option after questions have been added to the quiz. Changing the quiz settings dropdown does not trigger an automatic pagination.

      Anyway, it is horribly confusing, as evidenced by several bug reports and forum posts. And I have been thinking about the quiz for months, and only just understood all the intricacies myself. We need something less confusing. I suggest:

      On the quiz settings form, we add the option 'manual page breaks' to the 'questions per page' dropdown.

      If one of the current 'questions per page' options is selected (unlimited or n) then the quiz is always automatically paginated, and the 'show page breaks' option and the other options it hides are not available.

      If 'manual page breaks' is selected, the page breaks are always shown, and the manual repaginate dropdown is always present, and when new questions are added to the quiz, no automatic page breaks are added.

      It is an error to try to select both 'shuffle questions' and 'manual page breaks' at the same time.

      When making this change, all existing quizzes will be analysed for where the page breaks actually are. If the page breaks are uniformly spread, then they will be set to that automatic pagination value. If the page breaks are irregular, they will be set to manual pagination.

      At the same time, I propse to change the default setting for new quizzes to 'one question per page' becuase I believe that pedagogically it is best for students to concentrate on one thing at a time.

      And if only one question per page is shown, I propose to change the paging bar, so that instead of 'page' is says 'question' (and references to description items will be referred to as 'info', not given a number).

        Issue Links

          Activity

          Hide
          Ray Lawrence added a comment -

          At the same time, I propse to change the default setting for new quizzes to 'one question per page' becuase I believe that pedagogically it is best for students to concentrate on one thing at a time.

          ...... so it should be 1 qpp.

          Tim,

          Do you have any evidence to support this proposal? This may be the case with lengthy case study type questions, for example, but makes no sense at all for, say, a wholly MC quiz. How many paper based tests have you encountered with one MC question per sheet?

          Unlimited is the most sensible default. Please don't change this on a whim.

          And if only one question per page is shown, I propose to change the paging bar, so that instead of 'page' is says 'question' (and references to description items will be referred to as 'info', not given a number).

          This makes sense and would be welcome improvement.

          Show
          Ray Lawrence added a comment - At the same time, I propse to change the default setting for new quizzes to 'one question per page' becuase I believe that pedagogically it is best for students to concentrate on one thing at a time. ...... so it should be 1 qpp. Tim, Do you have any evidence to support this proposal? This may be the case with lengthy case study type questions, for example, but makes no sense at all for, say, a wholly MC quiz. How many paper based tests have you encountered with one MC question per sheet? Unlimited is the most sensible default. Please don't change this on a whim. And if only one question per page is shown, I propose to change the paging bar, so that instead of 'page' is says 'question' (and references to description items will be referred to as 'info', not given a number). This makes sense and would be welcome improvement.
          Hide
          Tim Hunt added a comment -

          The duplicate bug is a simple-minded patch that just repaginates the quiz when the quiz settings are changes. This may not be a good idea becuase it will overwrite any manual page breaks people have put into their quizzes.

          Show
          Tim Hunt added a comment - The duplicate bug is a simple-minded patch that just repaginates the quiz when the quiz settings are changes. This may not be a good idea becuase it will overwrite any manual page breaks people have put into their quizzes.
          Hide
          Olli Savolainen added a comment -

          As far as the actual editing interface goes, the new quiz UI makes the paging more explicit and also makes it clear when question order is shuffled and the question order is not the actual order.

          However, this is mostly a problem of not communicating the dependencies between different options on the quiz settings ("update this x") page. I am not completely sure I understand all the dependencies described above yet, but naturally the actual outcome of the current selection should also be communicated to the user on the reordering tab, if not also in the edit tab, so as to make sure the user understands the implications of his/her choices.

          Show
          Olli Savolainen added a comment - As far as the actual editing interface goes, the new quiz UI makes the paging more explicit and also makes it clear when question order is shuffled and the question order is not the actual order. However, this is mostly a problem of not communicating the dependencies between different options on the quiz settings ("update this x") page. I am not completely sure I understand all the dependencies described above yet, but naturally the actual outcome of the current selection should also be communicated to the user on the reordering tab, if not also in the edit tab, so as to make sure the user understands the implications of his/her choices.
          Hide
          Olli Savolainen added a comment -

          Reposting a part of what I said at the linked issue, MDL-14632:

          "[...] That said, what comes to my mind quickly are that the different options should be analyzed throughly and it should be determined with real users. To get a bit deeper, different information gathering methods can be used to:

          • which settings are basic ones that every user of quiz should consider, and which ones are advanced settings
          • which settings or their outcomes are not understood by users at all
          • which interdependencies between settings are not understood by users from the current UI
          • what are reasonable defaults for different usage scenarios"
          Show
          Olli Savolainen added a comment - Reposting a part of what I said at the linked issue, MDL-14632 : " [...] That said, what comes to my mind quickly are that the different options should be analyzed throughly and it should be determined with real users. To get a bit deeper, different information gathering methods can be used to: which settings are basic ones that every user of quiz should consider, and which ones are advanced settings which settings or their outcomes are not understood by users at all which interdependencies between settings are not understood by users from the current UI what are reasonable defaults for different usage scenarios"
          Hide
          Tim Hunt added a comment -

          I just thought of a simpler way to remove the confusion. I have changed field on the quiz settings form to be:

          Automatically start a new page Never / After adding each question / After adding 2 questions / ...

          And I have ensured that the repagination control is always visible on the quiz editing page.

          Since this change involves a number of new language strings, and breaks existing Moodle instruction manuals, I have done it in head only. I realise that some of this may be obsoleted by Olli's work, but I did not want to leave a job half done.

          Show
          Tim Hunt added a comment - I just thought of a simpler way to remove the confusion. I have changed field on the quiz settings form to be: Automatically start a new page Never / After adding each question / After adding 2 questions / ... And I have ensured that the repagination control is always visible on the quiz editing page. Since this change involves a number of new language strings, and breaks existing Moodle instruction manuals, I have done it in head only. I realise that some of this may be obsoleted by Olli's work, but I did not want to leave a job half done.
          Hide
          Olli Savolainen added a comment -

          This issue is reopened at MDL-17333 - sorry for the misuse of the tracker, this one should have been reopened instead, but now the discussion is already continuing there.

          The intricacies of this question are discussed in http://docs.moodle.org/en/Development:Quiz_Usability_portal/Different_paginating_features_in_quiz with proposed solutions.

          Show
          Olli Savolainen added a comment - This issue is reopened at MDL-17333 - sorry for the misuse of the tracker, this one should have been reopened instead, but now the discussion is already continuing there. The intricacies of this question are discussed in http://docs.moodle.org/en/Development:Quiz_Usability_portal/Different_paginating_features_in_quiz with proposed solutions.

            People

            • Votes:
              1 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: