Moodle

Question multichoice responses are not logical

Details

  • Type: Improvement Improvement
  • Status: Open Open
  • Priority: Minor Minor
  • Resolution: Unresolved
  • Affects Version/s: 1.7, 1.9.7
  • Fix Version/s: None
  • Component/s: Lesson
  • Labels:
    None
  • Environment:
    1.9.7 demo.moodle.net demonstrates issue
  • Database:
    MySQL
  • Affected Branches:
    MOODLE_17_STABLE, MOODLE_19_STABLE

Description

When selecting a multichoice question, the wrong response often appears.

For example, as a teacher using preview mode, my 3rd question in my short lesson:

I had 4 answers Correct1, Correct2, Wrong1, Wrong2 and the reponses said something like "Response to Correct1" etc. 1) When I checked off two correct answers the first time I only saw Response to Correct2". 2) When I checked of Correct2 and Wrong1, I got "Response to Wrong4". I switched display default response off and on and tried #2 again and it gave me "Response to Wrong4" again, so it appears to be consistant.

Logged in as my student Dim Witt and Mr. Witt tried #2 and got same "response to Wrong4"

This bug came up in Lesson Forum .

Activity

Hide
Mark Nielsen added a comment -

This issue comes up a lot.

The multiple choice multianswer interface is terrible

There is only a correct or incorrect with multianswer. For best results, when authoring these questions, all correct answers should be first. All jumps/scores/responses should be the SAME for BOTH correct and incorrect answers. I know this is not ideal but that it how it works for now.

Show
Mark Nielsen added a comment - This issue comes up a lot. The multiple choice multianswer interface is terrible There is only a correct or incorrect with multianswer. For best results, when authoring these questions, all correct answers should be first. All jumps/scores/responses should be the SAME for BOTH correct and incorrect answers. I know this is not ideal but that it how it works for now.
Hide
Chris Collman added a comment -

Changed this to an improvement. I am in process of rewriting MoodleDocs. Your comment was a big help. This is really a can of worms.

Multianswer or multichoice needs to be in its own edit form. Responces and jumps have more in common with matching. when it comes to the edit form. True it looks more like a multiple choice to a student, but not to the teacher trying to create it.

If there are too many forms, then put T/F on the muliple choice as a checkoff box. Could be wrong but it is really a special case (two answers only) of a multiple choice, otherwise there is no difference.

Also on my list of improvements is to make sure the question forms in Lesson and Quiz use the same language. When I looked at a Quiz multiple choice, I was surprised. I would like students to "answer" and teachers give "feedback".

The MoodleDoc Quiz question description uses 'responce' as the action verb describe the student's choice. Very confusing to a bald headed guy. Good thing there no adaptive jumps in quizzes because they would probably be called branches. Just being funny. I appreciate dual tracks and independent inventions.

That is enough from Chris. Just add this to the round tuit list

Show
Chris Collman added a comment - Changed this to an improvement. I am in process of rewriting MoodleDocs. Your comment was a big help. This is really a can of worms. Multianswer or multichoice needs to be in its own edit form. Responces and jumps have more in common with matching. when it comes to the edit form. True it looks more like a multiple choice to a student, but not to the teacher trying to create it. If there are too many forms, then put T/F on the muliple choice as a checkoff box. Could be wrong but it is really a special case (two answers only) of a multiple choice, otherwise there is no difference. Also on my list of improvements is to make sure the question forms in Lesson and Quiz use the same language. When I looked at a Quiz multiple choice, I was surprised. I would like students to "answer" and teachers give "feedback". The MoodleDoc Quiz question description uses 'responce' as the action verb describe the student's choice. Very confusing to a bald headed guy. Good thing there no adaptive jumps in quizzes because they would probably be called branches. Just being funny. I appreciate dual tracks and independent inventions. That is enough from Chris. Just add this to the round tuit list
Hide
Chris Collman added a comment -

Thanks for redirect to this. I just rewrote the MoodleDoc lesson so I would not forget what to do. I am still blushing about my memory. Oh well. Moving right along.

http://docs.moodle.org/en/Lesson_module#With_multianswer_box_checked

Now will I remember? Thanks Chris

Show
Chris Collman added a comment - Thanks for redirect to this. I just rewrote the MoodleDoc lesson so I would not forget what to do. I am still blushing about my memory. Oh well. Moving right along. http://docs.moodle.org/en/Lesson_module#With_multianswer_box_checked Now will I remember? Thanks Chris
Hide
Minh-Tam Nguyen added a comment -

This has just come up with us as well (1.9.4):
[Multiple Choice - Multianswer]
Answer 1: answer 1 - correct
Response 1: response 1
Score 1: 1
Jump 1: Next page
Answer 2: answer 2 - correct
Response 2: response 2
Score 2: 1
Jump 2: This page
Answer 3: answer 3 - wrong
Response 3: response 3
Score 3: 0
Jump 3: This page
Answer 4: answer 4 - wrong
Response 4: response 4
Score 4: 0
Jump 4: This page

this page in the lesson will show response 4 no matter which combination of answers is selected, EXCEPT for if answers 1 and 2 are selected in which case it will show response 2.
This is unfortunately not as discussed here either: http://moodle.org/mod/forum/discuss.php?d=119643

To fit with the constructivist mindset of Moodle, there should be more options for responses than just right (response 2) and wrong (response 4). Why are the other responses ignored?

Show
Minh-Tam Nguyen added a comment - This has just come up with us as well (1.9.4): [Multiple Choice - Multianswer] Answer 1: answer 1 - correct Response 1: response 1 Score 1: 1 Jump 1: Next page Answer 2: answer 2 - correct Response 2: response 2 Score 2: 1 Jump 2: This page Answer 3: answer 3 - wrong Response 3: response 3 Score 3: 0 Jump 3: This page Answer 4: answer 4 - wrong Response 4: response 4 Score 4: 0 Jump 4: This page this page in the lesson will show response 4 no matter which combination of answers is selected, EXCEPT for if answers 1 and 2 are selected in which case it will show response 2. This is unfortunately not as discussed here either: http://moodle.org/mod/forum/discuss.php?d=119643 To fit with the constructivist mindset of Moodle, there should be more options for responses than just right (response 2) and wrong (response 4). Why are the other responses ignored?
Hide
Chris Collman added a comment -

The instructions in MoodleDocs http://docs.moodle.org/en/Lesson_questions#Multianswer for a Multianswer question are that all right answers should have the same response and the same jump. And that all the wrong answers have the same response and the same jump. (If you mixed up the answers, put a wrong answer in the #2 position, the jump and response show can be different. Also it will be different if you have 10 answers). Tried that way back when

A multichoice Lesson question is really like a matching question when it is evaluated. Lesson does not display all the choices that were available to the student in any question, just the one they selected.

Personally I do not think a Lesson multianswer question should look like a multiple choice question, with a check box. It should have it's own screen. Student gets it 100% correct or the student misses the question. Makes it clear to teacher that is the way it is period

Quiz, unlike Lesson, can display right and wrong answers on the screen. Interestingly, I just checked Quiz in demo.moodle. I created a multichoice question and allowed multiple answers. I had 2 correct answers (50% each) and 2 wrong answers (0% each). in Preview mode I selected 1 correct and 1 wrong it told me I was wrong and gave me 50% credit and showed me the responses for just those selections. When I selected 2 correct answers and 1 wrong answers, I got 100% credit and saw the responses for the of the 4 answers. So if you want the student to miss the question when they select 1 or more wrong answers and get zero points, how do you do it in Quiz?

There are issues in both modules with the functionality of this question type. Excellent comment. Never settle for "that is the way it is". Chris

Show
Chris Collman added a comment - The instructions in MoodleDocs http://docs.moodle.org/en/Lesson_questions#Multianswer for a Multianswer question are that all right answers should have the same response and the same jump. And that all the wrong answers have the same response and the same jump. (If you mixed up the answers, put a wrong answer in the #2 position, the jump and response show can be different. Also it will be different if you have 10 answers). Tried that way back when A multichoice Lesson question is really like a matching question when it is evaluated. Lesson does not display all the choices that were available to the student in any question, just the one they selected. Personally I do not think a Lesson multianswer question should look like a multiple choice question, with a check box. It should have it's own screen. Student gets it 100% correct or the student misses the question. Makes it clear to teacher that is the way it is period Quiz, unlike Lesson, can display right and wrong answers on the screen. Interestingly, I just checked Quiz in demo.moodle. I created a multichoice question and allowed multiple answers. I had 2 correct answers (50% each) and 2 wrong answers (0% each). in Preview mode I selected 1 correct and 1 wrong it told me I was wrong and gave me 50% credit and showed me the responses for just those selections. When I selected 2 correct answers and 1 wrong answers, I got 100% credit and saw the responses for the of the 4 answers. So if you want the student to miss the question when they select 1 or more wrong answers and get zero points, how do you do it in Quiz? There are issues in both modules with the functionality of this question type. Excellent comment. Never settle for "that is the way it is". Chris
Hide
Chris Collman added a comment -

The reports interface now shows all the answers a particular student selected. as well as something that is similar to an item analysis in Quiz.

I still would like to see a multi choice question with its own screen own screens, similar to the Matching interface.

Tell me a common educator can understand these instructions when pushing the help icon next to Multicanswer box :

Multichoice There is variant of Multichoice questions called "Multichoice Multianswer" questions. If the Question Option is selected then the student is required to select all the correct answers from the set of answers. The question may or may not tell the student how many correct answers there are. For example "Which of the following were US Presidents?" does not, while "Select the two US presidents from the following list." does. The actual number of correct answers can be from one up to the number of choices. (A Multichoice Multianswer question with one correct answer is different from a Multichoice question as the former allows the student the possibility of choosing more than one answer while the latter does not.)

I do not mean to be negative but "variant", "called Multichoice Multianswer", what is this prose really trying to say, "here is how it is scored?". There is nothing about where feedback to student comes from. Until a new question format is designed, I suggest changing the help link text to:

"The multianswer option in a multiple choice question type forces the student to select all the right answers to receive any credit for the question. When creating a question using this option to make sure it gives consistent results, all correct answers must have the same feedback and score. And all the wrong answers must have the same feedback and score. "

Show
Chris Collman added a comment - The reports interface now shows all the answers a particular student selected. as well as something that is similar to an item analysis in Quiz. I still would like to see a multi choice question with its own screen own screens, similar to the Matching interface. Tell me a common educator can understand these instructions when pushing the help icon next to Multicanswer box : Multichoice There is variant of Multichoice questions called "Multichoice Multianswer" questions. If the Question Option is selected then the student is required to select all the correct answers from the set of answers. The question may or may not tell the student how many correct answers there are. For example "Which of the following were US Presidents?" does not, while "Select the two US presidents from the following list." does. The actual number of correct answers can be from one up to the number of choices. (A Multichoice Multianswer question with one correct answer is different from a Multichoice question as the former allows the student the possibility of choosing more than one answer while the latter does not.) I do not mean to be negative but "variant", "called Multichoice Multianswer", what is this prose really trying to say, "here is how it is scored?". There is nothing about where feedback to student comes from. Until a new question format is designed, I suggest changing the help link text to: "The multianswer option in a multiple choice question type forces the student to select all the right answers to receive any credit for the question. When creating a question using this option to make sure it gives consistent results, all correct answers must have the same feedback and score. And all the wrong answers must have the same feedback and score. "
Hide
Martin Dougiamas added a comment -

Reassigning this to moodle.com for the time being, since Mark Nielsen is not maintaining Lesson any more. Please comment/vote/patch any crucial bugs that affect you for 2.0 to help us prioritise fixes for the upcoming release.

Show
Martin Dougiamas added a comment - Reassigning this to moodle.com for the time being, since Mark Nielsen is not maintaining Lesson any more. Please comment/vote/patch any crucial bugs that affect you for 2.0 to help us prioritise fixes for the upcoming release.

People

Vote (3)
Watch (0)

Dates

  • Created:
    Updated: