Details

    • Type: Sub-task Sub-task
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 2.0
    • Fix Version/s: 1.9.1
    • Component/s: Quiz
    • Labels:
      None
    • Affected Branches:
      MOODLE_20_STABLE
    • Fixed Branches:
      MOODLE_19_STABLE
    • Rank:
      26447

      Description

      Our "Early warning test" (see above) generates a graph like this showing score frequencies for all students:

      http://docs.moodle.org/en/Image:Quiz_report_enhancements_historgram.png

      It should be possible to produce a graph like this using graphlib.php, and a single database query, so I think we should, and display it after the results table. It should count the number of attempts with a score in each of an appropriate number of score brackets, depending on the quiz total score.

        Activity

        Hide
        Jamie Pratt added a comment -

        I'm wondering if the graph should be for all quiz attempts or depending on scoring the highest graded / first / last attempt ??

        Show
        Jamie Pratt added a comment - I'm wondering if the graph should be for all quiz attempts or depending on scoring the highest graded / first / last attempt ??
        Hide
        Pierre Pichet added a comment -

        At first sight, I think it should follow the grading rules.

        Show
        Pierre Pichet added a comment - At first sight, I think it should follow the grading rules.
        Hide
        Tim Hunt added a comment -

        I agree, the graph should be per student, not per attempt - we need to label the axes appropriately.

        Show
        Tim Hunt added a comment - I agree, the graph should be per student, not per attempt - we need to label the axes appropriately.
        Hide
        Tim Hunt added a comment -

        Phil, when you have a chance to look at this, can you confirm. Thanks.

        Show
        Tim Hunt added a comment - Phil, when you have a chance to look at this, can you confirm. Thanks.
        Hide
        Jamie Pratt added a comment -

        So perhaps we should actually be querying the quiz_grades table and not the attempts table. I'm thinking that the graph should respect the group selected too and display only grades for the group members.

        Show
        Jamie Pratt added a comment - So perhaps we should actually be querying the quiz_grades table and not the attempts table. I'm thinking that the graph should respect the group selected too and display only grades for the group members.
        Hide
        Tim Hunt added a comment -

        Well, what I think would be nicest is a bar chart showing the numbers for the whole course in one colour, then drawn over the top in another colour, the numbers for this group. (Since the group bars will always be shorter, this will work.) If that is quite easy to do, do it.

        The main use for this though is to let people, even if they are not allowed to see scores for everyone in the course, to still get a rough impression for how their group compares to the whole course.

        Show
        Tim Hunt added a comment - Well, what I think would be nicest is a bar chart showing the numbers for the whole course in one colour, then drawn over the top in another colour, the numbers for this group. (Since the group bars will always be shorter, this will work.) If that is quite easy to do, do it. The main use for this though is to let people, even if they are not allowed to see scores for everyone in the course, to still get a rough impression for how their group compares to the whole course.
        Hide
        Jamie Pratt added a comment -

        I added a graph to the bottom of the overview report. It displays group grades (if you are viewing results for a group) as well as grades for all participants.

        Show
        Jamie Pratt added a comment - I added a graph to the bottom of the overview report. It displays group grades (if you are viewing results for a group) as well as grades for all participants.
        Hide
        Jamie Pratt added a comment - - edited

        do the x axis labels look good to you on the attached graph image Tim. Or do you prefer the present labels 0.00 - 1.00 (respects quiz decimal points setting).

        Show
        Jamie Pratt added a comment - - edited do the x axis labels look good to you on the attached graph image Tim. Or do you prefer the present labels 0.00 - 1.00 (respects quiz decimal points setting).
        Hide
        Tim Hunt added a comment -

        I think 0.00 - 1.00 looks better.

        Show
        Tim Hunt added a comment - I think 0.00 - 1.00 looks better.
        Hide
        Philip Butcher added a comment -

        I have to express concern about showing groups on the same graph as we show the whole cohort. For courses where we have large cohorts I do not think that we can show the whole cohort and the group on the same graph with the same axes.

        For an example let's assume a course with 1,000 students.
        And the graph broken in 20 ranges each of 5%.
        Then we might easily imagine that >100 students will be in one of the ranges.

        Now our tutor groups only have 20 students.
        Taking the same proportions as above that translates into 2 students in a range.

        And showing 2 students on the same axis as we show >100 will render the former as almost 'not there'.

        So I don't want this left as it is.

        Which raises the question of what we should do. The points are labelled only so that I can refer back to them below.

        [option 1] Let's be clear that the main purpose of this graph is for course teams to get a pictorial view of how the assessment has performed. That is we are mainly interested in 'Course staff' viewing the graph of the whole cohort.

        [option 2] Once we have this it is quite OK, and I think helpful, to show that graph to tutors of groups..

        If we can easily show tutors where their students sit then that is worthwhile but as I've pointed out we can't do it using the same scales.
        [option 3a] So either there will need to be two y scales, one for the cohort and one for the group ( I don't know that I like this).
        [option 3b] Or we should arrange a graph for the group below that for the cohort and positioned so that shapes of the graphs can be compared.

        [option 4] We should not try to show all groups on one graph. A course population of 1,000 translates into 50 tutor groups. And we have much bigger courses.

        I wish to see [option 1]. This is a requirement.
        [option 2] follows readily from [option 1].
        [option 3a/b] would probably be good. But I'd like to see it with reasonable numbers.
        [option 4] should be dismissed. Course staff can already see how tutor groups perform through the Gradebook. If we wish to reproduce this in the quiz reports we should use the same approach i.e. allow course staff to select a group. But this is not a requirement

        Show
        Philip Butcher added a comment - I have to express concern about showing groups on the same graph as we show the whole cohort. For courses where we have large cohorts I do not think that we can show the whole cohort and the group on the same graph with the same axes. For an example let's assume a course with 1,000 students. And the graph broken in 20 ranges each of 5%. Then we might easily imagine that >100 students will be in one of the ranges. Now our tutor groups only have 20 students. Taking the same proportions as above that translates into 2 students in a range. And showing 2 students on the same axis as we show >100 will render the former as almost 'not there'. So I don't want this left as it is. Which raises the question of what we should do. The points are labelled only so that I can refer back to them below. [option 1] Let's be clear that the main purpose of this graph is for course teams to get a pictorial view of how the assessment has performed. That is we are mainly interested in 'Course staff' viewing the graph of the whole cohort. [option 2] Once we have this it is quite OK, and I think helpful, to show that graph to tutors of groups.. If we can easily show tutors where their students sit then that is worthwhile but as I've pointed out we can't do it using the same scales. [option 3a] So either there will need to be two y scales, one for the cohort and one for the group ( I don't know that I like this). [option 3b] Or we should arrange a graph for the group below that for the cohort and positioned so that shapes of the graphs can be compared. [option 4] We should not try to show all groups on one graph. A course population of 1,000 translates into 50 tutor groups. And we have much bigger courses. I wish to see [option 1] . This is a requirement. [option 2] follows readily from [option 1] . [option 3a/b] would probably be good. But I'd like to see it with reasonable numbers. [option 4] should be dismissed. Course staff can already see how tutor groups perform through the Gradebook. If we wish to reproduce this in the quiz reports we should use the same approach i.e. allow course staff to select a group. But this is not a requirement
        Hide
        Philip Butcher added a comment -

        I now see that I should have put my request for 5% ranges (http://tracker.moodle.org/browse/MDL-15953) here.

        Show
        Philip Butcher added a comment - I now see that I should have put my request for 5% ranges ( http://tracker.moodle.org/browse/MDL-15953 ) here.
        Hide
        Philip Butcher added a comment -

        Have now found the re-open link...

        Show
        Philip Butcher added a comment - Have now found the re-open link...
        Hide
        Jamie Pratt added a comment -

        Hi Phil,

        Did you consider changing the scales to percentages. We could them compare the percentage of students in the group to the percentage of students in all of those who took the test who achieve a grade within the grade band ranges? We would not need different y scales then. This would mean though it would be more difficult to see exactly how many students achieve the grade.

        Jamie

        Show
        Jamie Pratt added a comment - Hi Phil, Did you consider changing the scales to percentages. We could them compare the percentage of students in the group to the percentage of students in all of those who took the test who achieve a grade within the grade band ranges? We would not need different y scales then. This would mean though it would be more difficult to see exactly how many students achieve the grade. Jamie
        Hide
        Philip Butcher added a comment -

        No I didn't think of that however I think that the drawback you highlight is important and we shouldstick to showing actual numbers of students.

        Show
        Philip Butcher added a comment - No I didn't think of that however I think that the drawback you highlight is important and we shouldstick to showing actual numbers of students.
        Hide
        Jamie Pratt added a comment - - edited

        Now showing 2 separate graphs in group mode (in HEAD only).

        Show
        Jamie Pratt added a comment - - edited Now showing 2 separate graphs in group mode (in HEAD only).
        Hide
        Philip Butcher added a comment -

        Have now seen these graphs and they're OK but might I suggest that if they were smaller in the y dimension then a tutor could view both the graph for their own group and the overall graph on the same screen. At the moment it's only possible to see one graph at a time. Could we do this to make it fit on a 1280 x 1024 screen?

        Show
        Philip Butcher added a comment - Have now seen these graphs and they're OK but might I suggest that if they were smaller in the y dimension then a tutor could view both the graph for their own group and the overall graph on the same screen. At the moment it's only possible to see one graph at a time. Could we do this to make it fit on a 1280 x 1024 screen?
        Hide
        Ray Lawrence added a comment -

        Would 1024 x 768 be a better target resolution? Still the default in many institutions and organisations.

        Show
        Ray Lawrence added a comment - Would 1024 x 768 be a better target resolution? Still the default in many institutions and organisations.
        Hide
        Philip Butcher added a comment -

        Our major use will be for our exams staff to look at the overall distribution for the whole cohort. So the shape matters as does the numbers of students below the pass threshhold. Here they'll only be using the one graph for all participants. So we don't want to make this too small.

        However I take Ray's point and as there's a computer behind this that knows how many graphs it is going to draw perhaps Jamie can do the scaling on the fly so that either one graph occupies all the 1028 x 768 or if two graphs are to be shown they are scaled so that together they fit onto 1028 x 768.

        Show
        Philip Butcher added a comment - Our major use will be for our exams staff to look at the overall distribution for the whole cohort. So the shape matters as does the numbers of students below the pass threshhold. Here they'll only be using the one graph for all participants. So we don't want to make this too small. However I take Ray's point and as there's a computer behind this that knows how many graphs it is going to draw perhaps Jamie can do the scaling on the fly so that either one graph occupies all the 1028 x 768 or if two graphs are to be shown they are scaled so that together they fit onto 1028 x 768.

          People

          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved: