Uploaded image for project: 'Moodle'
  1. Moodle
  2. MDL-42198

No stable results with a low number of loops (admin/tool/generator/cli/maketestplan)

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.5.2, 2.6
    • Fix Version/s: 2.5.3
    • Component/s: Performance
    • Labels:
    • Testing Instructions:
      Hide
      1. Run php admin/tool/generator/cli/maketestplan.php using --size="M"
      2. Download and open the provided link to a .jmx file
      3. Around ~266-268 line you will see the number of loops (loops) and threads (users), it SHOULD be users=100, loops=5
      Show
      Run php admin/tool/generator/cli/maketestplan.php using --size="M" Download and open the provided link to a .jmx file Around ~266-268 line you will see the number of loops (loops) and threads (users), it SHOULD be users=100, loops=5
    • Affected Branches:
      MOODLE_25_STABLE, MOODLE_26_STABLE
    • Fixed Branches:
      MOODLE_25_STABLE
    • Pull from Repository:
    • Pull Master Branch:
      MDL-42198_master

      Description

      We should get stable results using the default values provided by the test plan, we specified 1 or 2 loops for small plans and this is not enough, from 5 loops we get consistent and stable results across executions of the same branch/hash.

        Attachments

          Activity

            People

            Assignee:
            dmonllao David Monllaó
            Reporter:
            dmonllao David Monllaó
            Peer reviewer:
            Rajesh Taneja
            Integrator:
            Damyon Wiese
            Tester:
            Ankit Agarwal
            Participants:
            Component watchers:
            Matteo Scaramuccia, Andrew Nicols, Jun Pataleta, Michael Hawkins, Shamim Rezaie, Simey Lameze
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:
              Fix Release Date:
              11/Nov/13