Uploaded image for project: 'Moodle'
  1. Moodle
  2. MDL-55986

Recent problems with parallel behat runs under Windows

    XMLWordPrintable

    Details

    • Testing Instructions:
      Hide
      Run unit test admin/tool/behat/tests/manager_util_test.php
      Manual test
      1. Initialize behat for parallel run php admin/tool/behat/cli/init.php -j=2
      2. Check both behat.yml files and ensure they have all the core features
      3. run behat with --tags=@mod_workshop and ensure behat.yml is not modified.
      4. Initialize behat for parallel run with optimize tags php admin/tool/behat/cli/init.php -j=2 --optimize-runs=@mod_assign
      5. Check both behat.yml and ensure features containing mod_assign are split in both behat.yml files and contains rest of the core features.
      6. run behat with --tags=@mod_workshop and ensure behat.yml is not modified.

      Run test on windows as well.

      Show
      Run unit test admin/tool/behat/tests/manager_util_test.php Manual test Initialize behat for parallel run php admin/tool/behat/cli/init.php -j=2 Check both behat.yml files and ensure they have all the core features run behat with --tags=@mod_workshop and ensure behat.yml is not modified. Initialize behat for parallel run with optimize tags php admin/tool/behat/cli/init.php -j=2 --optimize-runs=@mod_assign Check both behat.yml and ensure features containing mod_assign are split in both behat.yml files and contains rest of the core features. run behat with --tags=@mod_workshop and ensure behat.yml is not modified. Run test on windows as well.
    • Affected Branches:
      MOODLE_32_STABLE
    • Fixed Branches:
      MOODLE_32_STABLE
    • Pull Master Branch:
      wip-mdl-55986

      Description

      Hi,

      I was trying to prepare some new Windows boxes (VMs) here for testing and have detected some incorrect behaviors that I think were not present some months ago. Here are the details:

      0) Install a parallel=2 environment: php admin/tool/behat/cli/init.php --parallel=2

      1) PROBEM1: Multiple tags combination not working:

      • If I execute php admin/tool/behat/cli/run.php --tags='@mod_assign&&~@javascript' I get No scenarios/no steps.
      • In Mac, I get 2 scenarios executed (have not confirmed if that's correct).
      • Reproducible both under CMD and git bash in Windows.

      2) PROBLEM 2: Progress outputs nothing:

      • If I execute php admin/tool/behat/cli/run.php --tags='~@javascript' the processes are launched (I can see apache/database/php working) but nothing is shown on screen. Neither run information, neither progress dots. At the end (2h later) the errors and the final summary is shown, but not the progress info.
      • In Mac, I get 2XX scenarios executed and progress show correctly.
      • Reproducible with git bash.
      • With CMD I get the same behavior than problem 1, aka, "No scenarios".

      So, something is behaving badly. Just guessing if it maybe caused by all the recent changes affecting DIRECTORY_SEPARATOR, PHP_EOL and similar stuff. But right now those parallel runs in Windows are not reliable.

      Note I've not been able to confirm the behavior in previous versions, still I don't have my environment here ready for that.

      Ciao

        Attachments

          Issue Links

            Activity

              People

              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:
                  Fix Release Date:
                  5/Dec/16