Uploaded image for project: 'Moodle'
  1. Moodle
  2. MDL-71108

Failing behat scenarios after upgrading to Chrome 89 and up

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 3.9.5, 3.10.2, 3.11, 4.0
    • Fix Version/s: None
    • Labels:
      None
    • Affected Branches:
      MOODLE_310_STABLE, MOODLE_311_STABLE, MOODLE_39_STABLE, MOODLE_400_STABLE

      Description

      We were impatiently waiting for Chrome 89 (selenium image) to be available and, some hours ago, it finally was created.

      So, in https://github.com/moodlehq/moodle-ci-runner/pull/51 we unpinned the old Chrome 79 we were using and switched to Chrome 89 for all the CI infrastructure (~10h ago).

      Since then, some scenarios, previously passing have started to fail, more or less consistently. Details follow, common point is that all them seem to fail with a "element has zero size" error.

      Add and configure small quiz and perform an attempt as a student with Javascript enabled

      • It only happens if you run the tests headless (current default for CI jobs). Consistently.
      • Reproducible 100% locally.
      • Link: https://ci.moodle.org/job/W.03.05%20-%20Behat%20-%20Chrome%20+%20Oracle/816/ (ignore the other failure it's already tracked).

        001 Scenario: Add and configure small quiz and perform an attempt as a student with Javascript enabled # /var/www/html/mod/quiz/tests/behat/add_quiz.feature:44
              And I log out                                                                                    # /var/www/html/mod/quiz/tests/behat/add_quiz.feature:31
                element not interactable: element has zero size
                  (Session info: headless chrome=89.0.4389.82) (Facebook\WebDriver\Exception\ElementNotInteractableException)
        

      Natural aggregation from the setup screen

      • It happens both headless and normal runs (and not always!)
      • Passing locally (tried 5 times).
      • Link: https://ci.moodle.org/job/S310.03.01%20-%20Behat%20-%20Chrome%20+%20Postgres/48/

        001 Scenario: Natural aggregation from the setup screen              # /var/www/html/grade/tests/behat/grade_aggregation.feature:451
              And I set the field "Override weight of Sub category 1" to "1" # /var/www/html/grade/tests/behat/grade_aggregation.feature:477
                element not interactable: element has zero size
                  (Session info: chrome=89.0.4389.82) (Facebook\WebDriver\Exception\ElementNotInteractableException)
        

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              Unassigned Unassigned
              Reporter:
              stronk7 Eloy Lafuente (stronk7)
              Participants:
              Component watchers:
              Andrew Lyons, Dongsheng Cai, Huong Nguyen, Jun Pataleta, Michael Hawkins, Shamim Rezaie, Simey Lameze
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated: