80389[TASK] Remove implicit wait timeout from acceptance tests
Commit message
Review
-
Code review CR 0
-
Verified V 0
Issues 1
Files 11
- typo3/sysext/core/Tests/Acceptance/Application/FileList/FileClipboardCest.php+6 −4
- typo3/sysext/core/Tests/Acceptance/Application/FormEngine/ElementsGroupCest.php+1 −0
- typo3/sysext/core/Tests/Acceptance/Application/Frontend/ContentElementsCest.php4+11 −1
- typo3/sysext/core/Tests/Acceptance/Application/InstallTool/EnvironmentCest.php+3 −2
- typo3/sysext/core/Tests/Acceptance/Application/InstallTool/LoginCest.php+4 −0
- typo3/sysext/core/Tests/Acceptance/Application/InstallTool/MaintenanceCest.php+6 −5
- typo3/sysext/core/Tests/Acceptance/Application/InstallTool/SettingsCest.php+2 −0
- typo3/sysext/core/Tests/Acceptance/Application/InstallTool/UpgradeCest.php+8 −1
- typo3/sysext/core/Tests/Acceptance/Application/Topbar/SearchCest.php+4 −0
- typo3/sysext/core/Tests/Acceptance/Application.suite.yml+2 −2
- typo3/sysext/core/Tests/Acceptance/Install.suite.yml+2 −2
Review log 1117
-
Benjamin Franzke uploaded patch set 1 08/04/23, 11:24
-
core-ci voted on patch set 1 V -1 08/04/23, 11:36 Core CI is not happy: https://git.typo3.org/typo3/CI/cms/-/pipelines/45050
-
Benjamin Franzke uploaded patch set 2
V -108/07/23, 19:43 -
core-ci voted on patch set 2 V -1 08/07/23, 19:54 Core CI is not happy: https://git.typo3.org/typo3/CI/cms/-/pipelines/45201
-
Tymoteusz Motylewski commented on patch set 2 08/07/23, 20:54
-
Benjamin Franzke uploaded patch set 3
V -108/08/23, 02:55 -
core-ci voted on patch set 3 V -1 08/08/23, 03:06 Core CI is not happy: https://git.typo3.org/typo3/CI/cms/-/pipelines/45210
-
Benjamin Franzke uploaded patch set 4
V -108/08/23, 03:42 -
core-ci voted on patch set 4 V +1 08/08/23, 03:48 Core CI is happy: https://git.typo3.org/typo3/CI/cms/-/pipelines/45212
-
Benjamin Franzke commented on patch set 4 08/08/23, 04:12
ContentElementsCest.php:45ReplyThanks for your insight. I agree that could be an alternative, but: There are two reasons why I wanted to try this change: a) It seems most TYPO3 developers (that I talked to) did not actually know that there is an implicit wait configured/happending all over the place, so they couldn't understand, why test fail from time to time. (It took me hours to find about that myself and others never did and often added TODOs/comments that showcased, that codeception was a magic blackbox, which caused some wild guessing workarounds in code, often simply adding 2seconds of timeouts, which then succeed by luck but actually didn't change anything, as the replicated the implicit timeout) b) It don't think it is obvious, which locators perform implicit wait, and which not. Seems like one would actually need to have a cheat-sheet open all the time, that lists the implicit wait scenarios. Please see the documentation. https://codeception.com/docs/AcceptanceTests#smartwait Like $I->see('Hello, Davert'); // DISABLED, Not a locator Now you say this one implicitly waits: $I->see('TYPO3 Styleguide Frontend', '.content'); Cool, so `see()` becomes an implicit waiter when gloal wait *AND* a second parameter is supplied. This is hard to understand for those that do not work with codeception on a daily basis. So, I think, with playwright, where implict wait actually checks for things we need (like "can it receive events, or do I need to wait until it is no longer oscured by another element") and is builtin and not an afterthought, we would proably be fine with the automagic, but with codeception I'd propose this one, in order to be able to migrate to other tools from a very explicit set of tests. (There were some ideas, and I think this helps in case anyone wants to try out migrating, without having to figure out, why certain tests worked in codeception and do not when migrating). -
Benjamin Franzke updated the commit message in patch set 5
V +108/08/23, 08:11 -
core-ci voted on patch set 5 V -1 08/08/23, 08:21 Core CI is not happy: https://git.typo3.org/typo3/CI/cms/-/pipelines/45222
-
Benjamin Franzke uploaded patch set 6
V -108/08/23, 09:23 -
core-ci voted on patch set 6 V -1 08/08/23, 09:35 Core CI is not happy: https://git.typo3.org/typo3/CI/cms/-/pipelines/45228
-
Christian Kuhn commented on patch set 6 08/08/23, 09:59
ContentElementsCest.php:45ReplyAgree with Benjamin: The implicit wait is a black box nobody understands. We should get rid of it and instead plaster our tests with explicit waitForX() things, which we're doing at tons of places already, anyways. The fact that the implicit wait kick in only "sometimes" just adds confusion and does not help us. +1 for the patch approach. And yes, we need to have stable codeception tests before we walk away from it - there is some progress, we'll see what happens next weeks. -
Tymoteusz Motylewski commented on patch set 6 08/08/23, 10:47
ContentElementsCest.php:45ReplyThanks Benjamin for explanation, now I see the issue - the smart wait is only working when selector is passed. I'm ok with the change. Anyway, are there plans to use sth more modern like cypress or playwright? I saw Benji did some poc https://review.typo3.org/c/Packages/TYPO3.CMS/+/75520 -
Benjamin Franzke abandoned the change 02/12/24, 12:46
abandoned for the time being
ContentElementsCest.php:45