93312[TASK] Temporarily disable flaky Playwright e2e tests
Commit message
Review
-
Code review CR -1
- Georg Ringer +1
- Oliver Klee +1
- Josua Vogel +1
- Sven Liebert -1
- Benjamin Kott -1
-
Verified V -1
- Georg Ringer +1
- Oliver Klee +1
- Josua Vogel +1
- Sven Liebert -1
- core-ci +1 CI
Issues 1
Files 3
Review log 2830
Show 45 earlier messages
-
Simon Schaufelberger uploaded patch set 1 03/23/26, 10:28
-
Josua Vogel commented on patch set 1 03/23/26, 10:31
Maybe we should use this: https://playwright.dev/docs/api/class-test#test-fixme -
core-ci voted on patch set 1 V +1 03/23/26, 10:36 Core CI is happy: https://git.typo3.org/typo3/CI/cms/-/pipelines/98448
-
Garvin Hicking commented on patch set 1 CR +1 V +1 03/23/26, 10:42
I cant take the gailing -
Simon Schaufelberger uploaded patch set 2
CR +1V +103/23/26, 10:43
-
Simon Schaufelberger commented on patch set 2 03/23/26, 10:44
Reply
great idea! -
Simon Schaufelberger uploaded patch set 3 03/23/26, 10:44
-
Mathias Brodala commented on patch set 3 03/23/26, 11:07
qrcode-module.spec.ts:10You can use test.fixme() before the 1st test to have all tests in this file skipped.bookmark.spec.ts:11See above, this time all testes in this test.describe() block can be skipped with a single test.fixme() -
Simon Schaufelberger commented on patch set 3 03/23/26, 11:14
qrcode-module.spec.ts:10Replybut this will make it easier to enable individual tests again -
Mathias Brodala commented on patch set 3 03/23/26, 11:16
qrcode-module.spec.ts:10ReplySure, also fine with me. Just wanted make sure it was mentioned. -
Simon Schaufelberger commented on patch set 3 03/23/26, 11:17
bookmark.spec.ts:11ReplyDone -
Garvin Hicking voted on patch set 3 CR +1 V +1 03/23/26, 11:20
-
core-ci voted on patch set 3 V +1 03/23/26, 11:22 Core CI is happy: https://git.typo3.org/typo3/CI/cms/-/pipelines/98450
-
Georg Ringer voted on patch set 3 CR +1 V +1 03/23/26, 11:41
-
Josua Vogel voted on patch set 3 CR +1 V +1 03/23/26, 11:46
-
Benjamin Franzke commented on patch set 3 03/23/26, 12:00
open-in-new-window-language-switching.spec.ts:4Hey, `text.fixme` is intended for tests that crash. [1] `test.fail` could be used to denote patches that are expected to fail, but will be run nonetheless. That mean we can see what's going on in the logs, which might be helpful to fix these issues in future. [1] https://playwright.dev/docs/test-annotations#introduction > test.fail() marks the test as failing. Playwright will run this test and ensure it does indeed fail. If the test does not fail, Playwright will complain. > test.fixme() marks the test as failing. Playwright will not run this test, as opposed to the fail annotation. Use fixme when running the test is slow or crashes. -
Josua Vogel commented on patch set 3 03/23/26, 12:03
open-in-new-window-language-switching.spec.ts:4Reply"test.fail() marks the test as failing. Playwright will run this test and ensure it does indeed fail. If the test does not fail, Playwright will complain." I think sometimes the test does not fail, so it will complain -
Benjamin Franzke commented on patch set 3 03/23/26, 12:04
open-in-new-window-language-switching.spec.ts:4Replyyou're right, ack. -
Sven Liebert voted on patch set 3 CR +1 V +1 03/23/26, 13:04
-
Oliver Klee voted on patch set 3 CR +1 V +1 03/23/26, 13:10
-
Benjamin Kott commented on patch set 3 CR -1 03/23/26, 14:01
i prefer this not to be merged, working on stabilization -
Simon Schaufelberger commented on patch set 3 03/23/26, 14:03
Reply
it would have been good to tell us that you do that already last week. -
Simon Praetorius commented on patch set 3 03/23/26, 14:34
Reply
@simonschaufi+typo3@gmail.com There's really no need to be snarky here. Please don't talk to others like that! -
Garvin Hicking commented on patch set 3 03/23/26, 14:48
Reply
I read Benjis statement so that he'll "now start working on it", not "past tense". And I agree with Simon P. This is a frustrating topic and I try to contain myself (with little success), but no ad hominems please. -
Simon Schaufelberger commented on patch set 3 03/23/26, 15:06
Reply
@benjamin.kott@outlook.com ok, let me know if it works out and you are successful. If not, can we use this patch as a temporary "solution" to stabilize the CI? -
Garvin Hicking commented on patch set 3 CR 0 V 0 03/23/26, 15:12
-
Benjamin Kott commented on patch set 3 03/23/26, 16:26
Reply Unresolved
@simonschaufi+typo3@gmail.com i started working on it today. looks promising, pipelines keep green, still have some retries here and then, trying to smooth them out. -
Sven Liebert voted on patch set 3 CR 0 V 0 03/24/26, 06:39
-
Sven Liebert voted on patch set 3 CR -1 V -1 03/24/26, 06:39
-
Garvin Hicking abandoned the change 03/24/26, 09:49