Review main Merged

51713[TASK] Run acceptance tests in parallel

Tymoteusz Motylewski CR +2 V +2 Normal +98 −0 updated 02/17/17, 00:44

Commit message

Provide script for generating files with acceptance tests groups
to allow running them in parallel on different hosts. Very useful
for bamboo.

Usage:

Generating 5 dynamic group files:
./components/testing_framework/Resources/Core/Build/Scripts/splitAcceptanceTests.sh 5

Run tests of group 1:
./bin/codecept run Acceptance -g AcceptanceTests-Job-1 -c ...

Note group numbers start from 1, not 0.

Review

  • Code review CR +2
    • Christian Kuhn +2
  • Verified V +2
    • Christian Kuhn +2
    • TYPO3com +1 CI

Issues 1

Files 2

Review log 1016

  1. Tymoteusz Motylewski uploaded patch set 1 02/15/17, 21:51

  2. TYPO3com voted on patch set 1 V +1 02/15/17, 21:57 Completed build in 05m 09s on Wed, 15 Feb, 10:56 PM Test Summary: 56289 passed Find logs and detail information at https://bamboo.typo3.com/browse/CORE-GTC-8122

  3. Tymoteusz Motylewski uploaded patch set 2 02/15/17, 22:36

  4. Tymoteusz Motylewski updated the commit message in patch set 3 02/15/17, 22:40

  5. TYPO3com voted on patch set 2 V +1 02/15/17, 22:42 Completed build in 05m 30s on Wed, 15 Feb, 11:42 PM Test Summary: 56289 passed Find logs and detail information at https://bamboo.typo3.com/browse/CORE-GTC-8127

  6. TYPO3com voted on patch set 3 V +1 02/15/17, 22:45 Completed build in 04m 55s on Wed, 15 Feb, 11:45 PM Test Summary: 56289 passed Find logs and detail information at https://bamboo.typo3.com/browse/CORE-GTC-8128

  7. Mona Muzaffar uploaded patch set 4 02/16/17, 15:09

  8. TYPO3com voted on patch set 4 V +1 02/16/17, 15:15 Completed build in 06m 12s on Thu, 16 Feb, 04:15 PM Test Summary: 56289 passed Find logs and detail information at https://bamboo.typo3.com/browse/CORE-GTC-8152

  9. Mona Muzaffar commented on patch set 4 02/16/17, 15:17

    rebased (changed namespace https://review.typo3.org/#/c/51715)
  10. Tymoteusz Motylewski updated the commit message in patch set 5 02/16/17, 16:32

  11. TYPO3com voted on patch set 5 V +1 02/16/17, 16:37 Completed build in 05m 04s on Thu, 16 Feb, 05:37 PM Test Summary: 56289 passed Find logs and detail information at https://bamboo.typo3.com/browse/CORE-GTC-8157

  12. Christian Kuhn uploaded patch set 6 02/17/17, 00:30

  13. Christian Kuhn commented on patch set 6 02/17/17, 00:31

    cosmetical changes only.
  14. TYPO3com voted on patch set 6 V +1 02/17/17, 00:36 Completed build in 06m 08s on Fri, 17 Feb, 01:36 AM Test Summary: 56289 passed Find logs and detail information at https://bamboo.typo3.com/browse/CORE-GTC-8185

  15. Christian Kuhn commented on patch set 6 CR +2 V +2 02/17/17, 00:43

    works like a charm! i executed the whole suite once, then used the split script, then compared the number of tests executed by 'full-run' and 'only-parts': same result. since this is no code change directly and more a maintenance script, i'll merge that right away now. next steps: split one of the big Cest files into multiple files to reach a more even share of tests, then setup bamboo to use this script. great work! thank you tymek! cool solution with the group based splitting. that is more elegant that what the functional splitter does.
  16. Gerrit merged patch set 6 02/17/17, 00:44