Commit graph

55 commits

Author SHA1 Message Date
a039be4581 move sorting stuff 2023-12-02 14:34:39 +01:00
06ff6449c3 shorter code 2023-12-02 14:31:18 +01:00
5541e7a88a add test script for dependency resolving algorithm 2023-12-02 13:47:00 +01:00
1eabe31e9e other way of importing the fixtures, not sure if better 2023-12-02 13:45:04 +01:00
37062ad502 add pytest arguments to make pytest usable for testing the actual code base 2023-12-02 13:44:43 +01:00
2e7e2c0fb2 make it a package 2023-12-02 13:44:04 +01:00
361c92a3df remove prints 2023-12-02 13:43:54 +01:00
0fe5fa5536 move function 2023-12-01 20:32:00 +01:00
dad9d297ab add sorting algorithm 2023-12-01 20:24:38 +01:00
23184d82bc enable -v 2023-12-01 17:25:21 +01:00
3a69366cc7 rename log file 2023-12-01 15:13:37 +01:00
d6941824cd put logging file into /records 2023-12-01 15:13:06 +01:00
b62adc0c2a add comment 2023-12-01 15:09:45 +01:00
010b1187c0 add codegen 2023-11-30 23:08:00 +01:00
99e7800792 rename test functions to setup_ 2023-11-30 19:31:46 +01:00
c9cb39d375 cleanup 2023-11-30 19:30:59 +01:00
ec748398fb also discover functions as tests that have setup_ naming 2023-11-30 19:30:24 +01:00
cd824c2bf2 small dir improvements 2023-11-30 19:21:46 +01:00
a8b4302805 add prototype 2023-11-30 19:16:03 +01:00
f5d31ebc75 remove old setup 2023-11-30 19:04:37 +01:00
4af494e047 custom timeout for expect in failing test 2023-11-30 19:02:36 +01:00
0d76754ece change global timeout 2023-11-30 18:58:56 +01:00
aa442a7f0c remove unused plugin 2023-11-30 18:50:26 +01:00
d96927ae02 fix references 2023-11-30 18:48:22 +01:00
21dd190fb3 use new authentik fixture name 2023-11-30 18:43:53 +01:00
3e142a7593 import all authentik fixtures 2023-11-30 18:42:27 +01:00
add21a694e rename more authentik fixtures 2023-11-30 18:42:15 +01:00
5d3743962f add global timeout settings 2023-11-30 18:25:58 +01:00
636c39d557 remove timeout and locale to replace with global timeout 2023-11-30 18:25:41 +01:00
565903f304 fix _dependencies_passed 2023-11-30 18:22:30 +01:00
58303c55ca turn warning into f-string 2023-11-30 18:10:04 +01:00
19f44f3028 remove assert in _dependencies_passed, because it crashes the coordinator. instead, just skip the test with a warning 2023-11-30 17:50:02 +01:00
e446102912 increase timeout 2023-11-30 17:44:05 +01:00
ab202afc87 add pytest-html 2023-11-30 17:41:47 +01:00
8c5b1dab94 add playwright install 2023-11-30 16:49:18 +01:00
dbbbd3a43d improve readme 2023-11-30 16:34:31 +01:00
466acbd760 disable localization test 2023-11-30 13:13:30 +01:00
60f281db95 add fixtures to wordpress conftest 2023-11-30 12:26:59 +01:00
ab295d815a add wordpress setup 2023-11-30 12:26:39 +01:00
6cfca22168 simplify vars 2023-11-30 12:25:35 +01:00
827827b962 rename authentik context json files 2023-11-30 12:22:19 +01:00
641d89438b add authentik_user_page 2023-11-30 12:21:27 +01:00
2394d2fd9b typo 2023-11-30 12:00:53 +01:00
d29e8102e9 add RunnerNextcloud 2023-11-30 11:58:23 +01:00
1b3396baf4 add make_url util function 2023-11-30 11:49:31 +01:00
f270f3d4a9 disable cleanup for now, unclear what it does 2023-11-30 11:47:55 +01:00
ca974d9024 WIP: add nextcloud tests 2023-11-30 11:42:52 +01:00
cb6544f5aa add cleanup routine to runner and coordinator 2023-11-30 11:16:43 +01:00
2e33f8f014 make-all-env-files-available (#4)
Before, a test had only access to it's own env file / configuration (wordpress could see wordpress env file). Now, all env files are available. Wordpress test can also read authentik env file, for example to get the authentik domain.

Reviewed-on: local-it-infrastructure/e2e_tests#4
Co-authored-by: Daniel <d.brummerloh@gmail.com>
Co-committed-by: Daniel <d.brummerloh@gmail.com>
2023-11-30 10:53:20 +01:00
8172f685de rework-output-and-test-logic (#3)
* fix flakey tests in authentik / wordpress

* make it possible to rerun tests partially -> passed will be skipped, failed will be repeated

* improve organization of all outputs (moving, renaming, keeping multiple versions etc.)

* add html reports, replace .txt tracebacks

* combine all html reports into one

* add demo runner with comments for documentation purposes

Reviewed-on: local-it-infrastructure/e2e_tests#3
Co-authored-by: Daniel <d.brummerloh@gmail.com>
Co-committed-by: Daniel <d.brummerloh@gmail.com>
2023-11-29 14:14:46 +01:00