Commit graph

46 commits

Author SHA1 Message Date
23184d82bc enable -v 2023-12-01 17:25:21 +01:00
3a69366cc7 rename log file 2023-12-01 15:13:37 +01:00
d6941824cd put logging file into /records 2023-12-01 15:13:06 +01:00
b62adc0c2a add comment 2023-12-01 15:09:45 +01:00
010b1187c0 add codegen 2023-11-30 23:08:00 +01:00
99e7800792 rename test functions to setup_ 2023-11-30 19:31:46 +01:00
c9cb39d375 cleanup 2023-11-30 19:30:59 +01:00
ec748398fb also discover functions as tests that have setup_ naming 2023-11-30 19:30:24 +01:00
cd824c2bf2 small dir improvements 2023-11-30 19:21:46 +01:00
a8b4302805 add prototype 2023-11-30 19:16:03 +01:00
f5d31ebc75 remove old setup 2023-11-30 19:04:37 +01:00
4af494e047 custom timeout for expect in failing test 2023-11-30 19:02:36 +01:00
0d76754ece change global timeout 2023-11-30 18:58:56 +01:00
aa442a7f0c remove unused plugin 2023-11-30 18:50:26 +01:00
d96927ae02 fix references 2023-11-30 18:48:22 +01:00
21dd190fb3 use new authentik fixture name 2023-11-30 18:43:53 +01:00
3e142a7593 import all authentik fixtures 2023-11-30 18:42:27 +01:00
add21a694e rename more authentik fixtures 2023-11-30 18:42:15 +01:00
5d3743962f add global timeout settings 2023-11-30 18:25:58 +01:00
636c39d557 remove timeout and locale to replace with global timeout 2023-11-30 18:25:41 +01:00
565903f304 fix _dependencies_passed 2023-11-30 18:22:30 +01:00
58303c55ca turn warning into f-string 2023-11-30 18:10:04 +01:00
19f44f3028 remove assert in _dependencies_passed, because it crashes the coordinator. instead, just skip the test with a warning 2023-11-30 17:50:02 +01:00
e446102912 increase timeout 2023-11-30 17:44:05 +01:00
ab202afc87 add pytest-html 2023-11-30 17:41:47 +01:00
8c5b1dab94 add playwright install 2023-11-30 16:49:18 +01:00
dbbbd3a43d improve readme 2023-11-30 16:34:31 +01:00
466acbd760 disable localization test 2023-11-30 13:13:30 +01:00
60f281db95 add fixtures to wordpress conftest 2023-11-30 12:26:59 +01:00
ab295d815a add wordpress setup 2023-11-30 12:26:39 +01:00
6cfca22168 simplify vars 2023-11-30 12:25:35 +01:00
827827b962 rename authentik context json files 2023-11-30 12:22:19 +01:00
641d89438b add authentik_user_page 2023-11-30 12:21:27 +01:00
2394d2fd9b typo 2023-11-30 12:00:53 +01:00
d29e8102e9 add RunnerNextcloud 2023-11-30 11:58:23 +01:00
1b3396baf4 add make_url util function 2023-11-30 11:49:31 +01:00
f270f3d4a9 disable cleanup for now, unclear what it does 2023-11-30 11:47:55 +01:00
ca974d9024 WIP: add nextcloud tests 2023-11-30 11:42:52 +01:00
cb6544f5aa add cleanup routine to runner and coordinator 2023-11-30 11:16:43 +01:00
2e33f8f014 make-all-env-files-available (#4)
Before, a test had only access to it's own env file / configuration (wordpress could see wordpress env file). Now, all env files are available. Wordpress test can also read authentik env file, for example to get the authentik domain.

Reviewed-on: local-it-infrastructure/e2e_tests#4
Co-authored-by: Daniel <d.brummerloh@gmail.com>
Co-committed-by: Daniel <d.brummerloh@gmail.com>
2023-11-30 10:53:20 +01:00
8172f685de rework-output-and-test-logic (#3)
* fix flakey tests in authentik / wordpress

* make it possible to rerun tests partially -> passed will be skipped, failed will be repeated

* improve organization of all outputs (moving, renaming, keeping multiple versions etc.)

* add html reports, replace .txt tracebacks

* combine all html reports into one

* add demo runner with comments for documentation purposes

Reviewed-on: local-it-infrastructure/e2e_tests#3
Co-authored-by: Daniel <d.brummerloh@gmail.com>
Co-committed-by: Daniel <d.brummerloh@gmail.com>
2023-11-29 14:14:46 +01:00
d2cd6ba47f authentik setup and tracing (#2)
* authentik sessions created successfully during setup without breaking tracing

* setup works on EN and DE localization by using regex patterns

* automated tracing with pytest --trace option, manual hook no longer needed

Reviewed-on: local-it-infrastructure/e2e_tests#2
Co-authored-by: Daniel <d.brummerloh@gmail.com>
Co-committed-by: Daniel <d.brummerloh@gmail.com>
2023-11-27 17:01:45 +01:00
97ed87c79f [WIP] Add new automated test framework (#1)
Co-authored-by: Daniel <d.brummerloh@gmail.com>
Co-committed-by: Daniel <d.brummerloh@gmail.com>
2023-11-22 21:40:13 +01:00
859bd57006 test framework 2023-07-07 03:38:10 +02:00
5961516536 add config 2023-06-15 22:22:58 +02:00
6ec9b5df50 init 2023-06-15 21:53:12 +02:00