local-it/e2e_tests
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

rework-output-and-test-logic #3

Merged
dan merged 2 commits from rework-output-and-test-logic into dev 2023-11-29 14:14:48 +01:00
Conversation 0 Commits 2 Files changed 24 +588 -418
dan commented 2023-11-29 14:14:32 +01:00
Collaborator
Copy link

  • fix flakey tests in authentik / wordpress

  • make it possible to rerun tests partially -> passed will be skipped, failed will be repeated

  • improve organization of all outputs (moving, renaming, keeping multiple versions etc.)

  • add html reports, replace .txt tracebacks

  • combine all html reports into one

  • add demo runner with comments for documentation purposes

* fix flakey tests in authentik / wordpress * make it possible to rerun tests partially -> passed will be skipped, failed will be repeated * improve organization of all outputs (moving, renaming, keeping multiple versions etc.) * add html reports, replace .txt tracebacks * combine all html reports into one * add demo runner with comments for documentation purposes
dan added 2 commits 2023-11-29 14:14:34 +01:00 
set correct work dir for docker image

fix check_if_user_exists by adding wait time to is_visible

implement the wait with playwright functions

cleanup

add locale for testing

add WIP argument only_run_failed

make progress output more fine grained

improve docstring

save tracebacks to records

add check to look for already passed tests to skip those

remove progress dir

put the actual class in runner dependencies, fix _check_dependencies_finished

cleanup

work on wordpress test

add loguru

add logger and html report

add test helper to skip tests if required

remove old file

add demo test with explanation

make name and test_dir_name required

cleanup

add demo Runner with documentation

improve doc

fix arguments in _create_result_file

use _run_test_if_required in run_tests

add prevent skip

set timeout

save traces to RECORDS

add doc

include setup_demo

wip

rename authentic fixtures

should work

reomve

remove localization stuff

remove dummy test

use config in condition

put html reports in their own dir inside records

add beautifulsoup4

initial commit

add combine_html

cleanup

improve doc string

more logging, cleanup

cleanup

fixup

remove only_run_failed

add comment

move traces to their own dir and move them after test

improve depenency check

add parse_env_files

enable all

rename wrapper to coordinator

remove Protocol

create DIR in init

make _parse_env_files private

make coordinator instance available in runner

handle env files via dict objects

remove trace dir after collect_traces

rename html report

Revert "make coordinator instance available in runner"

This reverts commit a17402ed319da98518f8bb8ed8eca462299657a1.

add todo

add _copy_env_files

log tests finished

collect_traces saves each trace with unique dir name via enumeration

remove traceback hook as same information is available in html report

improve logging
dan merged commit 8172f685de into dev 2023-11-29 14:14:48 +01:00
dan referenced this pull request from a commit 2023-11-29 14:14:48 +01:00
rework-output-and-test-logic (#3)
dan deleted branch rework-output-and-test-logic 2023-11-29 14:14:52 +01:00
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: local-it/e2e_tests#3
No description provided.
Delete branch "rework-output-and-test-logic"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?