Unhealthy Tests
Feb 21 - Feb 27
These are the top 20 most flaky test cases using data from the selected week's test sessions. Learn more
| Rank | Testcase | Flakiness Score | Total Duration |
|---|---|---|---|
1 | test_ping_no_environment_variables tests.utils.test_db_connection.PingTest-20210629062321 tests/utils/test_db_connection.py | 1.00 0.02 | 1,666.67 min / week 833.33 |
2 | test_ping_with_environment_variables tests.utils.test_db_connection.PingTest-20210629062321 tests/utils/test_db_connection.py | 0.98 0.12 | 1,125.00 min / week 416.67 |
3 | test_container_build_latest_image tests.utils.test_container_build.ContainerBuildTest-20210629062321 tests/utils/test_container_build.py | 0.95 0.05 | 666.67 min / week -50.00 |
4 | test_container_build_fixed_version_image tests.utils.test_container_build.ContainerBuildTest-20210629062321 tests/utils/test_container_build.py | 0.80 0.20 | 350.00 min / week 8.33 |
5 | test_async_event_routing tests.utils.test_event_router.AsyncRouterTest-20210629062321 tests/utils/test_event_router.py | 0.78 | 100.00 min / week |
Sometimes tests that always pass and never fail can take up a lot of execution time and effort to maintain while not providing much value. It's worth thinking about whether each test is really worth the time it takes to run. You might find that you can run these tests less often.Learn more
| Rank | Testcase | Runs | Total Duration |
|---|---|---|---|
1 | test_get_org_workspace_no_environment_variables tests.utils.test_authentication.AuthenticationTest-20210629062321 tests/utils/test_authentication.py | 100 | 1,666.67 min / week |
2 | test_subset tests.test_runners.test_minitest.MinitestTest-20210702100111 tests/test_runners/test_minitest.py | 90 | 1,125.00 min / week |
3 | test_authentication_headers_empty tests.utils.test_authentication.AuthenticationTest-20210629062321 tests/utils/test_authentication.py | 80 | 666.67 min / week |
4 | test_subset tests.test_runners.test_nunit.NUnitTest-20210629062321 tests/test_runners/test_nunit.py | 70 | 350.00 min / week |
5 | test_record_test tests.test_runners.test_nunit.NUnitTest-20210702100111 tests/test_runners/test_nunit.py | 60 | 100.00 min / week |
Slow tests are like gunk that builds up in your engine. Over time they slow down your CI cycle.Learn more
| Rank | Testcase | Runs | Average Duration | Total Duration |
|---|---|---|---|---|
1 | test_get_org_workspace_no_environment_variables tests.utils.test_authentication.AuthenticationTest-20210629062321 tests/utils/test_authentication.py | 100 | 16.67 min | 1,666.67 min |
2 | test_subset tests.test_runners.test_minitest.MinitestTest-20210702100111 tests/test_runners/test_minitest.py | 90 | 12.50 min | 1,125.00 min |
3 | test_authentication_headers_empty tests.utils.test_authentication.AuthenticationTest-20210629062321 tests/utils/test_authentication.py | 80 | 8.33 min | 666.67 min |
4 | test_subset tests.test_runners.test_nunit.NUnitTest-20210629062321 tests/test_runners/test_nunit.py | 70 | 5.00 min | 350.00 min |
5 | test_record_test tests.test_runners.test_nunit.NUnitTest-20210702100111 tests/test_runners/test_nunit.py | 60 | 1.67 min | 100.00 min |
Tests that fail too often are suspicious. Perhaps they are flaky. Perhaps they are fragile / high maintenance. Perhaps they are testing too many things in one shot.Learn more
| Rank | Testcase | Runs | Failure Rate |
|---|---|---|---|
1 | test_get_org_workspace_no_environment_variables tests.utils.test_authentication.AuthenticationTest-20210629062321 tests/utils/test_authentication.py | 100 | 0.69 |
2 | test_subset tests.test_runners.test_minitest.MinitestTest-20210702100111 tests/test_runners/test_minitest.py | 90 | 0.50 |
3 | test_authentication_headers_empty tests.utils.test_authentication.AuthenticationTest-20210629062321 tests/utils/test_authentication.py | 80 | 0.42 |
4 | test_subset tests.test_runners.test_nunit.NUnitTest-20210629062321 tests/test_runners/test_nunit.py | 70 | 0.36 |
5 | test_record_test tests.test_runners.test_nunit.NUnitTest-20210702100111 tests/test_runners/test_nunit.py | 60 | 0.29 |