Skip to content

[BUG] Weird but semi-consistent test failures #2966

@georglauterbach

Description

@georglauterbach

Miscellaneous first checks

  • I checked that all ports are open and not blocked by my ISP / hosting provider.
  • I know that SSL errors are likely the result of a wrong setup on the user side and not caused by DMS itself. I'm confident my setup is correct.

Affected Component(s)

CI

What happened and when does this occur?

Not sure when it started exactly, but as of now, serial tests in `test/tests/serial/tests.bats` do not run (sometimes), because the setup procedure fails.

What did you expect to happen?

I expected the tests to succeed as there is nothing that should prevent them from succeeding.

How do we replicate the issue?

1. Open a PR
2. Watch how the tests for this PR fail sporadically

or

1. Merge a PR
2. Watch how the tests on `master` fail

DMS version

v11.3.1

What operating system is DMS running on?

Linux

Which operating system version?

Ubuntu 22.04

What instruction set architecture is DMS running on?

AMD64 / x86_64

What container orchestration tool are you using?

Docker

docker-compose.yml

N/A

Relevant log output

not ok 212 setup_file failed
# (from function `repeat_until_success_or_timeout' in file test/test_helper/common.bash, line 43,
#  from function `wait_until_change_detection_event_completes' in file test/test_helper/common.bash, line 208,
#  from function `setup_file' in test file test/tests/serial/tests.bats, line 50)
#   `wait_until_change_detection_event_completes mail' failed
# 8d7ce2717447a5b330bc24466c6b6b3110fff825af10b80fbc0248287fa3372d
# [   INF   ]  mail.my-domain.com is up and running
# Timed out on command: __is_changedetector_processing
# mail
# bats warning: Executed 212 instead of expected 309 tests
make: *** [Makefile:52: tests/serial] Error 1
Error: Process completed with exit code 2.

Other relevant information

An example failure can be seen via the following link: https://github.com/docker-mailserver/docker-mailserver/actions/runs/3789635420/jobs/6443579882#step:5:219

What level of experience do you have with Docker and mail servers?

  • I am inexperienced with docker
  • I am rather experienced with docker
  • I am inexperienced with mail servers
  • I am rather experienced with mail servers
  • I am uncomfortable with the CLI
  • I am rather comfortable with the CLI

Code of conduct

Improvements to this form?

No response

Metadata

Metadata

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions