✗ checking tls: cipher list - rsa intermediate [25151]
(from function `assert_success' in file test/test_helper/bats-assert/src/assert.bash, line 114,
from function `compare_cipherlist' in file test/security_tls_cipherlists.bats, line 164,
from function `check_cipherlists' in file test/security_tls_cipherlists.bats, line 176,
from function `check_ports' in file test/security_tls_cipherlists.bats, line 90,
in test file test/security_tls_cipherlists.bats, line 47)
`check_ports 'rsa' 'intermediate'' failed with status 5
[ TASKLOG ] mail.example.test is up and running
-- command failed --
status : 5
output : jq: error (at /tmp/results/rsa/intermediate/port_25.json:14): Cannot iterate over null (null)
--
tls_test_cipherlists
✗ checking tls: cipher list - rsa modern [22107]
(from function `assert_success' in file test/test_helper/bats-assert/src/assert.bash, line 114,
from function `compare_cipherlist' in file test/security_tls_cipherlists.bats, line 164,
from function `check_cipherlists' in file test/security_tls_cipherlists.bats, line 179,
from function `check_ports' in file test/security_tls_cipherlists.bats, line 90,
in test file test/security_tls_cipherlists.bats, line 51)
`check_ports 'rsa' 'modern'' failed with status 5
[ TASKLOG ] mail.example.test is up and running
-- command failed --
status : 5
output : jq: error (at /tmp/results/rsa/modern/port_25.json:14): Cannot iterate over null (null)
--
tls_test_cipherlists
✗ checking tls: cipher list - ecdsa intermediate [22167]
(from function `assert_success' in file test/test_helper/bats-assert/src/assert.bash, line 114,
from function `compare_cipherlist' in file test/security_tls_cipherlists.bats, line 164,
from function `check_cipherlists' in file test/security_tls_cipherlists.bats, line 176,
from function `check_ports' in file test/security_tls_cipherlists.bats, line 90,
in test file test/security_tls_cipherlists.bats, line 55)
`check_ports 'ecdsa' 'intermediate'' failed with status 5
[ TASKLOG ] mail.example.test is up and running
-- command failed --
status : 5
output : jq: error (at /tmp/results/ecdsa/intermediate/port_25.json:14): Cannot iterate over null (null)
--
tls_test_cipherlists
✓ checking tls: cipher list - ecdsa modern [24607]
✗ checking tls: cipher list - ecdsa intermediate, with rsa fallback [29217]
(from function `assert_success' in file test/test_helper/bats-assert/src/assert.bash, line 114,
from function `compare_cipherlist' in file test/security_tls_cipherlists.bats, line 164,
from function `check_cipherlists' in file test/security_tls_cipherlists.bats, line 176,
from function `check_ports' in file test/security_tls_cipherlists.bats, line 90,
in test file test/security_tls_cipherlists.bats, line 66)
`check_ports 'ecdsa' 'intermediate' 'rsa'' failed with status 5
[ TASKLOG ] mail.example.test is up and running
-- command failed --
status : 5
output : jq: error (at /tmp/results/ecdsa_rsa/intermediate/port_25.json:14): Cannot iterate over null (null)
--
tls_test_cipherlists
I see a lot of these lines
ok 240 first # skip This version natively supports setup/teardown_file. Does this mean, the dummy tests can be removed?When running the tests locally, some of them are always failing:
Details
I use this to run the tests on my debian 11 host:
git clone --recurse-submodules https://github.com/docker-mailserver/docker-mailserver dms cd dms make allAny idea, why these tests fail locally?
docker stop -t 0ordocker rm -f:docker-mailserver/test/mail_hostname.bats
Lines 180 to 198 in f7465a5