Skip to content

nixos/tests/fluent-bit: add regression test for #395128#395625

Merged
arianvp merged 2 commits intoNixOS:masterfrom
arianvp:regression-test-for-fluent-bit-395128
Apr 7, 2025
Merged

nixos/tests/fluent-bit: add regression test for #395128#395625
arianvp merged 2 commits intoNixOS:masterfrom
arianvp:regression-test-for-fluent-bit-395128

Conversation

@arianvp
Copy link
Member

@arianvp arianvp commented Apr 3, 2025 •
edited
Loading

Things done

I tested that this fails before #395128

machine # [   28.067840] fluent-bit[952]: [2025/04/03 00:48:52] [engine] caught signal (SIGSEGV)
machine # [   28.106852] fluent-bit[952]: #0  0xffffaf69d72f      in  _int_free_create_chunk() at ???:0
machine # [   28.116952] fluent-bit[952]: #1  0xffffaf69ed27      in  _int_free_merge_chunk() at ???:0
machine # [   28.127270] fluent-bit[952]: #2  0xffffaf69ef9b      in  _int_free() at ???:0
machine # [   28.136738] fluent-bit[952]: #3  0xffffaf6a178f      in  __libc_free() at ???:0
machine # [   28.146192] fluent-bit[952]: #4  0xffffaf40cabf      in  ZSTD_freeDCtx() at ???:0
machine # [   28.156682] fluent-bit[952]: #5  0xffffafc7498b      in  decompress_blob_zstd() at ???:0
machine # [   28.166576] fluent-bit[952]: #6  0xffffafbd8e87      in  journal_file_data_payload() at ???:0
machine # [   28.177307] fluent-bit[952]: #7  0xffffafbe80ef      in  sd_journal_enumerate_data() at ???:0
machine # [   28.188252] fluent-bit[952]: #8  0x4ea54f            in  in_systemd_collect() at ???:0
machine # [   28.198918] fluent-bit[952]: #9  0x47bf9f            in  flb_input_collector_fd() at ???:0
machine # [   28.210586] fluent-bit[952]: #10 0x4940eb            in  flb_engine_start() at ???:0
machine # [   28.220750] fluent-bit[952]: #11 0x470c6f            in  flb_lib_worker() at ???:0
machine # [   28.230031] fluent-bit[952]: #12 0xffffaf68f02b      in  start_thread() at ???:0
machine # [   28.239230] fluent-bit[952]: #13 0xffffaf6fe20b      in  thread_start() at ???:0
machine # [   28.249052] fluent-bit[952]: #14 0xffffffffffffffff  in  ???() at ???:0
machine # [   28.266068] systemd-coredump[972]: Process 952 (fluent-bit) of user 61496 terminated abnormally with signal 6/ABRT, processing...
machine # [   28.288362] systemd[1]: Started Process Core Dump (PID 972/UID 0).
machine # [   28.513582] systemd-coredump[973]: Process 952 (fluent-bit) of user 61496 dumped core.
machine # 
machine # Stack trace of thread 956:
machine # #0  0x0000ffffaf690f34 n/a (n/a + 0x0)
machine # #1  0x0000ffffaf690f20 n/a (n/a + 0x0)
machine # #2  0x0000ffffaf63b4dc n/a (n/a + 0x0)
machine # #3  0x0000ffffaf625a00 n/a (n/a + 0x0)
machine # #4  0x000000000046bce0 n/a (n/a + 0x0)
machine # #5  0x0000ffffb061f968 n/a (linux-vdso.so.1 + 0x968)
machine # #6  0x0000ffffaf69d730 n/a (n/a + 0x0)
machine # #7  0x0000ffffaf69d730 n/a (n/a + 0x0)
machine # #8  0x0000ffffaf69ed28 n/a (n/a + 0x0)
machine # #9  0x0000ffffaf69ef9c n/a (n/a + 0x0)
machine # #10 0x0000ffffaf6a1790 n/a (n/a + 0x0)
machine # #11 0x0000ffffaf40cac0 n/a (n/a + 0x0)
machine # #12 0x0000ffffafc7498c n/a (n/a + 0x0)
machine # #13 0x0000ffffafbd8e88 n/a (n/a + 0x0)
machine # #14 0x0000ffffafbe80f0 n/a (n/a + 0x0)
machine # #15 0x00000000004ea550 n/a (n/a + 0x0)
machine # #16 0x000000000047bfa0 n/a (n/a + 0x0)
machine # #17 0x00000000004940ec n/a (n/a + 0x0)
machine # #18 0x0000000000470c70 n/a (n/a + 0x0)
machine # #19 0x0000ffffaf68f02c n/a (n/a + 0x0)
machine # #20 0x0000ffffaf6fe20c n/a (n/a + 0x0)
machine # ELF object binary architecture: AARCH64
machine # 
machine # [   28.693573] systemd[1]: [email protected]: Deactivated successfully.
machine # [   28.729516] systemd[1]: fluent-bit.service: Main process exited, code=dumped, status=6/ABRT
machine # [   28.742001] systemd[1]: fluent-bit.service: Failed with result 'core-dump'.
machine # [   28.870945] systemd[1]: fluent-bit.service: Scheduled restart job, restart counter is at 2.
machine # [   28.893464] systemd[1]: Started Fluent Bit.
machine # [   28.962964] fluent-bit[980]: Fluent Bit v3.2.9
machine # [   28.968636] fluent-bit[980]: * Copyright (C) 2015-2025 The Fluent Bit Authors
machine # [   28.978946] fluent-bit[980]: * Fluent Bit is a CNCF sub-project under the umbrella of Fluentd
machine # [   28.989468] fluent-bit[980]: * https://fluentbit.io
machine # [   28.996160] fluent-bit[980]: ______ _                  _    ______ _ _           _____  _____
machine # [   29.007086] fluent-bit[980]: |  ___| |                | |   | ___ (_) |         |____ |/ __  \
machine # [   29.019023] fluent-bit[980]: | |_  | |_   _  ___ _ __ | |_  | |_/ /_| |_  __   __   / /`' / /'
machine # [   29.031148] fluent-bit[980]: |  _| | | | | |/ _ \ '_ \| __| | ___ \ | __| \ \ / /   \ \  / /
machine # [   29.041992] fluent-bit[980]: | |   | | |_| |  __/ | | | |_  | |_/ / | |_   \ V /.___/ /./ /___
machine # [   29.052712] fluent-bit[980]: \_|   |_|\__,_|\___|_| |_|\__| \____/|_|\__|   \_/ \____(_)_____/
machine # [   29.064138] fluent-bit[980]: [2025/04/03 00:48:52] [ info] [fluent bit] version=3.2.9, commit=, pid=980
machine # [   29.077142] fluent-bit[980]: [2025/04/03 00:48:52] [ info] [storage] ver=1.5.2, type=memory, sync=normal, checksum=off, max_chunks_up=128
machine # [   29.093847] fluent-bit[980]: [2025/04/03 00:48:52] [ info] [simd    ] disabled
machine # [   29.103536] fluent-bit[980]: [2025/04/03 00:48:52] [ info] [cmetrics] version=0.9.9
machine # [   29.113233] fluent-bit[980]: [2025/04/03 00:48:52] [ info] [ctraces ] version=0.6.1
machine # [   29.124265] fluent-bit[980]: [2025/04/03 00:48:52] [ info] [input:systemd:systemd.0] initializing
machine # [   29.134983] fluent-bit[980]: [2025/04/03 00:48:52] [ info] [input:systemd:systemd.0] storage_strategy='memory' (memory only)
machine # [   29.150894] fluent-bit[980]: [2025/04/03 00:48:52] [ info] [sp] stream processor started
machine # [   29.161993] fluent-bit[980]: [2025/04/03 00:48:52] [ info] [output:file:file.0] worker #0 started
machine # [   29.178801] fluent-bit-regression-395128-start[988]: AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA>
machine # [   30.343918] fluent-bit-regression-395128-start[992]: AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA>
machine # [   31.535648] fluent-bit-regression-395128-start[997]: AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA>
machine # [   32.727355] fluent-bit-regression-395128-start[1001]: AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA>
machine # [   33.927041] fluent-bit-regression-395128-start[1005]: AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA>
machine # [   35.119261] fluent-bit-regression-395128-start[1010]: AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA>
machine # [   36.331655] systemd[1]: Finished fluent-bit-regression-395128.service.
machine # [   36.349127] systemd[1]: Startup finished in 5.207s (kernel) + 31.093s (userspace) = 36.300s.
(finished: must succeed: systemctl start fluent-bit-regression-395128.service, in 24.17 seconds)
machine: must succeed: systemctl show -p NRestarts fluent-bit.service | grep -q 'NRestarts=0'
machine: output: 
Test "fluent-bit handles zstd-compressed journal logs" failed with error: "command `systemctl show -p NRestarts fluent-bit.service | grep -q 'NRestarts=0'` failed >
cleanup
kill machine (pid 11)
qemu-system-aarch64: terminating on signal 15 from pid 8 (/nix/store/cxhrrsf7spcgdkrxmlbfzc1bh46rzf7w-python3-3.12.9/bin/python3.12)
kill vlan (pid 9)
(finished: cleanup, in 0.01 seconds)

I tested that it succeeds after #395128

(finished: must succeed: systemctl start fluent-bit-regression-395128.service, in 24.32 seconds)
machine: must succeed: systemctl show -p NRestarts fluent-bit.service | grep -q 'NRestarts=0'
(finished: must succeed: systemctl show -p NRestarts fluent-bit.service | grep -q 'NRestarts=0', in 0.08 seconds)
(finished: subtest: fluent-bit handles zstd-compressed journal logs, in 24.40 seconds)
machine: waiting for file '/var/log/fluent-bit/fluent-bit.out'
(finished: waiting for file '/var/log/fluent-bit/fluent-bit.out', in 0.03 seconds)
(finished: run the VM test script, in 44.98 seconds)
test script finished in 45.06s
cleanup
kill machine (pid 11)
qemu-system-aarch64: terminating on signal 15 from pid 8 (/nix/store/cxhrrsf7spcgdkrxmlbfzc1bh46rzf7w-python3-3.12.9/bin/python3.12)
kill vlan (pid 9)
(finished: cleanup, in 0.03 seconds)
/nix/store/3ib777y832fgr77fba77jd6h7rxxkhnd-vm-test-run-fluent-bit
  • Built on platform(s)
    • x86_64-linux
    • aarch64-linux
    • x86_64-darwin
    • aarch64-darwin
  • For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)
    • sandbox = relaxed
    • sandbox = true
  • Tested, as applicable:
  • Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
  • Tested basic functionality of all binary files (usually in ./result/bin/)
  • 25.05 Release Notes (or backporting 24.11 and 25.05 Release notes)
    • (Package updates) Added a release notes entry if the change is major or breaking
    • (Module updates) Added a release notes entry if the change is significant
    • (Module addition) Added a release notes entry if adding a new NixOS module
  • Fits CONTRIBUTING.md.

Add a 👍 reaction to pull requests you find important.

@arianvp arianvp requested a review from edef1c April 3, 2025 00:50
@github-actions github-actions bot added 6.topic: nixos Issues or PRs affecting NixOS modules, or package usability issues specific to NixOS 10.rebuild-darwin: 0 This PR does not cause any packages to rebuild on Darwin. 10.rebuild-linux: 0 This PR does not cause any packages to rebuild on Linux. labels Apr 3, 2025
@arianvp arianvp marked this pull request as ready for review April 3, 2025 12:14
@arianvp arianvp requested a review from commiterate April 3, 2025 12:33
commiterate
commiterate suggested changes Apr 3, 2025
View reviewed changes
@arianvp arianvp force-pushed the regression-test-for-fluent-bit-395128 branch from 2419e18 to 145cc7f Compare April 4, 2025 11:18
@arianvp arianvp requested a review from commiterate April 4, 2025 11:19
@commiterate
Copy link
Contributor

commiterate commented Apr 4, 2025

@ofborg build nixosTests.fluent-bit

@wegank wegank added the 12.approvals: 1 This PR was reviewed and approved by one person. label Apr 4, 2025
@arianvp arianvp merged commit a7424fe into NixOS:master Apr 7, 2025
30 of 32 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@edef1c edef1c Awaiting requested review from edef1c

1 more reviewer

@commiterate commiterate commiterate approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

6.topic: nixos Issues or PRs affecting NixOS modules, or package usability issues specific to NixOS 10.rebuild-darwin: 0 This PR does not cause any packages to rebuild on Darwin. 10.rebuild-linux: 0 This PR does not cause any packages to rebuild on Linux. 12.approvals: 1 This PR was reviewed and approved by one person.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@arianvp @commiterate @wegank