Skip to content

qa/multisite: add extra checkpoints in datalog_autotrim testcase#60591

Merged
smanjara merged 1 commit intoceph:mainfrom
smanjara:wip-datalog-autotrim
Dec 3, 2024
Merged

qa/multisite: add extra checkpoints in datalog_autotrim testcase#60591
smanjara merged 1 commit intoceph:mainfrom
smanjara:wip-datalog-autotrim

Conversation

@smanjara
Copy link
Contributor

@smanjara smanjara commented Nov 1, 2024

https://tracker.ceph.com/issues/67207

Contribution Guidelines

  • To sign and title your commits, please refer to Submitting Patches to Ceph.

  • If you are submitting a fix for a stable branch (e.g. "quincy"), please refer to Submitting Patches to Ceph - Backports for the proper workflow.

  • When filling out the below checklist, you may click boxes directly in the GitHub web UI. When entering or editing the entire PR message in the GitHub web UI editor, you may also select a checklist item by adding an x between the brackets: [x]. Spaces and capitalization matter when checking off items this way.

Checklist

  • Tracker (select at least one)
    • References tracker ticket
    • Very recent bug; references commit where it was introduced
    • New feature (ticket optional)
    • Doc update (no ticket needed)
    • Code cleanup (no ticket needed)
  • Component impact
    • Affects Dashboard, opened tracker ticket
    • Affects Orchestrator, opened tracker ticket
    • No impact that needs to be tracked
  • Documentation (select at least one)
    • Updates relevant documentation
    • No doc update is appropriate
  • Tests (select at least one)
Show available Jenkins commands
  • jenkins retest this please
  • jenkins test classic perf
  • jenkins test crimson perf
  • jenkins test signed
  • jenkins test make check
  • jenkins test make check arm64
  • jenkins test submodules
  • jenkins test dashboard
  • jenkins test dashboard cephadm
  • jenkins test api
  • jenkins test docs
  • jenkins render docs
  • jenkins test ceph-volume all
  • jenkins test ceph-volume tox
  • jenkins test windows
  • jenkins test rook e2e

@smanjara smanjara requested a review from a team as a code owner November 1, 2024 23:44
@smanjara smanjara requested a review from cbodley November 1, 2024 23:44
@smanjara
Copy link
Contributor Author

smanjara commented Nov 1, 2024

we may have datalog entries being written simultaneously with datalog trim running. at this point, there might still be some datalog entries having their timestamp lower than the datalog status marker timestamp which may not get cleared. for a brief duration sometimes the sync status can show as caught up while they are still processing shards. in the test, we rely on data sync checkpoint before issuing trim to tell us if sync is caught up. I have added a second data checkpoint call including delay timer and a bucket sync checkpoint. hopefully that should give us enough time to ensure that we are fully in sync atleast for the workload we test in multisite suite.

I understand that the error may not occur during every run which is why I ran quite a few jobs to make sure the fix is working. they all pass test_datalog_autotrim() test case.

https://pulpito.ceph.com/smanjara-2024-11-01_22:42:15-rgw:multisite-main-distro-default-smithi/7977125/
https://pulpito.ceph.com/smanjara-2024-11-01_22:41:58-rgw:multisite-main-distro-default-smithi/7977122/
https://pulpito.ceph.com/smanjara-2024-11-01_22:41:46-rgw:multisite-main-distro-default-smithi/7977119/
https://pulpito.ceph.com/smanjara-2024-11-01_22:41:31-rgw:multisite-main-distro-default-smithi/7977116/

@smanjara
Copy link
Contributor Author

smanjara commented Nov 5, 2024

jenkins test make check

1 similar comment
@smanjara
Copy link
Contributor Author

jenkins test make check

@cbodley
Copy link
Contributor

cbodley commented Nov 21, 2024

jenkins test api

@cbodley
Copy link
Contributor

cbodley commented Nov 21, 2024

jenkins test make check

@smanjara
Copy link
Contributor Author

smanjara commented Dec 2, 2024

jenkins test api

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants