Skip to content

Avoid killing too many machines if one region is being shared between the remote primary and a satellite #9727

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
sfc-gh-abeamon merged 2 commits into from
Mar 17, 2023
Merged

Avoid killing too many machines if one region is being shared between the remote primary and a satellite #9727

sfc-gh-abeamon merged 2 commits into from
Mar 17, 2023

Conversation

@sfc-gh-abeamon
Copy link
Collaborator

@sfc-gh-abeamon sfc-gh-abeamon commented Mar 16, 2023

This modifies the simulated remote log policy to require more logs, preventing the simulator from killing machines that may be needed by other regions.

Code-Reviewer Section

The general pull request guidelines can be found here.

Please check each of the following things and check all boxes before accepting a PR.

  • The PR has a description, explaining both the problem and the solution.
  • The description mentions which forms of testing were done and the testing seems reasonable.
  • Every function/class/actor that was touched is reasonably well documented.

For Release-Branches

If this PR is made against a release-branch, please also check the following:

  • This change/bugfix is a cherry-pick from the next younger branch (younger release-branch or main if this is the youngest branch)
  • There is a good reason why this PR needs to go into a release branch and this reason is documented (either in the description above or in a linked GitHub issue)

@sfc-gh-abeamon
If one region is being shared between the remote primary and a satell…
75b8148 
…ite, the simulator could kill too many machines
@foundationdb-ci
Copy link
Contributor

foundationdb-ci commented Mar 16, 2023

Result of foundationdb-pr-clang-ide on Linux CentOS 7

  • Commit ID: 75b8148
  • Duration 0:15:00
  • Result: ✅ SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@fdb-windows-ci
Copy link
Collaborator

fdb-windows-ci commented Mar 16, 2023

Doxense CI Report for Windows 10

@foundationdb-ci
Copy link
Contributor

foundationdb-ci commented Mar 16, 2023

Result of foundationdb-pr-clang on Linux CentOS 7

  • Commit ID: 75b8148
  • Duration 0:38:00
  • Result: ✅ SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Contributor

foundationdb-ci commented Mar 16, 2023

Result of foundationdb-pr on Linux CentOS 7

  • Commit ID: 75b8148
  • Duration 0:46:22
  • Result: ❌ FAILED
  • Error: Error while executing command: if python3 -m joshua.joshua list --stopped | grep ${ENSEMBLE_ID} | grep -q 'pass=10[0-9][0-9][0-9]'; then echo PASS; else echo FAIL && exit 1; fi. Reason: exit status 1
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Contributor

foundationdb-ci commented Mar 16, 2023

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: 75b8148
  • Duration 1:19:42
  • Result: ✅ SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)
  • Cluster Test Logs zip file of the test logs (available for 30 days)

@sfc-gh-abeamon
Fix check that excludes satellites from consideration to consider sat…
6818ce9 
…elliteTLogReplicationFactor and satelliteTLogUsableDcs. Update trace event with more info about the updated policy.
@foundationdb-ci
Copy link
Contributor

foundationdb-ci commented Mar 16, 2023

Result of foundationdb-pr-clang-ide on Linux CentOS 7

  • Commit ID: 6818ce9
  • Duration 0:16:11
  • Result: ✅ SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@sfc-gh-abeamon sfc-gh-abeamon marked this pull request as ready for review March 16, 2023 21:54
@foundationdb-ci
Copy link
Contributor

foundationdb-ci commented Mar 16, 2023

Result of foundationdb-pr-clang on Linux CentOS 7

  • Commit ID: 6818ce9
  • Duration 0:37:41
  • Result: ✅ SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Contributor

foundationdb-ci commented Mar 16, 2023

Result of foundationdb-pr on Linux CentOS 7

  • Commit ID: 6818ce9
  • Duration 0:39:46
  • Result: ❌ FAILED
  • Error: Error while executing command: if python3 -m joshua.joshua list --stopped | grep ${ENSEMBLE_ID} | grep -q 'pass=10[0-9][0-9][0-9]'; then echo PASS; else echo FAIL && exit 1; fi. Reason: exit status 1
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Contributor

foundationdb-ci commented Mar 16, 2023

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: 6818ce9
  • Duration 1:21:30
  • Result: ❌ FAILED
  • Error: Error while executing command: if $fail_test; then exit 1; fi. Reason: exit status 1
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)
  • Cluster Test Logs zip file of the test logs (available for 30 days)

@fdb-windows-ci
Copy link
Collaborator

fdb-windows-ci commented Mar 16, 2023

Doxense CI Report for Windows 10

@foundationdb-ci
Copy link
Contributor

foundationdb-ci commented Mar 16, 2023

Result of foundationdb-pr-clang-ide on Linux CentOS 7

  • Commit ID: 6818ce9
  • Duration 0:16:47
  • Result: ✅ SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Contributor

foundationdb-ci commented Mar 16, 2023

Result of foundationdb-pr-clang on Linux CentOS 7

  • Commit ID: 6818ce9
  • Duration 0:55:26
  • Result: ✅ SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Contributor

foundationdb-ci commented Mar 16, 2023

Result of foundationdb-pr on Linux CentOS 7

  • Commit ID: 6818ce9
  • Duration 1:03:09
  • Result: ❌ FAILED
  • Error: Error while executing command: if python3 -m joshua.joshua list --stopped | grep ${ENSEMBLE_ID} | grep -q 'pass=10[0-9][0-9][0-9]'; then echo PASS; else echo FAIL && exit 1; fi. Reason: exit status 1
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Contributor

foundationdb-ci commented Mar 17, 2023

Result of foundationdb-pr-clang-ide on Linux CentOS 7

  • Commit ID: 6818ce9
  • Duration 0:14:20
  • Result: ✅ SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Contributor

foundationdb-ci commented Mar 17, 2023

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: 6818ce9
  • Duration 1:26:13
  • Result: ✅ SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)
  • Cluster Test Logs zip file of the test logs (available for 30 days)

@foundationdb-ci
Copy link
Contributor

foundationdb-ci commented Mar 17, 2023

Result of foundationdb-pr-macos-m1 on macOS Ventura 13.x

  • Commit ID: 6818ce9
  • Duration 0:29:07
  • Result: ✅ SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Contributor

foundationdb-ci commented Mar 17, 2023

Result of foundationdb-pr on Linux CentOS 7

  • Commit ID: 6818ce9
  • Duration 0:50:19
  • Result: ✅ SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@foundationdb-ci
Copy link
Contributor

foundationdb-ci commented Mar 17, 2023

Result of foundationdb-pr-clang on Linux CentOS 7

  • Commit ID: 6818ce9
  • Duration 0:51:38
  • Result: ✅ SUCCEEDED
  • Error: N/A
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)

@sfc-gh-abeamon sfc-gh-abeamon merged commit aeaedb1 into apple:main Mar 17, 2023
@sfc-gh-abeamon sfc-gh-abeamon mentioned this pull request Mar 17, 2023
Merged
5 tasks
@foundationdb-ci
Copy link
Contributor

foundationdb-ci commented Mar 17, 2023

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

  • Commit ID: 6818ce9
  • Duration 1:18:33
  • Result: ❌ FAILED
  • Error: Error while executing command: if $fail_test; then exit 1; fi. Reason: exit status 1
  • Build Log terminal output (available for 30 days)
  • Build Workspace zip file of the working directory (available for 30 days)
  • Cluster Test Logs zip file of the test logs (available for 30 days)

@jzhou77 jzhou77 mentioned this pull request Mar 17, 2023
Merged
18 tasks
@sfc-gh-abeamon sfc-gh-abeamon deleted the fix-shared-remote-region-kills branch March 28, 2023 22:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@sfc-gh-etschannen sfc-gh-etschannen sfc-gh-etschannen approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@sfc-gh-abeamon @foundationdb-ci @fdb-windows-ci @sfc-gh-etschannen