Skip to content

Conversation

@oleg68
Copy link
Collaborator

@oleg68 oleg68 commented Feb 4, 2021

Problem statement

I can make a fast consistent copy of a fdb cluster by stopping a DR site and copy all the files from all DR nodes to a new cluster nodes and detach this copy from the primary site.
I can perform a point-in-time recovery from this copy with fdbrestore start --incremental --begin_version XXXXXXX.
But there is no easy way to get a source db version for using with --begin_version option.

Findings

When dr agent runs it executes dr_copy_diff_logs tasks for copying version intervals of the mutation log to the DR database, When the task is executing, it has beginVersion: the version all changes before have been copied.

Proposal

  1. Store beginVersion to the state subspace of system keyspace each time dr_copy_diff_logs executes
  2. Read this version from the state subspace and return as result of fdbdr status

This pull request implements this proposal.

P.S. I'd like to merge it to fdb 6.2. Is it possible?

jzhou77 and others added 30 commits December 9, 2020 16:39
Adding LZ4 to Centos 7 Docker Image: #4147
That's the only place they're needed. This fixes at least the USE_TSAN
build and possibly other sanitizer builds
Set special sanitizer annotations in stacktrace.amalgamation.cpp
…many queue entries are processed without waiting on IO.
Fixed error with Windows CMake Compilation Error
Remove "a/" from tracing keys in special-key-space
Whem the database is not fully replicated to remote, fault tolerance
can be calculated by couting total number of tLogs replicas in primary
and satellite - 1, as we can lose all but one of those, but we were
subtracting 2 instead of 1.
sfc-gh-anoyes and others added 21 commits January 26, 2021 02:21
Add c function fdb_database_force_recovery_with_data_loss
…ride

Apply modernize-use-override to several files
Add CLI argument to print build information
Fix missing override in fdbrpc/FlowTests.actor.cpp
Support Testing S3BlobStore backup in simulation
Add network option to set tracer in fdbclient
…lconnection-read

Improve SimExternalConnection::read performance
@jzhou77 jzhou77 marked this pull request as draft February 8, 2021 21:54
@sfc-gh-etschannen
Copy link
Collaborator

This PR looks good, you are free to rebase it against 6.2

@oleg68 oleg68 changed the base branch from master to release-6.2 February 16, 2021 07:27
@oleg68
Copy link
Collaborator Author

oleg68 commented Feb 16, 2021

Automatic rebase master->6.2 was not successful. So I will close this PR and I will create a new one for 6.2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.