Skip to content

Conversation

@correiaafonso12
Copy link
Contributor

@correiaafonso12 correiaafonso12 commented Apr 10, 2025

What this PR changes/adds

Applies a retry mechanism in the DataFlowManagerImpl when processing the Dataflow's COMPLETED and FAILED states

Why it does that

After the data transfer, the DataFlow transitions to either COMPLETED or FAILED depending on whether the transfer succeeded or failed. In either case, the data plane notifies the control plane of the transfer outcome. If this notification fails, the DataFlow transitions to its current state, causing the state machine manager to pick it up again and retry the process. Since there is no limit to the number of retries, this process could potentially continue forever.

Further notes

Check this DR for more information: https://github.com/eclipse-edc/Connector/tree/main/docs/developer/decision-records/2025-03-17-retry-processor-on-dataflow-completion

Who will sponsor this feature?

@ndr-brt

Linked Issue(s)

Relates to #4860

Please be sure to take a look at the contributing guidelines and our etiquette for pull requests.

@paullatzelsperger
Copy link
Member

paullatzelsperger commented Apr 10, 2025

@correiaafonso12 please do not raise dangling PRs. there should be a properly triaged (!) issue accompanying (=linked to) this.

@correiaafonso12
Copy link
Contributor Author

@correiaafonso12 please do not raise dangling PRs. there should be a properly triaged (!) issue accompanying (=linked to) this.

Added the original issue in the description. Omitted it initially as it is already closed due to the PR for the decision record.

@ndr-brt ndr-brt added the bug Something isn't working label Apr 10, 2025
@ndr-brt ndr-brt self-requested a review April 10, 2025 13:20
@ndr-brt
Copy link
Member

ndr-brt commented Apr 10, 2025

@correiaafonso12 you can add me as a PR sponsor in the PR description

@correiaafonso12 correiaafonso12 force-pushed the feature/add-retry-mechanism-on-dataflow-completion branch from 820d0d4 to 163de68 Compare April 10, 2025 14:08
@correiaafonso12 correiaafonso12 force-pushed the feature/add-retry-mechanism-on-dataflow-completion branch from 163de68 to 534ea20 Compare April 10, 2025 14:14
@correiaafonso12 correiaafonso12 requested a review from ndr-brt April 10, 2025 14:16
Copy link
Member

@ndr-brt ndr-brt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ndr-brt ndr-brt merged commit 0d1e87b into eclipse-edc:main Apr 11, 2025
19 checks passed
@correiaafonso12 correiaafonso12 deleted the feature/add-retry-mechanism-on-dataflow-completion branch April 11, 2025 08:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants