Repository navigation
Finish the Life Cycle of Large Binaries #4123
Description
clearExecutionResources unconditionally calls LargeBinaryManager.deleteAllObjects(), which deletes all large-binary objects in the shared texera-large-binaries bucket even though the method is intended to clean up resources for a single execution eid. This means any user action that triggers cleanup for one workflow execution can erase all other users’ large-binary data, violating tenant isolation and causing global data loss. Instead of a bucket-wide wipe, track the specific LargeBinary URIs associated with the given eid and delete only those objects; reserve any global deleteAllObjects call for tightly controlled, admin-only maintenance flows, if needed at all.
Impact / Priority
(P2)Medium – useful enhancement
Affected Area
Storage / Metadata
Activity
feat: Python Support for Large Binary (#4100)
feat: Python Support for Large Binary (apache#4100)
feat: eid-scoped large binary create + per-execution delete (apache#4123
feat: add executionId to InitializeExecutorRequest (apache#4123)
feat: send executionId to workers on executor init (apache#4123)
feat: set large-binary execution context on JVM worker init (apache#4123
fix: scope execution cleanup to the execution's large binaries (apach…
fix: scope deleteWorkflow large-binary cleanup to its executions (apa…
refactor: remove unused bucket-wide deleteAllObjects (apache#4123)
feat: eid-scoped large binary create on Python worker (apache#4123)
fix: make Python large-binary execution-context guard fail-fast (apac…
refactor: hold large-binary execution id in a dedicated worker holder (…
refactor: read large-binary execution id through a getter (apache#4123)
refactor: encapsulate large-binary state in a LargeBinaryManager class (
test: cover create() in the MinIO-free LargeBinaryManager unit spec (a…
refactor: make Python LargeBinaryManager a __new__-guarded singleton (a…
test: guard the LargeBinaryManager singleton invariant (apache#4123)
refactor: let the controller name large-binary locations (apache#4123)
fix: address review comments on large-binary lifecycle (apache#4123)
fix: make InitializeExecutorRequest.executionId required via no_box (a…
fix: scope large binary storage and cleanup by execution id (apache#5280
fix: scope large binary storage and cleanup by execution id (#5280) […
fix: scope large binary storage and cleanup by execution id (apache#5280
feat: Python Support for Large Binary (apache#4100)
fix: scope large binary storage and cleanup by execution id (apache#5280