You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 4e7a1c6
Browse filesBrowse the repository at this point in the historyBrowse files
[fix](iceberg) Fix some issues in batch mode (apache#51185)
### What problem does this PR solve?
Problem Summary:
1. When adding splits to the queue, a retry mechanism is added to
prevent blocking and sticking.
2. We use a separate thread to fetch splits. When the SQL execution ends
early (such as `limit`), this thread needs to be handled. Now it is
exited by throwing an exception. Moreover, this thread should use an
independent thread pool to prevent system freezes caused by resource
contention.
3. When there are multiple exceptions, overwriting would occur
previously. Now we use `addSuppressed` to prevent exception loss.
4. When initializing the split assignment, a timeout mechanism is added
to prevent the situation where the system gets stuck due to failing to
obtain splits.
5. When the split assignment stop, if an exception is not null, an
exception should be thrown externally.
(cherry picked from commit f6d6041)
0 commit comments