Repository navigation
Commit 7deed96
[MINOR][SS] Use filterNot in HDFSBackedStateStoreProvider snapshot filtering
### What changes were proposed in this pull request?
Replaces `filter(_.isSnapshot == false)` with the equivalent, idiomatic `filterNot(_.isSnapshot)` in `HDFSBackedStateStoreProvider.doSnapshot`.
### Why are the changes needed?
`StoreFile.isSnapshot` is a plain `Boolean` field, so comparing it to `false` is redundant. `filterNot` is the idiomatic form used throughout Spark and reads more clearly.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Behavior-preserving one-line change; existing state-store tests cover the path. No new tests needed.
### Was this patch authored or co-authored using generative AI tooling?
Generated-by: Claude Code (Opus 4.8)
Closes #57519 from uros-b/cleanup-hdfs-state-filternot.
Lead-authored-by: Uros Bojanic <[email protected]>
Co-authored-by: Uros Bojanic <[email protected]>
Signed-off-by: Uros Bojanic <[email protected]>
(cherry picked from commit fd31694)
Signed-off-by: Uros Bojanic <[email protected]>1 parent af68ad7 commit 7deed96
1 file changed
Lines changed: 1 addition & 1 deletion
File tree
- sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1092 | 1092 | | |
1093 | 1093 | | |
1094 | 1094 | | |
1095 | | - | |
| 1095 | + | |
1096 | 1096 | | |
1097 | 1097 | | |
1098 | 1098 | | |
| |||
0 commit comments