Repository navigation
Commit fd31694
[MINOR][SS] Use filterNot in HDFSBackedStateStoreProvider snapshot filtering
### What changes were proposed in this pull request?
Replaces `filter(_.isSnapshot == false)` with the equivalent, idiomatic `filterNot(_.isSnapshot)` in `HDFSBackedStateStoreProvider.doSnapshot`.
### Why are the changes needed?
`StoreFile.isSnapshot` is a plain `Boolean` field, so comparing it to `false` is redundant. `filterNot` is the idiomatic form used throughout Spark and reads more clearly.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Behavior-preserving one-line change; existing state-store tests cover the path. No new tests needed.
### Was this patch authored or co-authored using generative AI tooling?
Generated-by: Claude Code (Opus 4.8)
Closes #57519 from uros-b/cleanup-hdfs-state-filternot.
Lead-authored-by: Uros Bojanic <[email protected]>
Co-authored-by: Uros Bojanic <[email protected]>
Signed-off-by: Uros Bojanic <[email protected]>1 parent ced139f commit fd31694
1 file changed
Lines changed: 1 addition & 1 deletion
File tree
- sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1077 | 1077 | | |
1078 | 1078 | | |
1079 | 1079 | | |
1080 | | - | |
| 1080 | + | |
1081 | 1081 | | |
1082 | 1082 | | |
1083 | 1083 | | |
| |||
0 commit comments