Repository navigation
Commit c97b60e
fix: use Hadoop Path when parsing input file URIs in native Delta scan
CometScanRule.nativeDeltaScan validates filesystem schemes by constructing
`new java.net.URI(f)` over raw `inputFiles` strings. Any path containing
characters invalid in a raw URI (unescaped `%`, spaces, etc.) threw
URISyntaxException during plan rewrite, silently degrading Comet's
native Delta scan.
Surfaced by running Delta's own test suite with Comet enabled: Delta
injects `test%file%prefix-` into test filenames, but the same class of
failure would hit real users with `%` or spaces in their S3 object keys.
Use `new org.apache.hadoop.fs.Path(f).toUri` instead — Path handles URI
escaping correctly.
Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>1 parent 64e1f3e commit c97b60e
1 file changed
Lines changed: 6 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
26 | 26 | | |
27 | 27 | | |
28 | 28 | | |
| 29 | + | |
29 | 30 | | |
30 | 31 | | |
31 | 32 | | |
| |||
402 | 403 | | |
403 | 404 | | |
404 | 405 | | |
| 406 | + | |
| 407 | + | |
| 408 | + | |
| 409 | + | |
405 | 410 | | |
406 | | - | |
| 411 | + | |
407 | 412 | | |
408 | 413 | | |
409 | 414 | | |
| |||
0 commit comments