Update to object_store 0.6 and arrow 41#6374
Conversation
| builder = builder.with_token(session_token); | ||
| } | ||
| } else { | ||
| let config = aws_config::from_env().load().await; |
There was a problem hiding this comment.
Unlike before, this now ensures that users get the full coherent configuration experience that they might expect from a CLI tool.
There was a problem hiding this comment.
cc @r4ntix as I think you contributed some of the previous configuration code
|
Waiting for apache/arrow-rs#4251 |
ec53cb3 to
4f24b3f
Compare
4f24b3f to
df5199a
Compare
| ctx.register_listing_table( | ||
| "my_table", | ||
| &format!("file://{testdata}"), | ||
| &format!("file://{testdata}/alltypes_plain.parquet"), |
There was a problem hiding this comment.
This is a nice validation of https://github.com/apache/arrow-rs/issues/4230 being a valuable change. This test was broken, as the lack of a trailing / meant it wouldn't list the directory, and this meant it silently failed to list any files. Schema inference fails on the root directory (correctly) so I changed this to a single file
Which issue does this PR close?
Closes #.
Rationale for this change
The next release of object_store contains a number of breaking changes, lets verify them before cutting the release
What changes are included in this PR?
Are these changes tested?
Are there any user-facing changes?