Skip to content

Comments

Provide Arrow Schema Hint to Parquet Reader#5671

Closed
Lordworms wants to merge 1 commit intoapache:masterfrom
Lordworms:issue_5657
Closed

Provide Arrow Schema Hint to Parquet Reader#5671
Lordworms wants to merge 1 commit intoapache:masterfrom
Lordworms:issue_5657

Conversation

@Lordworms
Copy link
Contributor

@Lordworms Lordworms commented Apr 20, 2024

Which issue does this PR close?

Closes #5657

Rationale for this change

What changes are included in this PR?

Are there any user-facing changes?

@Lordworms
Copy link
Contributor Author

seems like the integration process has some problem


// used for <https://github.com/apache/arrow-rs/pull/5605> we should decide what two different
// Datatype could be reinterpret
pub fn can_reinterpret(from_type: &DataType, to_type: &DataType) -> bool {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This appears to be duplicating the existing logic for schema jnference using the arrow schema as a hint, I'm not sure why we need this?

@alamb
Copy link
Contributor

alamb commented Jun 30, 2024

FYI there is another alternative idea here: #5939 which looks promising

@tustvold
Copy link
Contributor

tustvold commented Jul 2, 2024

Closed by #5939

@tustvold tustvold closed this Jul 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Provide Arrow Schema Hint to Parquet Reader

3 participants