Skip to content

Use Min, Max, and NumOfNulls from Manifest Files for Spark Column Stats #10791

@huaxingao

Description

@huaxingao

Feature Request / Improvement

I am adding Spark Column Stats in this pull request. Currently, in this PR, I only populate the NDV values. I plan to follow up with another PR that will retrieve the min, max, and numOfNulls values from the manifest files and use these to populate the Spark Column Stats.

Query engine

Spark

Metadata

Metadata

Assignees

No one assigned

    Labels

    improvementPR that improves existing functionalitystale

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions