Skip to content

Read temporal values from JSON #38

Closed

Description

@alamb

Note: migrated from original JIRA: https://issues.apache.org/jira/browse/ARROW-4803

Ability to parse strings that look like timestamps to timestamp type. Need to consider whether only timestamp type should be supported as most JSON libraries stick to ISO8601. It might also be inefficient to use regex for timestamps, so the user should provide a hint of which columns to convert to timestamps

Activity

  1. sum12 commented on Jan 6, 2022

    @sum12
    Contributor

    It seems the behavior here is not consistent. TemporalValues can get parsed to u64 if they look like u64 otherwise it is a null, but only while dealing with build_struct_array whereas for build_nested_list_array an error is returned.

    It could be done as done in csv_reader with regex and extra strings describing possible formats. Or we could have parser as closures (eg : Fn(String) -> Type)) stored in the reader/decoder(/Schema?)

  2. sum12 commented on Jan 10, 2022

    @sum12
    Contributor

    @alamb I would like to take a stab at this one (if it is still relevant)
    Thanks for looking :-)

  3. alamb commented on Jan 10, 2022

    @alamb
    ContributorAuthor

    As @nevi-me filed the original ticket, he may have some additional context. Thanks @sum12 !

  4. tustvold commented on Mar 16, 2023

    @tustvold
    Contributor

    Closed by #3835 with further support in #3845

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    arrowChanges to the arrow crate

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions