Skip to content

Unable to serialize and deserialize scans using ArrowFormat #16874

Closed

Description

@colinmarc

Describe the bug

It's not in the list here:

"Error converting file format, {:?} is invalid as a datafusion format.",

To Reproduce

Serialize and then deserialize the following plan:

SessionContext::new()
  .read_arrow(path.to_str().unwrap(), Default::default())
  .await?
Error: Internal error: Error converting file format, ArrowFormat is invalid as a datafusion format..
This was likely caused by a bug in DataFusion's code and we would welcome that you file an bug report in our issue tracker

Expected behavior

No response

Additional context

No response

Activity

  1. colinmarc commented on Jul 23, 2025

    @colinmarc
    ContributorAuthor

    Sorry, I failed to include the bit that was throwing the error. This is after round-tripping through protobuf.

  2. added a commit that references this issue on Jul 23, 2025
    112898a
  3. changed the title [-]Unable to read from ArrowFormat[/-] [+]Unable to serialize and deserialize scans using ArrowFormat[/+] on Jul 23, 2025
  4. added a commit that references this issue on Jul 26, 2025
    5e0b2d0
  5. added a commit that references this issue on Jul 28, 2025
    19d8e1f
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions