Skip to content

Tracking Issue: Arrow/Polars based data engine #376

@jondo2010

Description

@jondo2010

Primary goal: end-to-end point cloud logging to 3D scene, with a functional and fast query engine that has the desired interface.

Sub-issues:

Things we can work on in parallel now:

  • Arrow data store
  • Python SDK
  • Rust SDK

Things we can work on once the Arrow data store is done

  • Data UI
  • Table UI
  • Scene population

Arrow data store

For the arrow data store (and query engine), follow https://www.notion.so/rerunio/Arrow-Table-Design-cd77528c77ae4aa4a8c566e2ec29f84f. We can probably work in parallel on the main table and on the batching.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions