Skip to content

Feature: Make ListView canonical#4853

Closed
connortsui20 wants to merge 2 commits intodevelopfrom
ct/list-view-canonicalize
Closed

Feature: Make ListView canonical#4853
connortsui20 wants to merge 2 commits intodevelopfrom
ct/list-view-canonicalize

Conversation

@connortsui20
Copy link
Contributor

TODO

@connortsui20 connortsui20 added the changelog/feature A new feature label Oct 6, 2025
@codspeed-hq
Copy link

codspeed-hq bot commented Oct 6, 2025

CodSpeed Performance Report

Merging #4853 will not alter performance

Comparing ct/list-view-canonicalize (14d849a) with develop (7e72d35)

Summary

✅ 1168 untouched

Adds a `ListViewShape` type to track whether list view data has sorted
offsets, overlapping views, or gaps. This enables faster rebuilding and
identifies when a `ListView` can be efficiently converted to a regular
`List` array.

Signed-off-by: Connor Tsui <[email protected]>
@connortsui20
Copy link
Contributor Author

Since we're not merging #4830 and this PR is based on top of that, I'm just going to close this and fix all the conflicts with develop next week so I don't have to keep rebasing

connortsui20 added a commit that referenced this pull request Oct 16, 2025
Tracking Issue: #4699

Revived from: #4853 and
#4830

This PR makes `ListViewArray` the canonical encoding of `DType::List`,
which used to be `ListArray`.

We will probably have a large regression in term of performance for now,
but that can be improved in the future.

---------

Signed-off-by: Connor Tsui <[email protected]>
@connortsui20 connortsui20 deleted the ct/list-view-canonicalize branch October 16, 2025 18:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants