Skip to content

[python] skip obs axis read-back when appending known unique observations to Experiment#4108

Merged
bkmartinjr merged 2 commits intomainfrom
bkm/soma-259-obs-readback
Jun 10, 2025
Merged

[python] skip obs axis read-back when appending known unique observations to Experiment#4108
bkmartinjr merged 2 commits intomainfrom
bkm/soma-259-obs-readback

Conversation

@bkmartinjr
Copy link
Copy Markdown
Member

Issue and/or context:

Ingest (from_anndata/from_h5ad) will filter duplicate obs and var IDs as part of appending new data. In the case where the obs axis is a priori known to contain only unique IDs, this filter step can be bypassed, for a performance win. This builds upon the previous change to register_{anndatas,h5ads} which introduced the allow_duplicate_obs_ids parameter.

Fixes SOMA-259

@codecov
Copy link
Copy Markdown

codecov Bot commented Jun 5, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 89.38%. Comparing base (e2135d0) to head (33e1d72).
Report is 7 commits behind head on main.

Additional details and impacted files
@@             Coverage Diff             @@
##             main    #4108       +/-   ##
===========================================
+ Coverage   65.90%   89.38%   +23.48%     
===========================================
  Files         158       59       -99     
  Lines       21000     7087    -13913     
  Branches     1239        0     -1239     
===========================================
- Hits        13839     6335     -7504     
+ Misses       6748      752     -5996     
+ Partials      413        0      -413     
Flag Coverage Δ
libtiledbsoma ?
python 89.38% <100.00%> (-0.03%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Components Coverage Δ
python_api 89.38% <100.00%> (-0.03%) ⬇️
libtiledbsoma ∅ <ø> (∅)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@bkmartinjr bkmartinjr marked this pull request as ready for review June 5, 2025 21:01
@bkmartinjr bkmartinjr requested review from jp-dark and ktsitsi June 5, 2025 22:45
@bkmartinjr bkmartinjr merged commit 17ba473 into main Jun 10, 2025
19 checks passed
@bkmartinjr bkmartinjr deleted the bkm/soma-259-obs-readback branch June 10, 2025 16:10
github-actions Bot pushed a commit that referenced this pull request Jun 10, 2025
…ions to Experiment (#4108)

* skip obs axis read-back when appending known unique observations to Experiment

* add change log entry
jp-dark added a commit that referenced this pull request Jun 11, 2025
…ions to Experiment (#4108) (#4116)

* skip obs axis read-back when appending known unique observations to Experiment

* add change log entry

Co-authored-by: Bruce Martin <[email protected]>
Co-authored-by: Julia Dark <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants