feat: Optional nameless pre-computed vectors with a schema fingerprint by chandlerok · Pull Request #7077 · feast-dev/feast

chandlerok · 2026-10-26T23:19:14Z

What this PR does / why we need it:

Adds an opt-in precompute_omit_names on FeatureService. Vectors written for such a service carry values, per-view timestamps, and a fingerprint of the service's ordered <fv>__<feature> names instead of the repeated name list. The fast path validates a nameless vector by fingerprint and takes its names from the service. Vectors with names keep working as before, and a vector whose fingerprint does not match the service falls through to the existing mismatch handling.

Measured on a 90-feature service, Feast 0.67.0, Redis store:

	bytes per entity	bytes read for 500 entities
pre-computed vector, with names (today)	4773 B, 3774 B of it names	2.4 MB
pre-computed vector, `precompute_omit_names=True`	834 B	414 KB
per-view HMGET of the same 90 features (what the vector replaces)	n/a	550 KB

The names are identical for every entity, so today the single-read path moves 4x the bytes of the per-view path it replaces.

Proto changes: FeatureServiceSpec.precompute_omit_names and PrecomputedFeatureVector.schema_fingerprint, both additive. Generated code is from grpcio-tools 1.62.3 (protobuf 4.25) and mypy-protobuf 3.3.0 so the diff against the checked-in files is only the new fields.

Stacked on #7076; the first two commits are that PR.

Which issue(s) this PR fixes:

Fixes #7075

Checks

I've made sure the tests are passing.
My commits are signed off (git commit -s)
My PR title follows conventional commits format

Testing Strategy

Unit tests
Integration tests
Manual tests
Testing is not required for this change

New unit tests: nameless vector matches and reorders by fingerprint, stale fingerprint falls back, nameless vector without a service falls back, flag round-trips through proto, fingerprint follows feature order. test_precomputed_feature_vectors.py and local_feast_tests/test_feature_service.py pass locally.

Misc

@ntkathole

🤖 Generated with Claude Code

precompute_feature_service accepts entity_keys and skips the keyspace scan when they are given. The push hook now passes the distinct entity keys from the pushed DataFrame instead of rebuilding every entity in the store. Signed-off-by: Chandler King <[email protected]> Co-Authored-By: Claude Fable 5.1 <[email protected]>

Stored vectors carry "<fv>__<feature>" names while the default request expects bare feature names, so the fast path always reported a schema mismatch unless full_feature_names=True. Compare on the caller's naming and derive the per-feature view name from the stored names for TTL checks. Signed-off-by: Chandler King <[email protected]> Co-Authored-By: Claude Fable 5.1 <[email protected]>

A pre-computed vector stores the full repeated feature name list next to its values. For a wide service that is most of the blob: 90 features came to 4.8 KB per entity, 3.8 KB of it names that are identical for every entity. FeatureService gains precompute_omit_names. Vectors written for such a service carry only values, per-view timestamps, and a fingerprint of the service's ordered names. The fast path validates a nameless vector by fingerprint and takes its names from the service. Vectors with names keep working as before. With the flag on the same blob is 834 bytes, and a 500-entity read moves 414 KB instead of 2.4 MB. Generated code is from grpcio-tools 1.62.3 (protobuf 4.25) and mypy-protobuf 3.3.0 to match the checked-in files. Signed-off-by: Chandler King <[email protected]> Co-Authored-By: Claude Fable 5.1 <[email protected]>

codecov-commenter · 2026-10-26T23:33:19Z

⚠️ Please install the to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

❌ Patch coverage is 58.20896% with 28 lines in your changes missing coverage. Please review.
✅ Project coverage is 51.03%. Comparing base (bbaca76) to head (92367bd).
⚠️ Report is 22 commits behind head on master.

Files with missing lines	Patch %	Lines
sdk/python/feast/feature_store.py	34.88%	28 Missing ⚠️
❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #7077      +/-   ##
==========================================
- Coverage   51.32%   51.03%   -0.29%     
==========================================
  Files         458      455       -3     
  Lines       57441    56906     -535     
  Branches     8421     8287     -134     
==========================================
- Hits        29482    29044     -438     
+ Misses      25950    25895      -55     
+ Partials     2009     1967      -42

Flag	Coverage Δ		*Carryforward flag
go-feature-server	`30.58% <ø> (ø)`
python-unit	`52.50% <58.20%> (-0.30%)`	⬇️	Carriedforward from 644ba3a

*This pull request uses carry forward flags. Click here to find out more.

Files with missing lines	Coverage Δ
sdk/python/feast/feature_service.py	`84.05% <100.00%> (+0.55%)`	⬆️
...k/python/feast/infra/online_stores/online_store.py	`85.14% <100.00%> (+0.66%)`	⬆️
sdk/python/feast/feature_store.py	`47.27% <34.88%> (+0.38%)`	⬆️

... and 12 files with indirect coverage changes

Continue to review full report in Codecov by Harness.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1396c88...92367bd. Read the comment docs.

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

chandlerok · 2026-10-27T01:47:41Z

The one red check is unit-test-python (3.12, macos-14): test_start_script_can_fail_before_docker_when_repo_missing died with SIGTRAP under the gRPC fork handlers, nothing this PR touches. The same job is green on #7076 and the 3.11 macOS job is green here. Could a maintainer rerun it?

Signed-off-by: Chandler King <[email protected]>

shuchu

lgtm

# [0.68.0](v0.67.0...v0.68.0) (2026-11-10) ### Bug Fixes * add watch verb on clusterroles and clusterrolebindings for feast-operator ([#7062](#7062)) ([b6bdda4](b6bdda4)) * Apply on demand feature views in SparkRetrievalJob.to_spark_df() ([#6993](#6993)) ([f416309](f416309)) * Break event timestamp ties by created timestamp in Milvus write batches ([#7084](#7084)) ([bbaca76](bbaca76)) * Break event timestamp ties by created timestamp in the Dask offline store ([#6952](#6952)) ([eb93b08](eb93b08)) * Build the Go feature server image in two stages ([1e5e90c](1e5e90c)), closes [#7060](#7060) * Fall back to the serialized body when UDF source misses globals ([#6816](#6816)) ([f61079f](f61079f)) * Install patched libbrotli1 to address DSA-6582-1 ([#7096](#7096)) ([d458393](d458393)) * Keep description, tags and nested types of ODFV schema fields ([8ef6e75](8ef6e75)) * Keep entity columns out of StreamFeatureView proto features ([#7033](#7033)) ([d520584](d520584)) * Keep the metrics server running when a Gunicorn worker exits ([#7012](#7012)) ([68c5d54](68c5d54)), closes [#7011](#7011) * Key registry proto caches on the proto, not its id() ([#7085](#7085)) ([147adad](147adad)) * Log ODFV materialization skips instead of printing them ([#7117](#7117)) ([8fdcee7](8fdcee7)) * Pin build dependencies of source builds to the CI lock ([#7104](#7104)) ([dec2f24](dec2f24)) * Populate spec.project in registry REST feature view responses (#… ([#7037](#7037)) ([e304a84](e304a84)) * Preserve colliding source timestamps in Dask retrieval ([#7071](#7071)) ([1396c88](1396c88)) * Preserve Dask historical requests without eligible features ([#7000](#7000)) ([fff09f7](fff09f7)) * Read None elements of UUID and Decimal lists as None ([#7039](#7039)) ([03f30fe](03f30fe)) * Retire the support of Python3.10 ([#7101](#7101)) ([a56766e](a56766e)), closes [#7104](#7104) [#7089](#7089) [#7106](#7106) [#7105](#7105) * Serialize UUID and TimeUuid entity keys ([#7032](#7032)) ([0c845a1](0c845a1)) * Stop the Ray engine from hiding materialization errors ([#7026](#7026)) ([7903e2e](7903e2e)), closes [#7024](#7024) * **ui:** stop treating the monitoring baseline as the latest window ([#7056](#7056)) ([0f01802](0f01802)), closes [#7054](#7054) * Use date-only bounds for partition filters built from string timestamps ([#7116](#7116)) ([b1f2168](b1f2168)) * Validate entity column types in feast dbt import ([#7067](#7067)) ([abca80c](abca80c)), closes [#5876](#5876) * Warm up the whole DynamoDB connection pool ([#6985](#6985)) ([8ce548c](8ce548c)) ### Features * Add --gc-freeze option to feast serve ([#7089](#7089)) ([aad0c15](aad0c15)) * Add native complex types and scalar index tags to the Milvus online store ([#7120](#7120)) ([f7068d6](f7068d6)) * Add num_partitions and partition_key_isolation to the Milvus online store ([#7083](#7083)) ([68de84e](68de84e)), closes [#6940](#6940) * Add Pinecone online store integration ([#6585](#6585)) ([7a84f2a](7a84f2a)) * Add PolarisSource and PolarisProvider for Apache Polaris ([#7006](#7006)) ([386759c](386759c)) * Add row deletion to the Milvus online store ([#7082](#7082)) ([d3e2041](d3e2041)) * Add upstream FeatureView lineage support for PushSource ([#6853](#6853)) ([c9b9d72](c9b9d72)) * Optional nameless pre-computed vectors with a schema fingerprint ([#7077](#7077)) ([9420fac](9420fac)) ### Performance Improvements * Scan Lance sources lazily in the DuckDB offline store ([1299e4e](1299e4e))

feast-dev#7077) * feat: Refresh pre-computed vectors for pushed entities only precompute_feature_service accepts entity_keys and skips the keyspace scan when they are given. The push hook now passes the distinct entity keys from the pushed DataFrame instead of rebuilding every entity in the store. Signed-off-by: Chandler King <[email protected]> Co-Authored-By: Claude Fable 5.1 <[email protected]> * fix: Match pre-computed vector names when full_feature_names is False Stored vectors carry "<fv>__<feature>" names while the default request expects bare feature names, so the fast path always reported a schema mismatch unless full_feature_names=True. Compare on the caller's naming and derive the per-feature view name from the stored names for TTL checks. Signed-off-by: Chandler King <[email protected]> Co-Authored-By: Claude Fable 5.1 <[email protected]> * feat: Optional nameless pre-computed vectors with a schema fingerprint A pre-computed vector stores the full repeated feature name list next to its values. For a wide service that is most of the blob: 90 features came to 4.8 KB per entity, 3.8 KB of it names that are identical for every entity. FeatureService gains precompute_omit_names. Vectors written for such a service carry only values, per-view timestamps, and a fingerprint of the service's ordered names. The fast path validates a nameless vector by fingerprint and takes its names from the service. Vectors with names keep working as before. With the flag on the same blob is 834 bytes, and a 500-entity read moves 414 KB instead of 2.4 MB. Generated code is from grpcio-tools 1.62.3 (protobuf 4.25) and mypy-protobuf 3.3.0 to match the checked-in files. Signed-off-by: Chandler King <[email protected]> Co-Authored-By: Claude Fable 5.1 <[email protected]> * chore: Retrigger CI Signed-off-by: Chandler King <[email protected]> --------- Signed-off-by: Chandler King <[email protected]> Co-authored-by: Claude Fable 5.1 <[email protected]> Co-authored-by: Shuchu Han <[email protected]> Signed-off-by: Shuchu Han <[email protected]>

# [0.68.0](feast-dev/feast@v0.67.0...v0.68.0) (2026-11-10) ### Bug Fixes * add watch verb on clusterroles and clusterrolebindings for feast-operator ([feast-dev#7062](feast-dev#7062)) ([b6bdda4](feast-dev@b6bdda4)) * Apply on demand feature views in SparkRetrievalJob.to_spark_df() ([feast-dev#6993](feast-dev#6993)) ([f416309](feast-dev@f416309)) * Break event timestamp ties by created timestamp in Milvus write batches ([feast-dev#7084](feast-dev#7084)) ([bbaca76](feast-dev@bbaca76)) * Break event timestamp ties by created timestamp in the Dask offline store ([feast-dev#6952](feast-dev#6952)) ([eb93b08](feast-dev@eb93b08)) * Build the Go feature server image in two stages ([1e5e90c](feast-dev@1e5e90c)), closes [feast-dev#7060](feast-dev#7060) * Fall back to the serialized body when UDF source misses globals ([feast-dev#6816](feast-dev#6816)) ([f61079f](feast-dev@f61079f)) * Install patched libbrotli1 to address DSA-6582-1 ([feast-dev#7096](feast-dev#7096)) ([d458393](feast-dev@d458393)) * Keep description, tags and nested types of ODFV schema fields ([8ef6e75](feast-dev@8ef6e75)) * Keep entity columns out of StreamFeatureView proto features ([feast-dev#7033](feast-dev#7033)) ([d520584](feast-dev@d520584)) * Keep the metrics server running when a Gunicorn worker exits ([feast-dev#7012](feast-dev#7012)) ([68c5d54](feast-dev@68c5d54)), closes [feast-dev#7011](feast-dev#7011) * Key registry proto caches on the proto, not its id() ([feast-dev#7085](feast-dev#7085)) ([147adad](feast-dev@147adad)) * Log ODFV materialization skips instead of printing them ([feast-dev#7117](feast-dev#7117)) ([8fdcee7](feast-dev@8fdcee7)) * Pin build dependencies of source builds to the CI lock ([feast-dev#7104](feast-dev#7104)) ([dec2f24](feast-dev@dec2f24)) * Populate spec.project in registry REST feature view responses (#… ([feast-dev#7037](feast-dev#7037)) ([e304a84](feast-dev@e304a84)) * Preserve colliding source timestamps in Dask retrieval ([feast-dev#7071](feast-dev#7071)) ([1396c88](feast-dev@1396c88)) * Preserve Dask historical requests without eligible features ([feast-dev#7000](feast-dev#7000)) ([fff09f7](feast-dev@fff09f7)) * Read None elements of UUID and Decimal lists as None ([feast-dev#7039](feast-dev#7039)) ([03f30fe](feast-dev@03f30fe)) * Retire the support of Python3.10 ([feast-dev#7101](feast-dev#7101)) ([a56766e](feast-dev@a56766e)), closes [feast-dev#7104](feast-dev#7104) [feast-dev#7089](feast-dev#7089) [feast-dev#7106](feast-dev#7106) [feast-dev#7105](feast-dev#7105) * Serialize UUID and TimeUuid entity keys ([feast-dev#7032](feast-dev#7032)) ([0c845a1](feast-dev@0c845a1)) * Stop the Ray engine from hiding materialization errors ([feast-dev#7026](feast-dev#7026)) ([7903e2e](feast-dev@7903e2e)), closes [feast-dev#7024](feast-dev#7024) * **ui:** stop treating the monitoring baseline as the latest window ([feast-dev#7056](feast-dev#7056)) ([0f01802](feast-dev@0f01802)), closes [feast-dev#7054](feast-dev#7054) * Use date-only bounds for partition filters built from string timestamps ([feast-dev#7116](feast-dev#7116)) ([b1f2168](feast-dev@b1f2168)) * Validate entity column types in feast dbt import ([feast-dev#7067](feast-dev#7067)) ([abca80c](feast-dev@abca80c)), closes [feast-dev#5876](feast-dev#5876) * Warm up the whole DynamoDB connection pool ([feast-dev#6985](feast-dev#6985)) ([8ce548c](feast-dev@8ce548c)) ### Features * Add --gc-freeze option to feast serve ([feast-dev#7089](feast-dev#7089)) ([aad0c15](feast-dev@aad0c15)) * Add native complex types and scalar index tags to the Milvus online store ([feast-dev#7120](feast-dev#7120)) ([f7068d6](feast-dev@f7068d6)) * Add num_partitions and partition_key_isolation to the Milvus online store ([feast-dev#7083](feast-dev#7083)) ([68de84e](feast-dev@68de84e)), closes [feast-dev#6940](feast-dev#6940) * Add Pinecone online store integration ([feast-dev#6585](feast-dev#6585)) ([7a84f2a](feast-dev@7a84f2a)) * Add PolarisSource and PolarisProvider for Apache Polaris ([feast-dev#7006](feast-dev#7006)) ([386759c](feast-dev@386759c)) * Add row deletion to the Milvus online store ([feast-dev#7082](feast-dev#7082)) ([d3e2041](feast-dev@d3e2041)) * Add upstream FeatureView lineage support for PushSource ([feast-dev#6853](feast-dev#6853)) ([c9b9d72](feast-dev@c9b9d72)) * Optional nameless pre-computed vectors with a schema fingerprint ([feast-dev#7077](feast-dev#7077)) ([9420fac](feast-dev@9420fac)) ### Performance Improvements * Scan Lance sources lazily in the DuckDB offline store ([1299e4e](feast-dev@1299e4e)) Signed-off-by: Shuchu Han <[email protected]>

chandlerok and others added 3 commits October 26, 2026 19:16

chandlerok requested review from a team as code owners October 26, 2026 23:19

chandlerok requested review from ejscribner, robhowley and tokoko and removed request for a team October 26, 2026 23:19

chandlerok mentioned this pull request Oct 26, 2026

precompute_online: feature names are about 80% of every vector blob #7075

Closed

chandlerok and others added 2 commits October 29, 2026 23:03

chore: Retrigger CI

644ba3a

Signed-off-by: Chandler King <[email protected]>

Merge branch 'master' into feat/precompute-nameless-vectors

92367bd

shuchu merged commit 9420fac into feast-dev:master Nov 10, 2026
14 of 20 checks passed

shuchu approved these changes Nov 10, 2026

View reviewed changes

patelchaitany mentioned this pull request Nov 10, 2026

chore: Sync upstream feast-dev/feast master opendatahub-io/feast#288

Merged

patelchaitany mentioned this pull request Nov 11, 2026

chore: Sync upstream feast-dev/feast stable (0.68.0) opendatahub-io/feast#291

Merged

rhods-devops-app Bot mentioned this pull request Nov 12, 2026

Automated Sync from main to stable red-hat-data-services/feast#630

Open

Navigation Menu

Repository navigation

feat: Optional nameless pre-computed vectors with a schema fingerprint - #7077

feat: Optional nameless pre-computed vectors with a schema fingerprint#7077
shuchu merged 5 commits into
feast-dev:masterfrom
chandlerok:feat/precompute-nameless-vectors

chandlerok commented Oct 26, 2026 •

edited

Loading

Uh oh!

codecov-commenter commented Oct 26, 2026 •

edited

Loading

Uh oh!

chandlerok commented Oct 27, 2026

Uh oh!

Uh oh!

shuchu left a comment

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

chandlerok commented Oct 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What this PR does / why we need it:

Which issue(s) this PR fixes:

Checks

Testing Strategy

Misc

Uh oh!

codecov-commenter commented Oct 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

chandlerok commented Oct 27, 2026

Uh oh!

Uh oh!

shuchu left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

chandlerok commented Oct 26, 2026 •

edited

Loading

codecov-commenter commented Oct 26, 2026 •

edited

Loading