Skip to content

Configure write_to_online_store to allow transforms on writes to be skipped #5196

Closed

Description

@franciscojavierarceo

Is your feature request related to a problem? Please describe.
Configure write_to_online_store to allow transforms on writes to be skipped.

This will allow users to transform and materialize in batch and use the feature server for transformation, which allow the users to save code.

Describe the solution you'd like
write_to_online_store(feature_view, df, skip_transform=True)

Describe alternatives you've considered
N/A

Additional context
N/A

Activity

  1. haoxu0 commented on Mar 29, 2025

    @haoxu0
    Collaborator

    I think the current write_to_online_store doesn't run transformation. So the issue is more like enabling write_to_online_store and write_to_offline_store with optional transformation.

    I have a doc with new design for this. Mind hold on a bit for the work and we can discuss more after I showed you the doc?

  2. franciscojavierarceo commented on Mar 29, 2025

    @franciscojavierarceo
    MemberAuthor

    I already added transformation on write for on demand with write

  3. franciscojavierarceo commented on Mar 29, 2025

    @franciscojavierarceo
    MemberAuthor

    See here: #5127

    We can definitely revisit for new design! I was just going to enable it for the old version in a non-breaking way, so shouldn't impact users.

  4. franciscojavierarceo commented on Mar 29, 2025

    @franciscojavierarceo
    MemberAuthor

    FWIW the change itself is actually pretty small

  5. haoxu0 commented on Mar 30, 2025

    @haoxu0
    Collaborator

    ah make sense for on demand featur view.
    I meant for the batch/stream.👍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions