-
Notifications
You must be signed in to change notification settings - Fork 1.5k
cachedataset useability #1871
Copy link
Copy link
Closed
Labels
Module: transformdata transforms for preprocessing and postprocessing.data transforms for preprocessing and postprocessing.WG: TransformsFor the transforms working groupFor the transforms working groupenhancementNew feature or requestNew feature or request
Description
Is your feature request related to a problem? Please describe.
this feature request is a follow up of #1836. ideally multiple preprocessing threads would 1. read from a shared cache (storing non random transform outcomes) and 2. have independent transform instances for each of them. 2 is not currently implemented as a result the transform instance properties might be modified by multiple threads simultaneously and causing issues #1030 #1836.
the caching logic could be improved so that it is easier to make customised transforms for the cache based datasets.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
Module: transformdata transforms for preprocessing and postprocessing.data transforms for preprocessing and postprocessing.WG: TransformsFor the transforms working groupFor the transforms working groupenhancementNew feature or requestNew feature or request