Skip to content

'epochs' parameter for ShuffleBuffer #5488

@wyli

Description

@wyli

Is your feature request related to a problem? Please describe.
when creating a shuffled iterable dataset

cache_datasets:
  - _target_: ShuffleBuffer
    data:
      _target_: CacheDataset
      data: "@datalist"
      transform: [email protected]_random_state(123)
      hash_as_key: true
    seed: 1

the ShuffleBuffer supports only a single epoch of datalist
would be great to add epochs argument to the class for multiple epochs or infinite epochs.

Alternative solutions are:

  • extending the data list: monai.data.utils.resample_datalist(@datalist, epochs)
  • using the itertools: itertools.cycle(@data)

both solutions are not efficiently using the iterator.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions