SmartCacheDataset modified input datalist #2445
Description
Describe the bug
Bug reported by an internal user:
If set shuffle=True in SmartCacheDataset, it will modify the input datalist in place, program to reproduce:
data_list = list(np.array([i]) for i in range(5))
print("original datalist:", data_list)
SmartCacheDataset(
data=data_list,
transform=None,
cache_rate=0.5,
replace_rate=0.4,
shuffle=True,
)
print("datalist after dataset:", data_list)The output:
original datalist: [array([0]), array([1]), array([2]), array([3]), array([4])]
Loading dataset: 100%|█████████████████████████████████████████████████████████████████████| 2/2 [00:00<00:00, 4566.47it/s]
datalist after dataset: [array([2]), array([0]), array([1]), array([3]), array([4])]
It should only shuffle the datalist in the SmartCacheDataset.
Thanks.