I want to save a particular number of values in maps I create. For example, when creating (4064x1) values, I want to save first (1000x1) in map1, next (1000x1) in map2 and so on. The last map will have remaining (64x1) elements. I need these maps later for fast processing.
Now the issue is I want to automate this as the number 4064 varies based on data I analyze. Here is simplsitic version of something I tried and is working (L is 1000 and index is reset to zero as I move from one map to the other).
Any suggestions on how to make this creative?
Now the issue is I want to automate this as the number 4064 varies based on data I analyze. Here is simplsitic version of something I tried and is working (L is 1000 and index is reset to zero as I move from one map to the other).
Any suggestions on how to make this creative?
Code:
L = 1000
index = 0
count = 0
# manually creating maps
fp1 = np.memmap('map1.dat', dtype='float64', mode='w+', shape=(L,1))
fp2 = np.memmap('map2.dat', dtype='float64', mode='w+', shape=(L,1))
fp3 = np.memmap('map3.dat', dtype='float64', mode='w+', shape=(L,1))
...
# manually pushing generated values into created maps
if count < L:
fp1[index,0] = delta # delta is some float64 value I am creating in each iteration of a parent loop
if count == L:
index = 0
if L <= count < 2*L:
fp2[index,0] = delta
if count == 2*L:
index = 0
if 2*L <= count < 3*L:
fp3[index,0]=delta
...
count += 1
index += 1
Comment