-
-
Notifications
You must be signed in to change notification settings - Fork 750
Open
Labels
discussionDiscussing a topic with no specific actions yetDiscussing a topic with no specific actions yetmemory
Description
Have had a few thoughts about additional spilling layers we could benefit from:
- Defragmentation (perform a
memcpyinto larger and larger buffers to clean up and consolidate small buffers) - Shared memory (also has the benefit of being accessible from other workers on the same node)
- mmap files (in-between shared memory and a file on disk; can close when memory usage is high; also like memory when using solid state)
Would be straightforward to add these to Zict without any new dependencies
Metadata
Metadata
Assignees
Labels
discussionDiscussing a topic with no specific actions yetDiscussing a topic with no specific actions yetmemory