Skip to content

a way to parallelize with less contention#352

Closed
Sebastian Thiel (Byron) wants to merge 2 commits into
mainfrom
shared-parallel
Closed

a way to parallelize with less contention#352
Sebastian Thiel (Byron) wants to merge 2 commits into
mainfrom
shared-parallel

Conversation

@Byron

Copy link
Copy Markdown
Member

No description provided.

Previously they were Sync so FnMut wasn't so useful.
Now they are thread-local, and thus should be mutable
for max flexibility.
@Byron

Copy link
Copy Markdown
Member Author

Failure - tried shared-memory with chunks and work-stealing, chunks without work-stealing, and individual items without work-stealing.
It was always slower than channels, fastest was chunks without work-stealing, but still about 10% slower for some reason. Chunk-size is typically 1000.
I think it's mainly the file system that is sensitive to the order in which files are written and what not.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant