Skip to content

makes pool_size and queue size configurable for S3 reader&writer #41070

@young-scott

Description

@young-scott

in IDiskRemote::getThreadPoolWriter & IDiskRemote::getThreadPoolReader

reader&writer queue size is 1M . it's too large, my multi object upload size is 16M, and it will cause OOM when there are many moving task copying objects to low performance s3 server.

reader&writer pool can also not changed .

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions