Skip to content

Conversation

@fangn2
Copy link
Contributor

@fangn2 fangn2 commented Feb 7, 2023

Part of #7592 Add configuration options to local transfer service.

Signed-off-by: Tony Fang [email protected]

@fangn2 fangn2 marked this pull request as draft February 7, 2023 21:06
@k8s-ci-robot
Copy link

Hi @fangn2. Thanks for your PR.

I'm waiting for a containerd member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@fangn2 fangn2 force-pushed the config-options branch 4 times, most recently from 1e7a389 to 6441a40 Compare February 10, 2023 16:42
@dmcgowan dmcgowan added this to the 1.7 milestone Feb 10, 2023
@fangn2 fangn2 force-pushed the config-options branch 4 times, most recently from 3118d5d to 88c5582 Compare February 17, 2023 16:15
@fangn2 fangn2 force-pushed the config-options branch 3 times, most recently from d65b68d to 1600c32 Compare February 22, 2023 23:06
@fangn2 fangn2 marked this pull request as ready for review February 22, 2023 23:06
@fangn2
Copy link
Contributor Author

fangn2 commented Feb 23, 2023

@dmcgowan I addressed your comments, fixed CI failures, and rebased main.
Can you take another look?

@dmcgowan dmcgowan self-assigned this Feb 24, 2023
Copy link
Member

@dmcgowan dmcgowan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A few minor things, then I think it is ready to go

Copy link
Member

@dmcgowan dmcgowan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, the tests can be in the follow up to not hold up the export PR.

Copy link
Member

@fuweid fuweid left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

The comment issue can be handled in follow-up.


type TransferConfig struct {
// MaxConcurrentDownloads is the max concurrent content downloads for pull.
MaxConcurrentDownloads int `toml:"max_concurrent_downloads"`
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not related to this pr. I just see many issues saying that the image pulling brings more io pressure. So I am wondering about how to add a global limitation here. maybe introduces rate-limiter var?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We do have a global limiter defined here which initialized using this MaxConcurrentDownloads

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! I misunderstand this part when I review it. It will change the existing CRI-plugin config definition right now.
Currently, the CRI-plugin limits the concurrent pulling numbers for each pull. It confuses that users from docker.
It looks good to me if the CRI-plugin config definition can align with transfer service. I was thinking about adding a global rate-limit for CRI-plugin.

@fuweid fuweid merged commit a187094 into containerd:main Feb 25, 2023
@fangn2
Copy link
Contributor Author

fangn2 commented Feb 26, 2023

@dmcgowan @fuweid
Thanks for your reviews!
Followup added in #8165

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

Archived in project

Development

Successfully merging this pull request may close these issues.

4 participants