Skip to content

Add scratch space re-use functionality to LCOW snapshotter#4824

Merged
dmcgowan merged 1 commit intocontainerd:masterfrom
dcantah:dcantah/reuse-scratch
Jan 22, 2021
Merged

Add scratch space re-use functionality to LCOW snapshotter#4824
dmcgowan merged 1 commit intocontainerd:masterfrom
dcantah:dcantah/reuse-scratch

Conversation

@dcantah
Copy link
Copy Markdown
Member

@dcantah dcantah commented Dec 9, 2020

Currently we would create a new disk and mount this into the LCOW UVM for every container but there
are certain scenarios where we'd rather just mount a single disk and then have every container share this one
storage space instead of every container having it's own xGB of space to play around with.

This is accomplished by just making a symlink to the disk that we'd like to share and then
using ref counting later on down the stack in hcsshim if we see that we've already mounted this
disk.

Signed-off-by: Daniel Canter [email protected]

@k8s-ci-robot
Copy link
Copy Markdown

Hi @dcantah. Thanks for your PR.

I'm waiting for a containerd member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@dcantah
Copy link
Copy Markdown
Member Author

dcantah commented Dec 9, 2020

@dcantah
Copy link
Copy Markdown
Member Author

dcantah commented Dec 9, 2020

+@jterry75 @cpuguy83 If you could give this a peek :)

@theopenlab-ci
Copy link
Copy Markdown

theopenlab-ci Bot commented Dec 9, 2020

Build succeeded.

Comment thread snapshots/lcow/lcow.go Outdated
Copy link
Copy Markdown
Contributor

@jterry75 jterry75 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jterry75
Copy link
Copy Markdown
Contributor

Oh sorry. Can you fix the linter issue

@dcantah dcantah force-pushed the dcantah/reuse-scratch branch from fea304f to 40c9087 Compare December 10, 2020 18:34
@theopenlab-ci
Copy link
Copy Markdown

theopenlab-ci Bot commented Dec 10, 2020

Build succeeded.

@dcantah
Copy link
Copy Markdown
Member Author

dcantah commented Dec 10, 2020

@jterry75 hahah I'm on it. Thought it was coming from somewhere else

@dcantah dcantah force-pushed the dcantah/reuse-scratch branch from 40c9087 to eefb1f8 Compare December 10, 2020 19:46
@theopenlab-ci
Copy link
Copy Markdown

theopenlab-ci Bot commented Dec 10, 2020

Build succeeded.

@dcantah dcantah force-pushed the dcantah/reuse-scratch branch from eefb1f8 to 06457a4 Compare December 10, 2020 20:04
@theopenlab-ci
Copy link
Copy Markdown

theopenlab-ci Bot commented Dec 10, 2020

Build succeeded.

@dcantah
Copy link
Copy Markdown
Member Author

dcantah commented Dec 10, 2020

@jterry75 Fixed... after three tries..... haha

@crosbymichael
Copy link
Copy Markdown
Member

/ok-to-test

@dcantah
Copy link
Copy Markdown
Member Author

dcantah commented Dec 15, 2020

@anmaxvl @kevpar @katiewasnothere @ambarve If anyone has some time to give this a skim today

Comment thread snapshots/lcow/lcow.go Outdated
Comment thread snapshots/lcow/lcow.go Outdated
Comment thread snapshots/lcow/lcow.go Outdated
@dcantah dcantah force-pushed the dcantah/reuse-scratch branch from 06457a4 to a84fb2e Compare December 16, 2020 03:12
Copy link
Copy Markdown

@katiewasnothere katiewasnothere left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@dcantah
Copy link
Copy Markdown
Member Author

dcantah commented Dec 16, 2020

Looks like the CI failed on a devmapper test which is surely unrelated to this.

@katiewasnothere
Copy link
Copy Markdown

Looks like the CI failed on a devmapper test which is surely unrelated to this.

Same test has been failing for me on a separate PR so probably fine here

@dcantah dcantah force-pushed the dcantah/reuse-scratch branch from a84fb2e to 5d7691f Compare December 17, 2020 21:00
@dcantah
Copy link
Copy Markdown
Member Author

dcantah commented Dec 23, 2020

@crosbymichael The loop device tests that are failing can be ignored for this right? Anything else needed to help get this in?

Currently we would create a new disk and mount this into the LCOW UVM for every container but there
are certain scenarios where we'd rather just mount a single disk and then have every container share this one
storage space instead of every container having it's own xGB of space to play around with.

This is accomplished by just making a symlink to the disk that we'd like to share and then
using ref counting later on down the stack in hcsshim if we see that we've already mounted this
disk.

Signed-off-by: Daniel Canter <[email protected]>
@dcantah dcantah force-pushed the dcantah/reuse-scratch branch from 5d7691f to 3e5acb9 Compare January 13, 2021 23:21
@theopenlab-ci
Copy link
Copy Markdown

theopenlab-ci Bot commented Jan 13, 2021

Build succeeded.

@dcantah
Copy link
Copy Markdown
Member Author

dcantah commented Jan 21, 2021

@dmcgowan @crosbymichael Is there anything else needed for this?

@dmcgowan
Copy link
Copy Markdown
Member

@dcantah I think it is good since you have LGTM from @katiewasnothere and @jterry75.

@dmcgowan dmcgowan merged commit 9b9de47 into containerd:master Jan 22, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants