Skip to content

ci: moving universe and docs integration tests to the dagger CI plan#2442

Merged
samalba merged 3 commits intodagger:mainfrom
samalba:ci-integration
May 24, 2022
Merged

ci: moving universe and docs integration tests to the dagger CI plan#2442
samalba merged 3 commits intodagger:mainfrom
samalba:ci-integration

Conversation

@samalba
Copy link
Copy Markdown
Contributor

@samalba samalba commented May 12, 2022

This is a follow-up of PR #2284

It adds integration tests for:

  • documentation
  • universe packages

Closes #1522

@sipsma
Copy link
Copy Markdown
Contributor

sipsma commented May 21, 2022

The timeout you are getting in the universe tests should be fixed by this: #2495

@samalba samalba force-pushed the ci-integration branch 2 times, most recently from 5c4ca04 to afb7069 Compare May 24, 2022 01:28
@samalba samalba marked this pull request as ready for review May 24, 2022 01:29
@samalba samalba requested review from a team, helderco and shykes as code owners May 24, 2022 01:29
@samalba samalba changed the title ci: moving universe and docs integration tests to the dagger CI plan [DO NOT MERGE] ci: moving universe and docs integration tests to the dagger CI plan May 24, 2022
@samalba
Copy link
Copy Markdown
Contributor Author

samalba commented May 24, 2022

@sipsma Thanks for the review! Comparing the previous runs of integrations tests, looks like we took a 3x hit on performance for universe tests... I'll dig a bit deeper before we can merge this. You suggestion helped to prevent the timeout but it's still much slower than before, weird...

@sipsma
Copy link
Copy Markdown
Contributor

sipsma commented May 24, 2022

Comparing the previous runs of integrations tests, looks like we took a 3x hit on performance for universe tests... I'll dig a bit deeper before we can merge this.

Just re-ran the universe tests and they only took 6m, which is pretty good. I highly suspect what happened on the previous run was that we had too many tests running in parallel between this PR and others, which causes GHA cache to throttle us and take longer to download/upload cache. Issue for that here: #2365

The tracing I added to the integration tests let us 100% confirm that's what is happening, but I've held off on adding them to the universe tests just because there are several open PRs it would conflict with. So I can't be 100% sure that's what happened but feel fairly confident given the symptoms.

Either way, I think this should be good to merge.

@samalba samalba changed the title [DO NOT MERGE] ci: moving universe and docs integration tests to the dagger CI plan ci: moving universe and docs integration tests to the dagger CI plan May 24, 2022
@samalba
Copy link
Copy Markdown
Contributor Author

samalba commented May 24, 2022

Comparing the previous runs of integrations tests, looks like we took a 3x hit on performance for universe tests... I'll dig a bit deeper before we can merge this.

Just re-ran the universe tests and they only took 6m, which is pretty good. I highly suspect what happened on the previous run was that we had too many tests running in parallel between this PR and others, which causes GHA cache to throttle us and take longer to download/upload cache. Issue for that here: #2365

The tracing I added to the integration tests let us 100% confirm that's what is happening, but I've held off on adding them to the universe tests just because there are several open PRs it would conflict with. So I can't be 100% sure that's what happened but feel fairly confident given the symptoms.

Either way, I think this should be good to merge.

Thanks @sipsma, exactly what I needed to double check.

@samalba samalba merged commit 13cf9f4 into dagger:main May 24, 2022
@samalba samalba deleted the ci-integration branch May 24, 2022 18:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Convert our own Makefile to dagger

3 participants