Skip to content

Faster CI: Optimize Pull Request Tests#2075

Merged
felixge merged 22 commits into
mainfrom
felix.geisendoerfer/PROF-7836-faster-ci-cache-gotestsum
Jun 26, 2023
Merged

Faster CI: Optimize Pull Request Tests#2075
felixge merged 22 commits into
mainfrom
felix.geisendoerfer/PROF-7836-faster-ci-cache-gotestsum

Conversation

@felixge

@felixge felixge commented Jun 26, 2023

Copy link
Copy Markdown
Member

What does this PR do?

  1. Run lint job on "APM Large Runners" (saves up to 60s of build time, depending on scheduling)
  2. Expand cache to also cover the install of gotestsum (saves up to 60s of build time)
  3. Refactor go setup into a reusable composite action.
  4. Cleanup: Update from actions/checkout@v2 to actions/checkout@v3 and remove redundant repository parameter.

As the end result, this allows the "Pull Requests Tests" workflow to execute as fast as 2m45s. Even for executions where there is queuing/auto-scaling latency, I think this could bring the p95 to less than 5m.

Before After

Motivation

See RFC: Faster CI for dd-trace-go 🚀 google doc.

Describe how to test/QA your changes

Reviewer's Checklist

  • Changed code has unit tests for its functionality.
  • If this interacts with the agent in a new way, a system test has been added.

@felixge felixge changed the title debug Faster CI: gotestsum Jun 26, 2023
@pr-commenter

pr-commenter Bot commented Jun 26, 2023

Copy link
Copy Markdown

Benchmarks

Benchmark execution time: 2023-06-26 20:30:51

Comparing candidate commit 415348b in PR branch felix.geisendoerfer/PROF-7836-faster-ci-cache-gotestsum with baseline commit ed9cc9c in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 24 metrics, 0 unstable metrics.

@felixge felixge changed the title Faster CI: gotestsum Faster CI: Optimize Pull Request Tests II Jun 26, 2023
@felixge
felixge marked this pull request as ready for review June 26, 2023 20:36
@felixge
felixge requested a review from a team as a code owner June 26, 2023 20:36
@felixge felixge changed the title Faster CI: Optimize Pull Request Tests II Faster CI: Optimize Pull Request Tests Jun 26, 2023
Comment thread .github/actions/setup-go/action.yml Outdated
@@ -0,0 +1,31 @@
# Composite action to upload junit test result files to Datadog CI App

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

junit?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Caught me copy & pasting, haha. Will fix.

katiehockman
katiehockman previously approved these changes Jun 26, 2023

@katiehockman katiehockman left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!!!

@felixge
felixge merged commit 1170127 into main Jun 26, 2023
@felixge
felixge deleted the felix.geisendoerfer/PROF-7836-faster-ci-cache-gotestsum branch June 26, 2023 20:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants