Skip to content
This repository was archived by the owner on Mar 23, 2026. It is now read-only.

testing: avoid installing service dependencies in runners if unnecessary #13701

Merged
bentsku merged 1 commit intomainfrom
clean-pre-install-deps
Feb 5, 2026
Merged

testing: avoid installing service dependencies in runners if unnecessary #13701
bentsku merged 1 commit intomainfrom
clean-pre-install-deps

Conversation

@bentsku
Copy link
Copy Markdown
Contributor

@bentsku bentsku commented Feb 4, 2026

Motivation

When working with the LocalStack dev run utility (localstack.dev.run) and running OpenSearch tests together with @aidehn, we've realized that the test runner was installing the service lazy-loaded dependencies, even though we were running the tests against an external instance.

This PR changes the logic to skip installing those dependencies if they don't need to be. This will allow us to gain time in setups where we run the tests against external instances, and avoid local issues when the external dependencies are not runnable on certain types of host like macOS.

Additionally, I've made some test configuration flags more explicit by declaring them in testing.config, because they were not very easily discoverable, especially the TEST_SKIP_START_LOCALSTACK which is really handy.

Changes

  • skip logic to install external service dependencies early in test runners if the tests are run against external instances
  • add config flags related to starting/force starting LocalStack in process

Tests

Related

@bentsku bentsku added this to the 4.14 milestone Feb 4, 2026
@bentsku bentsku self-assigned this Feb 4, 2026
@bentsku bentsku added semver: patch Non-breaking changes which can be included in patch releases docs: skip Pull request does not require documentation changes notes: skip Pull request does not have to be mentioned in the release notes labels Feb 4, 2026
@github-actions
Copy link
Copy Markdown

github-actions bot commented Feb 4, 2026

Test Results - Preflight, Unit

23 114 tests  ±0   21 255 ✅ ±0   6m 35s ⏱️ +14s
     1 suites ±0    1 859 💤 ±0 
     1 files   ±0        0 ❌ ±0 

Results for commit b6fc84c. ± Comparison against base commit bb27e3e.

@github-actions
Copy link
Copy Markdown

github-actions bot commented Feb 4, 2026

Test Results (amd64) - Acceptance

7 tests  ±0   5 ✅ ±0   3m 6s ⏱️ +11s
1 suites ±0   2 💤 ±0 
1 files   ±0   0 ❌ ±0 

Results for commit b6fc84c. ± Comparison against base commit bb27e3e.

@github-actions
Copy link
Copy Markdown

github-actions bot commented Feb 4, 2026

Test Results (amd64) - Integration, Bootstrap

    5 files      5 suites   2h 39m 29s ⏱️
5 610 tests 5 049 ✅ 561 💤 0 ❌
5 616 runs  5 049 ✅ 567 💤 0 ❌

Results for commit b6fc84c.

@github-actions
Copy link
Copy Markdown

github-actions bot commented Feb 4, 2026

LocalStack Community integration with Pro

    2 files  ±0      2 suites  ±0   1h 58m 23s ⏱️ - 1m 0s
5 189 tests ±0  4 798 ✅ ±0  391 💤 ±0  0 ❌ ±0 
5 191 runs  ±0  4 798 ✅ ±0  393 💤 ±0  0 ❌ ±0 

Results for commit b6fc84c. ± Comparison against base commit bb27e3e.

@bentsku bentsku marked this pull request as ready for review February 4, 2026 15:24
Copy link
Copy Markdown
Member

@alexrashed alexrashed left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good catch and a nice cleanup! 🧹 🚀

@bentsku bentsku merged commit 8422daf into main Feb 5, 2026
57 checks passed
@bentsku bentsku deleted the clean-pre-install-deps branch February 5, 2026 14:11
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

docs: skip Pull request does not require documentation changes notes: skip Pull request does not have to be mentioned in the release notes semver: patch Non-breaking changes which can be included in patch releases

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants