Skip to content

[CI] TestAllJobs - create separate jobs for Auth and Firestore#7353

Merged
DellaBitta merged 21 commits intomasterfrom
ddb-test-all-jobs
Jun 26, 2023
Merged

[CI] TestAllJobs - create separate jobs for Auth and Firestore#7353
DellaBitta merged 21 commits intomasterfrom
ddb-test-all-jobs

Conversation

@DellaBitta
Copy link
Copy Markdown
Contributor

@DellaBitta DellaBitta commented Jun 6, 2023

Discussion

Created separate jobs in the Test All workflow for both Auth and Firestore. These two tests have a history of flaking when execute in the same job as the other tests. Breaking them-out into their own jobs may reduce the flake and isolate re-attempts at executing the test.

Also created a step to build the SDK. The various test domains (Auth, Firestore and the rest) no use the results from the build step to run the tests. This reduces the time needed to re-run flakey tests from 40 minutes to:

  • Auth: ~8 minutes
  • Firestore: ~15 minutes
  • Others: ~15 minutes

Testing

Updated the CI Workflow. Test has executed successfully (here's an example).

API Changes

N/A, CI and the addition of new build targets only.

@changeset-bot
Copy link
Copy Markdown

changeset-bot Bot commented Jun 6, 2023

⚠️ No Changeset found

Latest commit: 7652f23

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@google-oss-bot
Copy link
Copy Markdown
Collaborator

google-oss-bot commented Jun 6, 2023

@DellaBitta DellaBitta marked this pull request as ready for review June 6, 2023 20:56
@DellaBitta DellaBitta requested review from a team, dwyfrequency and hsubox76 as code owners June 6, 2023 20:56
Comment thread package.json Outdated
Comment thread package.json Outdated
Comment thread package.json Outdated
Comment thread package.json Outdated
"dev": "lerna run --parallel --scope @firebase/* --scope firebase dev",
"build": "lerna run --scope @firebase/* --scope firebase build",
"build:changed": "ts-node-script scripts/ci-test/build_changed.ts",
"build:ci:auth": "lerna run build:deps --scope '@firebase/auth*'",
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same comment regarding putting the command directly in the workflow.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done.

node scripts/print_test_logs.js
env:
FIREBASE_TOKEN: ${{ secrets.FIREBASE_CLI_TOKEN }}
- name: Generate coverage file
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm curious what the coverage step is going to do when it only has a subset of packages to work with but as it apparently currently doesn't work at all https://coveralls.io/github/firebase/firebase-js-sdk?branch=master I don't think it's an immediate concern. Future todo to figure out why it hasn't been working I guess.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, I wasn't quite sure about this either.

@DellaBitta DellaBitta requested a review from hsubox76 June 7, 2023 17:08
Comment thread .github/workflows/test-all.yml
Comment thread .github/workflows/test-all.yml
@DellaBitta DellaBitta requested a review from hsubox76 June 14, 2023 19:55
@DellaBitta DellaBitta merged commit 114bc6e into master Jun 26, 2023
@DellaBitta DellaBitta deleted the ddb-test-all-jobs branch June 26, 2023 21:35
@firebase firebase locked and limited conversation to collaborators Jul 27, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants