Skip to content

Fix flakiness on get metadata e2e.#4080

Merged
artursouza merged 1 commit into
dapr:masterfrom
artursouza:fix_metadata_e2e
Jan 4, 2022
Merged

Fix flakiness on get metadata e2e.#4080
artursouza merged 1 commit into
dapr:masterfrom
artursouza:fix_metadata_e2e

Conversation

@artursouza

Copy link
Copy Markdown
Contributor

Fix flakiness on get metadata e2e when there are additional tests running in parallel that can influence the actor count.

Issue reference

Please reference the issue this PR will close: #N/A

Checklist

Please make sure you've completed the relevant tasks for this PR, out of the following list:

@artursouza
artursouza requested review from a team as code owners January 4, 2022 05:51
@codecov

codecov Bot commented Jan 4, 2022

Copy link
Copy Markdown

Codecov Report

Merging #4080 (4be6c74) into master (8342158) will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master    #4080   +/-   ##
=======================================
  Coverage   63.19%   63.19%           
=======================================
  Files         101      101           
  Lines        9654     9654           
=======================================
  Hits         6101     6101           
  Misses       3074     3074           
  Partials      479      479           

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8342158...4be6c74. Read the comment docs.

@artursouza

Copy link
Copy Markdown
Contributor Author

/ok-to-test

@dapr-bot

dapr-bot commented Jan 4, 2022

Copy link
Copy Markdown
Collaborator

Found the available test cluster - dapr-aks-e2e-07 for linux. Please check the build status.

require.Greater(t, len(currentMetadata.Actors), 0)
require.Equal(t, "testactorfeatures", currentMetadata.Actors[0].Type)
require.Equal(t, "testactorfeatures", previousMetadata.Actors[0].Type)
require.Greater(t, currentMetadata.Actors[0].Count, previousMetadata.Actors[0].Count)

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We just assert it is greater and not necessarily the exact count.

@dapr-bot

dapr-bot commented Jan 4, 2022

Copy link
Copy Markdown
Collaborator

Found the available test cluster - dapr-aks-e2e-05 for windows. Please check the build status.

@dapr-bot

dapr-bot commented Jan 4, 2022

Copy link
Copy Markdown
Collaborator

End-to-end tests failed on windows. Please check the build logs

@daixiang0

Copy link
Copy Markdown
Member

Developers may not consider parallel issues, do we really need run tests in parallel? If so, we should better highlight those tests.

@artursouza

Copy link
Copy Markdown
Contributor Author

Developers may not consider parallel issues, do we really need run tests in parallel? If so, we should better highlight those tests.

The time to run tests increase a lot without parallelism. We need to keep this in mind when reviewing PRs. This is the only way to reduce time to run tests. IMO.

@daixiang0

Copy link
Copy Markdown
Member

@dapr-bot

dapr-bot commented Jan 4, 2022

Copy link
Copy Markdown
Collaborator

Congrats! All end-to-end tests have passed on linux. Thanks for your contribution!

@artursouza

Copy link
Copy Markdown
Contributor Author

Look at https://github.com/dapr/dapr/runs/4698628375?check_suite_focus=true, build and push containers spend ~50% time, if we do it only once before all e2e tests, we can reduce much time.

Refer to https://github.com/docker/build-push-action/blob/master/docs/advanced/share-image-jobs.md.

Yes, that is right. We have kept the build of E2E apps in the pipeline because it is very common to have PRs that require changes to E2E test app to be merged together with the test code. I agree that we can expedite the build time too.

@artursouza
artursouza merged commit 26e34de into dapr:master Jan 4, 2022
Taction added a commit to Taction/dapr that referenced this pull request Jan 4, 2022
* master:
  Saves 'describe' output of K8s resources for E2E tests. (dapr#4082)
  Fix flakiness on get metadata e2e. (dapr#4080)
  Return error instead of crashing when receiving grpc_proxy request on uninitialized daprd
  Fix actor reminder e2e tests + fixes to reminder partition (dapr#4021)
  Upgrading fasthttp to fix shutdown issue
  Fixed create timer duetime
  remove max graceful shutdown duration limit
  fix lint
  add more test case
  fix lint
  Make the grace period configurable

Signed-off-by: Taction <[email protected]>
x-shadow-man pushed a commit to x-shadow-man/dapr that referenced this pull request Jan 5, 2022
Signed-off-by: Artur Souza <[email protected]>
Signed-off-by: x-shadow-man <[email protected]>
x-shadow-man pushed a commit to x-shadow-man/dapr that referenced this pull request Jan 5, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants