Skip to content

[ci-visibility] Extract code coverage from cypress#3159

Merged
juan-fernandez merged 8 commits into
masterfrom
juan-fernandez/extra-coverage-from-cypress
May 23, 2023
Merged

[ci-visibility] Extract code coverage from cypress#3159
juan-fernandez merged 8 commits into
masterfrom
juan-fernandez/extra-coverage-from-cypress

Conversation

@juan-fernandez

@juan-fernandez juan-fernandez commented May 16, 2023

Copy link
Copy Markdown
Collaborator

What does this PR do?

If window.__coverage__ available from the test's context, it means that the web app has been instrumented with code coverage. If that's the case, we extract it.

Motivation

First step to making ITR usable with cypress.

@github-actions

github-actions Bot commented May 16, 2023

Copy link
Copy Markdown
Contributor

Overall package size

Self size: 4.16 MB
Deduped: 58.29 MB
No deduping: 58.33 MB

Dependency sizes

name version self size total size
@datadog/pprof 2.2.1 14.24 MB 15.12 MB
@datadog/native-iast-taint-tracking 1.4.1 14.85 MB 14.86 MB
@datadog/native-appsec 3.1.0 13.31 MB 13.32 MB
protobufjs 7.1.2 2.76 MB 6.55 MB
@datadog/native-iast-rewriter 2.0.1 2.09 MB 2.1 MB
@datadog/native-metrics 2.0.0 898.77 kB 1.3 MB
opentracing 0.14.7 194.81 kB 194.81 kB
semver 7.3.8 88.2 kB 118.6 kB
@datadog/sketches-js 2.1.0 109.9 kB 109.9 kB
lodash.sortby 4.7.0 75.76 kB 75.76 kB
lru-cache 7.14.0 74.95 kB 74.95 kB
ipaddr.js 2.0.1 59.52 kB 59.52 kB
ignore 5.2.0 48.87 kB 48.87 kB
import-in-the-middle 1.3.5 34.34 kB 38.81 kB
istanbul-lib-coverage 3.2.0 29.34 kB 29.34 kB
retry 0.10.1 27.44 kB 27.44 kB
lodash.uniq 4.5.0 25.01 kB 25.01 kB
limiter 1.1.5 23.17 kB 23.17 kB
lodash.kebabcase 4.1.1 17.75 kB 17.75 kB
lodash.pick 4.4.0 16.33 kB 16.33 kB
node-abort-controller 3.0.1 14.33 kB 14.33 kB
crypto-randomuuid 1.0.0 11.18 kB 11.18 kB
diagnostics_channel 1.1.0 7.07 kB 7.07 kB
path-to-regexp 0.1.7 6.78 kB 6.78 kB
koalas 1.0.2 6.47 kB 6.47 kB
methods 1.1.2 5.29 kB 5.29 kB
module-details-from-path 1.0.3 4.47 kB 4.47 kB

🤖 This report was automatically generated by heaviest-objects-in-the-universe

@codecov

codecov Bot commented May 16, 2023

Copy link
Copy Markdown

Codecov Report

Merging #3159 (dddebc7) into master (3428a1f) will decrease coverage by 0.31%.
The diff coverage is 61.53%.

@@            Coverage Diff             @@
##           master    #3159      +/-   ##
==========================================
- Coverage   86.95%   86.64%   -0.31%     
==========================================
  Files         322      328       +6     
  Lines       11763    11866     +103     
  Branches       33       33              
==========================================
+ Hits        10228    10281      +53     
- Misses       1535     1585      +50     
Impacted Files Coverage Δ
packages/datadog-plugin-cucumber/src/index.js 0.00% <ø> (ø)
packages/datadog-plugin-jest/src/index.js 76.54% <0.00%> (-0.96%) ⬇️
packages/datadog-plugin-mocha/src/index.js 0.00% <0.00%> (ø)
packages/datadog-plugin-cypress/src/plugin.js 82.24% <50.00%> (-6.06%) ⬇️
...ages/dd-trace/src/encode/coverage-ci-visibility.js 100.00% <100.00%> (ø)

... and 30 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@pr-commenter

pr-commenter Bot commented May 17, 2023

Copy link
Copy Markdown

Benchmarks

Comparing candidate commit dddebc7 in PR branch juan-fernandez/extra-coverage-from-cypress with baseline commit 3428a1f in branch master.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 440 metrics, 32 unstable metrics.

@juan-fernandez
juan-fernandez force-pushed the juan-fernandez/extra-coverage-from-cypress branch from 155908b to 566fa65 Compare May 17, 2023 10:51
@juan-fernandez
juan-fernandez marked this pull request as ready for review May 17, 2023 11:01
@juan-fernandez
juan-fernandez requested a review from a team as a code owner May 17, 2023 11:01
@juan-fernandez

Copy link
Copy Markdown
Collaborator Author

I'm moving this back to draft because I found an important bug

@juan-fernandez
juan-fernandez marked this pull request as draft May 18, 2023 10:16
@juan-fernandez
juan-fernandez force-pushed the juan-fernandez/extra-coverage-from-cypress branch from 567cc36 to eaac6b5 Compare May 18, 2023 10:49
traceId: this.testSuiteSpan.context()._traceId,
spanId: this.testSuiteSpan.context()._spanId,
sessionId: this.testSuiteSpan.context()._traceId,
suiteId: this.testSuiteSpan.context()._spanId,

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

unrelated fix: these names make more sense, given that that's what we end up encoding

@juan-fernandez

Copy link
Copy Markdown
Collaborator Author

I'm moving this back to draft because I found an important bug

ok that should be fixed

@juan-fernandez
juan-fernandez marked this pull request as ready for review May 18, 2023 11:51
const coverageFiles = getCoveredFilenamesFromCoverage(coverage)
const relativeCoverageFiles = coverageFiles.map(file => getTestSuitePath(file, rootDir))
const formattedCoverage = {
sessionId: testSuiteSpan.context()._traceId,

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

no need to call .context() twice no ?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also in jest and mocha

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

everytime i use both spanId and traceId i usually "cache" the span context

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

true. Will change that

Comment thread packages/dd-trace/test/encode/coverage-ci-visibility.spec.js
simon-id
simon-id previously approved these changes May 22, 2023
uurien
uurien previously approved these changes May 22, 2023
Comment thread integration-tests/cypress/cypress.spec.js
@juan-fernandez
juan-fernandez requested a review from uurien May 22, 2023 14:32
@juan-fernandez
juan-fernandez merged commit ca96946 into master May 23, 2023
@juan-fernandez
juan-fernandez deleted the juan-fernandez/extra-coverage-from-cypress branch May 23, 2023 07:19
thedavl pushed a commit that referenced this pull request May 30, 2023
uurien pushed a commit that referenced this pull request Jun 1, 2023
uurien pushed a commit that referenced this pull request Jun 1, 2023
uurien pushed a commit that referenced this pull request Jun 1, 2023
This was referenced Jun 1, 2023
uurien pushed a commit that referenced this pull request Jun 2, 2023
uurien pushed a commit that referenced this pull request Jun 2, 2023
uurien pushed a commit that referenced this pull request Jun 2, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants