Skip to content

refactor(test-optimization)!: raise Playwright minimum version to 1.38.0#5596

Merged
Mariovido merged 9 commits into
masterfrom
mario.vidal/remove-playwright-1.38.0
May 23, 2025
Merged

refactor(test-optimization)!: raise Playwright minimum version to 1.38.0#5596
Mariovido merged 9 commits into
masterfrom
mario.vidal/remove-playwright-1.38.0

Conversation

@Mariovido

@Mariovido Mariovido commented Apr 21, 2025

Copy link
Copy Markdown
Contributor

What does this PR do?

With this we are incresing the minimum supported version of playwright to the version 1.38.0 for v6 and posterior.

This should be a noop for v5.

Motivation

We want to stop having features depend on the test framework's version. v1.38.0 is ~2 years old and we'll maintain compatibility in v5 for a year, so I think that's reasonable.

Plugin Checklist

  • Unit tests.

@github-actions

github-actions Bot commented Apr 21, 2025

Copy link
Copy Markdown
Contributor

Overall package size

Self size: 9.42 MB
Deduped: 103.45 MB
No deduping: 103.97 MB

Dependency sizes | name | version | self size | total size | |------|---------|-----------|------------| | @datadog/libdatadog | 0.5.1 | 29.73 MB | 29.73 MB | | @datadog/native-appsec | 8.5.2 | 19.33 MB | 19.34 MB | | @datadog/pprof | 5.8.0 | 12.55 MB | 12.92 MB | | @datadog/native-iast-taint-tracking | 4.0.0 | 11.72 MB | 11.73 MB | | @opentelemetry/core | 1.30.1 | 908.66 kB | 7.16 MB | | protobufjs | 7.4.0 | 2.77 MB | 5.42 MB | | @datadog/wasm-js-rewriter | 4.0.1 | 2.85 MB | 3.58 MB | | @datadog/native-metrics | 3.1.1 | 1.02 MB | 1.43 MB | | @opentelemetry/api | 1.8.0 | 1.21 MB | 1.21 MB | | import-in-the-middle | 1.13.1 | 117.64 kB | 839.26 kB | | source-map | 0.7.4 | 226 kB | 226 kB | | opentracing | 0.14.7 | 194.81 kB | 194.81 kB | | lru-cache | 7.18.3 | 133.92 kB | 133.92 kB | | pprof-format | 2.1.0 | 111.69 kB | 111.69 kB | | @datadog/sketches-js | 2.1.1 | 109.9 kB | 109.9 kB | | lodash.sortby | 4.7.0 | 75.76 kB | 75.76 kB | | ignore | 5.3.2 | 53.63 kB | 53.63 kB | | istanbul-lib-coverage | 3.2.0 | 29.34 kB | 29.34 kB | | rfdc | 1.4.1 | 27.15 kB | 27.15 kB | | @isaacs/ttlcache | 1.4.1 | 25.2 kB | 25.2 kB | | dc-polyfill | 0.1.8 | 25.08 kB | 25.08 kB | | tlhunter-sorted-set | 0.1.0 | 24.94 kB | 24.94 kB | | shell-quote | 1.8.2 | 23.54 kB | 23.54 kB | | limiter | 1.1.5 | 23.17 kB | 23.17 kB | | retry | 0.13.1 | 18.85 kB | 18.85 kB | | semifies | 1.0.0 | 15.84 kB | 15.84 kB | | jest-docblock | 29.7.0 | 8.99 kB | 12.76 kB | | crypto-randomuuid | 1.0.0 | 11.18 kB | 11.18 kB | | ttl-set | 1.0.0 | 4.61 kB | 9.69 kB | | mutexify | 1.4.0 | 5.71 kB | 8.74 kB | | path-to-regexp | 0.1.12 | 6.6 kB | 6.6 kB | | koalas | 1.0.2 | 6.47 kB | 6.47 kB | | module-details-from-path | 1.0.3 | 4.47 kB | 4.47 kB |

🤖 This report was automatically generated by heaviest-objects-in-the-universe

@codecov

codecov Bot commented Apr 21, 2025

Copy link
Copy Markdown

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 79.15%. Comparing base (86f1f53) to head (a2e90e3).
Report is 2 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #5596      +/-   ##
==========================================
- Coverage   79.15%   79.15%   -0.01%     
==========================================
  Files         520      520              
  Lines       23729    23729              
==========================================
- Hits        18783    18782       -1     
- Misses       4946     4947       +1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@pr-commenter

pr-commenter Bot commented Apr 21, 2025

Copy link
Copy Markdown

Benchmarks

Benchmark execution time: 2025-05-22 14:51:27

Comparing candidate commit a2e90e3 in PR branch mario.vidal/remove-playwright-1.38.0 with baseline commit 86f1f53 in branch master.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 1268 metrics, 55 unstable metrics.

@datadog-datadog-prod-us1

datadog-datadog-prod-us1 Bot commented Apr 21, 2025

Copy link
Copy Markdown

Datadog Report

Branch report: mario.vidal/remove-playwright-1.38.0
Commit report: 6e72c0d
Test service: dd-trace-js-integration-tests

✅ 0 Failed, 1027 Passed, 0 Skipped, 20m 7.88s Total Time
❄️ 1 New Flaky

New Flaky Tests (1)

  • cypress@latest esm flaky test retries retries flaky tests - integration-tests/cypress/cypress.spec.js - Last Failure

    Expand for error
     expected +0 to equal 1
    

@Mariovido
Mariovido force-pushed the mario.vidal/remove-playwright-1.38.0 branch from 59c825f to 4201910 Compare April 24, 2025 15:21
@Mariovido Mariovido changed the title [do not merge] [SDTEST-1884] Increase minimum supported version of playwright (breaking change) [test-optimization] [SDTEST-1884] Increase minimum supported version of playwright (breaking change) May 9, 2025
@Mariovido
Mariovido force-pushed the mario.vidal/remove-playwright-1.38.0 branch from c43d561 to f260aa7 Compare May 19, 2025 10:28
@juan-fernandez
juan-fernandez marked this pull request as ready for review May 22, 2025 14:39
@juan-fernandez
juan-fernandez requested a review from a team as a code owner May 22, 2025 14:39

@juan-fernandez juan-fernandez left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Mariovido I've simplified the logic in the PR a bit. Have a look and let me know if it makes sense to you

@Mariovido
Mariovido merged commit dc92b29 into master May 23, 2025
@Mariovido
Mariovido deleted the mario.vidal/remove-playwright-1.38.0 branch May 23, 2025 08:44
ghost pushed a commit that referenced this pull request May 24, 2025
@ghost ghost mentioned this pull request May 24, 2025
ghost pushed a commit that referenced this pull request May 27, 2025
@ghost ghost mentioned this pull request May 27, 2025
watson pushed a commit that referenced this pull request Jun 4, 2025
@juan-fernandez juan-fernandez added this to the 6.0.0 milestone Nov 6, 2025
@pabloerhard pabloerhard changed the title [test-optimization] [SDTEST-1884] Increase minimum supported version of playwright (breaking change) refactor(test-optimization)!: raise Playwright minimum version to 1.38.0 Jul 2, 2026
@dd-octo-sts dd-octo-sts Bot mentioned this pull request Jul 2, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants