wpt: Enable WebDriver by default when running WPT#40291
wpt: Enable WebDriver by default when running WPT#40291mrobinson merged 2 commits intoservo:mainfrom
Conversation
|
Here is an explanation of the tests with different results: Failures
Failing differently
Progressions
Final batch of
|
|
🔨 Triggering try run (#18952236655) for Linux (WPT) |
|
Oh, one final, bad, thing about this is that it increases the number of tests that authentically flake (have different results when run again) by 20. I suspect that a good number of those might be |
|
Test results for linux-wpt from try job (#18952236655): Flaky unexpected result (46)
Stable unexpected results that are known to be intermittent (18)
Stable unexpected results (2)
|
|
|
|
🔨 Triggering try run (#18953271768) for Linux (WPT) |
|
Test results for linux-wpt from try job (#18953271768): Flaky unexpected result (43)
Stable unexpected results that are known to be intermittent (22)
Stable unexpected results (2)
|
|
|
|
🔨 Triggering try run (#18955392751) for Linux (WPT) |
|
Test results for linux-wpt from try job (#18955392751): Flaky unexpected result (38)
Stable unexpected results that are known to be intermittent (17)
Stable unexpected results (3)
|
|
|
|
🔨 Triggering try run (#18959141079) for Linux (WPT) |
|
Test results for linux-wpt from try job (#18959141079): Flaky unexpected result (38)
Stable unexpected results that are known to be intermittent (25)
Stable unexpected results (2)
|
|
|
|
It seems all these high-frequency stable result should just be filed intermittent. |
|
🔨 Triggering try run (#18962653380) for Linux (WPT) |
|
Test results for linux-wpt from try job (#18962653380): Flaky unexpected result (46)
Stable unexpected results that are known to be intermittent (26)
|
|
✨ Try run (#18962653380) succeeded. |
|
🔨 Triggering try run (#19042208799) for Linux (WPT) |
|
Test results for linux-wpt from try job (#19042208799): Flaky unexpected result (41)
Stable unexpected results that are known to be intermittent (26)
Stable unexpected results (1)
|
|
|
Signed-off-by: Martin Robinson <[email protected]>
1400894 to
87bb90f
Compare
|
🔨 Triggering try run (#19043981308) for Linux (WPT) |
|
Test results for linux-wpt from try job (#19043981308): Flaky unexpected result (44)
Stable unexpected results that are known to be intermittent (29)
Stable unexpected results (1)
|
|
|
|
🔨 Triggering try run (#19050220873) for Linux (WPT) |
|
Test results for linux-wpt from try job (#19050220873): Flaky unexpected result (38)
Stable unexpected results that are known to be intermittent (29)
|
|
✨ Try run (#19050220873) succeeded. |
|
🔨 Triggering try run (#19050930595) for Linux (WPT) |
|
Test results for linux-wpt from try job (#19050930595): Flaky unexpected result (53)
Stable unexpected results that are known to be intermittent (33)
|
|
✨ Try run (#19050930595) succeeded. |
|
Okay. Let's give this a shot! |
This change switches the default test runner for WPT to be WebDriver,
enabling testdriver tests by default. In addition, it update results to
reflect the ones that you would expect when running with WebDriver.
While there are some failures that require more investigation, in
general the differences in results are fairly explicable.
Testing: This change modifies the way that tests are run and is thus
tested by all WPT-like tests.
Fixes: #34683