Type of Request

bug

Infrastructure Environment

felt tests (flutter/engine tests on the web platform)

What is happening?

It seems that some felt test suites are not re-generating the flutter_js asset as needed. This makes them order-dependent with other bits of the testing infrastructure of the repo (and seemingly random when validating locally). For example:

• test/fallbacks/fallbacks_test.dart

Steps to reproduce

On a flutter/engine checkout:

1. Remove src/out/web_tests to remove all the test-related stuff
2. Attempt to run the test above: felt test test/fallbacks/fallbacks_test.dart
   • The test will time-out after 12 minutes.
3. ... Alternatively, for more output: felt test --debug --start-paused test/fallbacks/fallbacks_test.dart
   • Look at the network panel, and you'll see that the fluter_js/flutter.js is a 404 error.
4. Also check how: src/out/web_tests/artifacts/flutter_js doesn't exist.

To recover from this, you may run other suite:

1. Run: felt test test/engine/canvas_test.dart
2. Check src/out/web_tests/artifacts/flutter_js now.

Expected results

I'd expect to be able to run test/fallbacks/fallbacks_test.dart without needing side effects from other tests existing first.