Skip to content

chore: add flutter/tests customer testing script#1528

Merged
spydon merged 1 commit into
mainfrom
chore/flutter-tests-customer-testing
Jul 6, 2026
Merged

chore: add flutter/tests customer testing script#1528
spydon merged 1 commit into
mainfrom
chore/flutter-tests-customer-testing

Conversation

@spydon

@spydon spydon commented Jul 3, 2026

Copy link
Copy Markdown
Contributor

What

Adds scripts/customer_testing.dart, the entry point invoked by the flutter/tests registry to run this repository's tests as a presubmit against flutter/flutter framework changes.

This is the supabase-flutter counterpart of what Flame did in flutter/tests#489. A companion PR to flutter/tests adds the registry/supabase_flutter.test entry that clones this repo at a pinned commit and runs this script.

What the script does

  1. flutter analyze --no-fatal-infos over the whole pub workspace (covers every member package).
  2. flutter test in packages/supabase_flutter.

Only supabase_flutter is exercised because it is hermetic (mock/stub based). The other packages' tests require a live Supabase backend and are therefore not eligible for the registry, which requires hermetic tests (no network, no spawned services).

Why

So that Flutter framework regressions affecting supabase_flutter are caught upstream, before they reach a stable Flutter release.

Notes

  • The registry only honors changes here once the pinned commit in the flutter/tests entry is updated (revision bumps are periodic PRs to flutter/tests).
  • Verified locally: dart run scripts/customer_testing.dart passes (analyze clean, 57 tests pass).

Part of SDK-1216

@Vinzent03

Copy link
Copy Markdown
Collaborator

In my opinion the supabase_flutter packages does not contain enough tests to make this really worth it. The majority is not even really related to Flutter itself but rather Dart only tests.
I don't want to block this or something, but just my opinion here.

@spydon

spydon commented Jul 6, 2026

Copy link
Copy Markdown
Contributor Author

In my opinion the supabase_flutter packages does not contain enough tests to make this really worth it. The majority is not even really related to Flutter itself but rather Dart only tests. I don't want to block this or something, but just my opinion here.

Since it's very little work for us to have this (no maintenance cost) in the test registry, I think this is good to have set up for the future when there will be more test. A full suite of integration tests with all features are planned for example.

@spydon
spydon merged commit afad09d into main Jul 6, 2026
19 checks passed
@spydon
spydon deleted the chore/flutter-tests-customer-testing branch July 6, 2026 08:37
auto-submit Bot pushed a commit to flutter/tests that referenced this pull request Jul 6, 2026
Adds a registry entry for [supabase-flutter](https://github.com/supabase/supabase-flutter), the official Supabase client library for Flutter/Dart, so that framework changes are checked against its tests as a presubmit.

Follows the same pattern as the Flame entry (#489): the entry clones supabase-flutter at a pinned commit and runs `scripts/customer_testing.dart`, which:

1. Runs `flutter analyze --no-fatal-infos` over the whole pub workspace (covers every member package).
2. Runs `flutter test` in `packages/supabase_flutter`.

Only `supabase_flutter` is exercised because it is hermetic (mock/stub based). The repo's other packages have tests that require a live Supabase backend, so they are not included here.

The `scripts/customer_testing.dart` script is added in supabase/supabase-flutter#1528.

contact: [email protected]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants