Skip to content

Flake in Pub/Sub samples test #6939

New issue
New issue
Open
Open
Flake in Pub/Sub samples test#6939
Labels
api: pubsubIssues related to the Pub/Sub API.flakeUsed to track tests that flake (and then ruthlessly crush them)samplesIssues that are directly related to samples.type: cleanupAn internal cleanup or hygiene concern.

Description

@github-actions
github-actions
bot
opened on Sep 22, 2026

Failure in Google Cloud Build on main:

Failed Builds:

Commit: 5ed78cd

Associated Pull Requests:

Activity

  1. github-actions
    assigned
    haphungw
    on Sep 22, 2026

  2. github-actions commented on Sep 22, 2026

    @github-actions
    github-actionsBot
    on Sep 22, 2026 – with GitHub Actions
    Author

    @googleapis/cloud-sdk-rust-team A critical issue has been created, please respond immediately.

  3. github-actions
    added
    🚨 criticalThis issue needs some love.
    on Sep 22, 2026

  4. coryan commented on Sep 22, 2026

    @coryan
    coryan
    on Sep 22, 2026
    Contributor

    Looks like a flake in the Pub/Sub samples:

    ---- tests::subscriptions_samples stdout ----
success on create_topic(): Topic { name: "projects/rust-sdk-testing/topics/topic-J0mVx7SsEdutQAvE8R4uI0p7meH7mkZlj7rNsoSlTz58VLJyjYezNAlQN1yFLuCm0rLxkhKaEePV0JCMh2G9WMGJLtRi77uXi1rPlgMKyOetwxLd55zHfbySrizK01gaRdtGrS2VKxp2tEOSlniGTw0IifzQNpMblF0qdjwE1URAq6KZqG7emhNNIok58wI4fFwiTQ38zUmmMu2CWnvIVMLnHfWbofd3jIvNA4xvnx7dPoMcrsjfWB3F0", labels: {"integration-test": "true", "create-time": "1790060632"}, message_storage_policy: Some(MessageStoragePolicy { allowed_persistence_regions: ["asia-east1", "asia-northeast1", "asia-northeast2", "asia-southeast1", "australia-southeast1", "europe-north1", "europe-north2", "europe-west1", "europe-west2", "europe-west3", "europe-west4", "southamerica-west1", "us-central1", "us-central2", "us-east1", "us-east4", "us-east5", "us-east7", "us-south1", "us-west1", "us-west2", "us-west3", "us-west4", "us-west8"], enforce_in_transit: false }), kms_key_name: "", schema_settings: None, satisfies_pzs: false, message_retention_duration: None, state: Unspecified, ingestion_data_source_settings: None, message_transforms: [], tags: {} }
successfully created subscription Subscription { name: "projects/rust-sdk-testing/subscriptions/subscription-2ow1jhFWEt7srhmrjQW3pFIcfblc8mTobKGYoNpXACjxVjkl5eIza2qNJHNSSQfmRETbQEiF5jWBVYn4Q7nJ4mEFaeotPUF5H2P6iIBNssZmsYTjQuulvgAmq6XsRPxGVO32vPdPFgCTRBqPKXrs4aXin4AI7DasMDctm2f6sQUiPZvbb8YdZjmeImdkQf0JRv1tdHGw0S7UIaw39pImikaHcR2GZltVdhQ23rN25CFXNxPEto", topic: "projects/rust-sdk-testing/topics/topic-J0mVx7SsEdutQAvE8R4uI0p7meH7mkZlj7rNsoSlTz58VLJyjYezNAlQN1yFLuCm0rLxkhKaEePV0JCMh2G9WMGJLtRi77uXi1rPlgMKyOetwxLd55zHfbySrizK01gaRdtGrS2VKxp2tEOSlniGTw0IifzQNpMblF0qdjwE1URAq6KZqG7emhNNIok58wI4fFwiTQ38zUmmMu2CWnvIVMLnHfWbofd3jIvNA4xvnx7dPoMcrsjfWB3F0", push_config: Some(PushConfig { push_endpoint: "", attributes: {}, authentication_method: None, wrapper: None }), bigquery_config: None, cloud_storage_config: None, bigtable_config: None, ack_deadline_seconds: 10, retain_acked_messages: false, message_retention_duration: Some(Duration { seconds: 604800, nanos: 0 }), labels: {}, enable_message_ordering: false, expiration_policy: Some(ExpirationPolicy { ttl: Some(Duration { seconds: 2678400, nanos: 0 }) }), filter: "", dead_letter_policy: None, retry_policy: None, detached: false, enable_exactly_once_delivery: false, topic_message_retention_duration: None, state: Active, analytics_hub_subscription_info: None, message_transforms: [], tags: {} }
listing subscriptions
Subscription { name: "projects/rust-sdk-testing/subscriptions/gcb-gcb-pubsub-terraform", topic: "projects/rust-sdk-testing/topics/terraform-runner", push_config: Some(PushConfig { push_endpoint: "rpc://name:CloudBuildPushEndpoint:gslb:google.pubsub.v1.cloudbuildpushendpoint-prod-us-central1", attributes: {"x-goog-version": "v1"}, authentication_method: None, wrapper: None }), bigquery_config: None, cloud_storage_config: None, bigtable_config: None, ack_deadline_seconds: 10, retain_acked_messages: false, message_retention_duration: Some(Duration { seconds: 604800, nanos: 0 }), labels: {}, enable_message_ordering: false, expiration_policy: Some(ExpirationPolicy { ttl: None }), filter: "", dead_letter_policy: None, retry_policy: None, detached: false, enable_exactly_once_delivery: false, topic_message_retention_duration: None, state: Active, analytics_hub_subscription_info: None, message_transforms: [], tags: {} }
Subscription { name: "projects/rust-sdk-testing/subscriptions/subscription-2ow1jhFWEt7srhmrjQW3pFIcfblc8mTobKGYoNpXACjxVjkl5eIza2qNJHNSSQfmRETbQEiF5jWBVYn4Q7nJ4mEFaeotPUF5H2P6iIBNssZmsYTjQuulvgAmq6XsRPxGVO32vPdPFgCTRBqPKXrs4aXin4AI7DasMDctm2f6sQUiPZvbb8YdZjmeImdkQf0JRv1tdHGw0S7UIaw39pImikaHcR2GZltVdhQ23rN25CFXNxPEto", topic: "projects/rust-sdk-testing/topics/topic-J0mVx7SsEdutQAvE8R4uI0p7meH7mkZlj7rNsoSlTz58VLJyjYezNAlQN1yFLuCm0rLxkhKaEePV0JCMh2G9WMGJLtRi77uXi1rPlgMKyOetwxLd55zHfbySrizK01gaRdtGrS2VKxp2tEOSlniGTw0IifzQNpMblF0qdjwE1URAq6KZqG7emhNNIok58wI4fFwiTQ38zUmmMu2CWnvIVMLnHfWbofd3jIvNA4xvnx7dPoMcrsjfWB3F0", push_config: Some(PushConfig { push_endpoint: "", attributes: {}, authentication_method: None, wrapper: None }), bigquery_config: None, cloud_storage_config: None, bigtable_config: None, ack_deadline_seconds: 10, retain_acked_messages: false, message_retention_duration: Some(Duration { seconds: 604800, nanos: 0 }), labels: {}, enable_message_ordering: false, expiration_policy: Some(ExpirationPolicy { ttl: Some(Duration { seconds: 2678400, nanos: 0 }) }), filter: "", dead_letter_policy: None, retry_policy: None, detached: false, enable_exactly_once_delivery: false, topic_message_retention_duration: None, state: Active, analytics_hub_subscription_info: None, message_transforms: [], tags: {} }
DONE
listening for messages...
listening for messages...
listening for messages on stream 3...
listening for messages...
listening for messages on stream 1...
listening for messages on stream 0...
listening for messages on stream 2...
listening for messages...
listening for messages...
successfully created subscription Subscription { name: "projects/rust-sdk-testing/subscriptions/subscription-k2MsHWYADT87Ni3D2BonfES2qeBl62Hn96LPg8qrAMFfLryuYCjLpgZ1IGNdUcLBpMsII27ZG3NuYSYpo2eK9qkpNmIK8KslZSlifyPqajp6yVH8SR6pWQyKyS1wgdrTXXfy1EmAEPV051PbmNgTfi1o6B4ntdmneDaeSBmRWYcWCJp1FsIZjSSwa2ytQbE3QrSqHenuKMWm64YrNgX83p8fAF1CnPt8vHQdzfLgSAVjiNHtRk", topic: "projects/rust-sdk-testing/topics/topic-J0mVx7SsEdutQAvE8R4uI0p7meH7mkZlj7rNsoSlTz58VLJyjYezNAlQN1yFLuCm0rLxkhKaEePV0JCMh2G9WMGJLtRi77uXi1rPlgMKyOetwxLd55zHfbySrizK01gaRdtGrS2VKxp2tEOSlniGTw0IifzQNpMblF0qdjwE1URAq6KZqG7emhNNIok58wI4fFwiTQ38zUmmMu2CWnvIVMLnHfWbofd3jIvNA4xvnx7dPoMcrsjfWB3F0", push_config: Some(PushConfig { push_endpoint: "", attributes: {}, authentication_method: None, wrapper: None }), bigquery_config: None, cloud_storage_config: None, bigtable_config: None, ack_deadline_seconds: 60, retain_acked_messages: false, message_retention_duration: Some(Duration { seconds: 604800, nanos: 0 }), labels: {}, enable_message_ordering: false, expiration_policy: Some(ExpirationPolicy { ttl: Some(Duration { seconds: 2678400, nanos: 0 }) }), filter: "", dead_letter_policy: None, retry_policy: None, detached: false, enable_exactly_once_delivery: true, topic_message_retention_duration: None, state: Active, analytics_hub_subscription_info: None, message_transforms: [], tags: {} }
Listening for messages...
done listening for messages
done listening for messages
done listening for messages
done listening for messages
done listening for messages
done listening for messages
Done listening for messages
Done acking messages
Error cleaning up subscription projects/rust-sdk-testing/subscriptions/subscription-UE2Go8UWvgYhNqnASyv7qAizUIV9SWsWUcn8aGTJpfre1ncjwpQLzz5IqmWmk37iidBdYoCkA2THnk4bzukaZ46P3pHIywkoF9zfBA6lJtiaZqFFS4qjheXZKWBTO9AnXD0h5D0bAi2ZmjqooMHknkAjDwKQynejOsxxta4DQvo3wB7s19FFAqPPPcFLSGPv7oDdQYNAgoBwu1dVpQn05zrVJQKICSzWNZ67oYZ7tZ9NPgf2AU: the service reports an error with code NOT_FOUND described as: Resource not found (resource=subscription-UE2Go8UWvgYhNqnASyv7qAizUIV9SWsWUcn8aGTJpfre1ncjwpQLzz5IqmWmk37iidBdYoCkA2THnk4bzukaZ46P3pHIywkoF9zfBA6lJtiaZqFFS4qjheXZKWBTO9AnXD0h5D0bAi2ZmjqooMHknkAjDwKQynejOsxxta4DQvo3wB7s19FFAqPPPcFLSGPv7oDdQYNAgoBwu1dVpQn05zrVJQKICSzWNZ67oYZ7tZ9NPgf2AU).
full error: the service reports an error with code NOT_FOUND described as: Resource not found (resource=subscription-UE2Go8UWvgYhNqnASyv7qAizUIV9SWsWUcn8aGTJpfre1ncjwpQLzz5IqmWmk37iidBdYoCkA2THnk4bzukaZ46P3pHIywkoF9zfBA6lJtiaZqFFS4qjheXZKWBTO9AnXD0h5D0bAi2ZmjqooMHknkAjDwKQynejOsxxta4DQvo3wB7s19FFAqPPPcFLSGPv7oDdQYNAgoBwu1dVpQn05zrVJQKICSzWNZ67oYZ7tZ9NPgf2AU).
  because: Error { kind: Service(ServiceDetails { status_code: Some(404), headers: Some({"vary": "X-Origin", "vary": "Referer", "vary": "Origin,Accept-Encoding", "content-type": "application/json; charset=UTF-8", "date": "Tue, 22 Sep 2026 07:04:56 GMT", "server": "ESF", "x-xss-protection": "0", "x-frame-options": "SAMEORIGIN", "x-content-type-options": "nosniff", "accept-ranges": "none", "transfer-encoding": "chunked"}), status: Status { code: NotFound, message: "Resource not found (resource=subscription-UE2Go8UWvgYhNqnASyv7qAizUIV9SWsWUcn8aGTJpfre1ncjwpQLzz5IqmWmk37iidBdYoCkA2THnk4bzukaZ46P3pHIywkoF9zfBA6lJtiaZqFFS4qjheXZKWBTO9AnXD0h5D0bAi2ZmjqooMHknkAjDwKQynejOsxxta4DQvo3wB7s19FFAqPPPcFLSGPv7oDdQYNAgoBwu1dVpQn05zrVJQKICSzWNZ67oYZ7tZ9NPgf2AU).", details: [] } }), source: None }
Error: the request exceeded the request deadline error sending request for url (https://pubsub.googleapis.com/v1/projects/rust-sdk-testing/subscriptions/subscription-UE2Go8UWvgYhNqnASyv7qAizUIV9SWsWUcn8aGTJpfre1ncjwpQLzz5IqmWmk37iidBdYoCkA2THnk4bzukaZ46P3pHIywkoF9zfBA6lJtiaZqFFS4qjheXZKWBTO9AnXD0h5D0bAi2ZmjqooMHknkAjDwKQynejOsxxta4DQvo3wB7s19FFAqPPPcFLSGPv7oDdQYNAgoBwu1dVpQn05zrVJQKICSzWNZ67oYZ7tZ9NPgf2AU?%24alt=json%3Benum-encoding%3Dint)

Caused by:
    0: error sending request for url (https://pubsub.googleapis.com/v1/projects/rust-sdk-testing/subscriptions/subscription-UE2Go8UWvgYhNqnASyv7qAizUIV9SWsWUcn8aGTJpfre1ncjwpQLzz5IqmWmk37iidBdYoCkA2THnk4bzukaZ46P3pHIywkoF9zfBA6lJtiaZqFFS4qjheXZKWBTO9AnXD0h5D0bAi2ZmjqooMHknkAjDwKQynejOsxxta4DQvo3wB7s19FFAqPPPcFLSGPv7oDdQYNAgoBwu1dVpQn05zrVJQKICSzWNZ67oYZ7tZ9NPgf2AU?%24alt=json%3Benum-encoding%3Dint)
    1: operation timed out


failures:
    tests::subscriptions_samples

test result: FAILED. 3 passed; 1 failed; 0 ignored; 0 measured; 0 filtered out; finished in 63.83s

error: test failed, to rerun pass `-p pubsub-samples --test integration`
Finished Step #3 - "Run integration tests"
ERROR
ERROR: build step 3 "rust:1.98-bookworm" failed: step exited with non-zero status: 101
  5. coryan
    unassigned
    haphungw
    on Sep 22, 2026
  6. coryan
    changed the title [-]Post-merge failure[/-] [+]Flake in Pub/Sub samples test[/+] on Sep 22, 2026
  7. coryan
    added
    api: pubsubIssues related to the Pub/Sub API.
    flakeUsed to track tests that flake (and then ruthlessly crush them)
    and removed
    🚨 criticalThis issue needs some love.
    on Sep 22, 2026
  8. product-auto-label
    added
    samplesIssues that are directly related to samples.
    on Sep 23, 2026

  9. dbolduc commented on Oct 15, 2026

    @dbolduc
    dbolduc
    on Oct 15, 2026
    Member

    https://pantheon.corp.google.com/cloud-build/builds;region=us-central1/6c567e0b-301b-467c-a748-c8ff839e43cd;step=3?project=rust-sdk-testing

  10. dbolduc commented on Oct 19, 2026

    @dbolduc
    dbolduc
    on Oct 19, 2026
    Member

    https://pantheon.corp.google.com/cloud-build/builds;region=us-central1/806ebddf-7ae5-4681-b466-0e18fc1865cf;step=3?project=rust-sdk-testing

  11. coryan
    added
    type: cleanupAn internal cleanup or hygiene concern.
    on Oct 27, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    api: pubsubIssues related to the Pub/Sub API.flakeUsed to track tests that flake (and then ruthlessly crush them)samplesIssues that are directly related to samples.type: cleanupAn internal cleanup or hygiene concern.

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions