Skip to content

Add CI job to upload endpoint catalog CSV to S3#2346

Merged
GabrielAnca merged 1 commit into
masterfrom
gabriel.anca/add-catalog-endpoints-s3-upload
Jun 12, 2026
Merged

Add CI job to upload endpoint catalog CSV to S3#2346
GabrielAnca merged 1 commit into
masterfrom
gabriel.anca/add-catalog-endpoints-s3-upload

Conversation

@GabrielAnca

@GabrielAnca GabrielAnca commented Jun 9, 2026

Copy link
Copy Markdown
Contributor

Adds a GitLab CI job that runs on every push to master, generates the endpoint catalog CSV via yarn catalog-endpoints, and uploads it to the dd-datadog-ci S3 bucket using CI Identities for AWS authentication.

The job uses runner:docker (legacy EC2 runner) rather than arch:amd64 (Kubernetes). On Kubernetes, the CI Identities client communicates with the signer via Fabric DNS, which uses Datadog's private PKI — a public image like node:22 doesn't carry those CA certs and would fail TLS verification. On runner:docker, the client uses Vault instead, which uses a publicly trusted cert. The EC2 instance profile (ci-datadog-ci, provisioned via legacy-role: true) also provides the bootstrap credentials needed to download the CI Identities client binary from S3 before assume-role is called.

@datadog-prod-us1-4

datadog-prod-us1-4 Bot commented Jun 9, 2026

Copy link
Copy Markdown

Tests

🎉 All green!

🧪 All tests passed
❄️ No new flaky tests detected

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: afc13e8 | Docs | Datadog PR Page | Give us feedback!

@GabrielAnca GabrielAnca added the chores Related to the CI or developer experience label Jun 9, 2026
@GabrielAnca GabrielAnca changed the title [NO TICKET] Add CI job to upload endpoint catalog CSV to S3 Add CI job to upload endpoint catalog CSV to S3 Jun 10, 2026
@GabrielAnca
GabrielAnca force-pushed the gabriel.anca/add-catalog-endpoints-s3-upload branch 3 times, most recently from 029149e to 41ce6d5 Compare June 12, 2026 08:44
@GabrielAnca
GabrielAnca force-pushed the gabriel.anca/add-catalog-endpoints-s3-upload branch from 41ce6d5 to afc13e8 Compare June 12, 2026 08:45
@GabrielAnca
GabrielAnca marked this pull request as ready for review June 12, 2026 10:00
@GabrielAnca
GabrielAnca requested a review from a team as a code owner June 12, 2026 10:00
@GabrielAnca
GabrielAnca merged commit bd874ac into master Jun 12, 2026
60 of 61 checks passed
@GabrielAnca
GabrielAnca deleted the gabriel.anca/add-catalog-endpoints-s3-upload branch June 12, 2026 10:21
@GabrielAnca GabrielAnca mentioned this pull request Jun 17, 2026
@GabrielAnca GabrielAnca added the datadog-ci For PRs spanning multiple commands, and repo-wide changes label Jun 17, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

chores Related to the CI or developer experience datadog-ci For PRs spanning multiple commands, and repo-wide changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants