Skip to content

Conversation

@huydhn
Copy link
Contributor

@huydhn huydhn commented Aug 14, 2025

My proposal here is to use GitHub Dependabot to make sure that transformers version used in CI are always up-to-date. To achieve this, this PR does 2 things:

  1. Pin transformers version across all CI jobs to only one place at .ci/docker/ci_commit_pins/huggingface.txt. This file is now a regular pip requirements instead of a pinned commit text. There isn't any need to pin transformers to a specific commit and the file already refers to a stable version v4.54.0
  2. Create .github/dependabot.yml to config the bot to update transformers automatically when there is a new version. Those labels will ensure that the right reviewers from torch.compile and Dev Infra are notified. I'm not sure how to test this out in PR, but it feels ok to land and test this in main. If this works, we should see a PR to update v4.54.0 to the current latest v4.55.0

Reference

https://docs.github.com/en/code-security/dependabot/working-with-dependabot/dependabot-options-reference

@huydhn huydhn requested review from anijain2305 and malfet August 14, 2025 10:26
@huydhn huydhn requested review from a team and jeffdaily as code owners August 14, 2025 10:26
@pytorch-bot
Copy link

pytorch-bot bot commented Aug 14, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/160635

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 51c3412 with merge base 838f22c (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@huydhn huydhn requested a review from ZainRizvi August 15, 2025 21:03
Copy link
Contributor

@ZainRizvi ZainRizvi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I like it. We should do this more often

Approved pending the file rename fix

@huydhn huydhn force-pushed the autoupdate-transformers-pin-via-pr branch from c4cb900 to fde6933 Compare August 15, 2025 23:42
Signed-off-by: Huy Do <[email protected]>
@huydhn
Copy link
Contributor Author

huydhn commented Aug 16, 2025

@pytorchbot merge

@pytorch-bot pytorch-bot bot added the ciflow/trunk Trigger trunk jobs on your pull request label Aug 16, 2025
@huydhn huydhn added test-config/default and removed ciflow/trunk Trigger trunk jobs on your pull request labels Aug 16, 2025
@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

pytorchmergebot pushed a commit that referenced this pull request Aug 19, 2025
After #160635, I can see dependabot creating the PR to bump `transformers` version at #160807.  This a good start, but there are several tweaks we need:

1. Run inductor tests on the PR including one round of perf benchmark, which is always needed.  So, we need `ciflow/inductor` label and a `pull_request` trigger for the benchmark
2. Per @anijain2305 feedback, we don't need to update patch version.  So, I add a rule to ignore it.  Again, we would need to test this out after this lands.
Pull Request resolved: #160935
Approved by: https://github.com/anijain2305
can-gaa-hou pushed a commit to can-gaa-hou/pytorch that referenced this pull request Aug 22, 2025
…0635)

My proposal here is to use GitHub Dependabot to make sure that `transformers` version used in CI are always up-to-date.  To achieve this, this PR does 2 things:

1. Pin `transformers` version across all CI jobs to only one place at `.ci/docker/ci_commit_pins/huggingface.txt`.  This file is now a regular pip requirements instead of a pinned commit text.  There isn't any need to pin `transformers` to a specific commit and the file already refers to a stable version `v4.54.0`
2. Create `.github/dependabot.yml` to config the bot to update `transformers` automatically when there is a new version.  Those labels will ensure that the right reviewers from torch.compile and Dev Infra are notified.  I'm not sure how to test this out in PR, but it feels ok to land and test this in main.  If this works, we should see a PR to update `v4.54.0` to the current latest `v4.55.0`

### Reference
https://docs.github.com/en/code-security/dependabot/working-with-dependabot/dependabot-options-reference
Pull Request resolved: pytorch#160635
Approved by: https://github.com/ZainRizvi
@github-actions github-actions bot deleted the autoupdate-transformers-pin-via-pr branch September 16, 2025 02:07
markc-614 pushed a commit to markc-614/pytorch that referenced this pull request Sep 17, 2025
…0635)

My proposal here is to use GitHub Dependabot to make sure that `transformers` version used in CI are always up-to-date.  To achieve this, this PR does 2 things:

1. Pin `transformers` version across all CI jobs to only one place at `.ci/docker/ci_commit_pins/huggingface.txt`.  This file is now a regular pip requirements instead of a pinned commit text.  There isn't any need to pin `transformers` to a specific commit and the file already refers to a stable version `v4.54.0`
2. Create `.github/dependabot.yml` to config the bot to update `transformers` automatically when there is a new version.  Those labels will ensure that the right reviewers from torch.compile and Dev Infra are notified.  I'm not sure how to test this out in PR, but it feels ok to land and test this in main.  If this works, we should see a PR to update `v4.54.0` to the current latest `v4.55.0`

### Reference
https://docs.github.com/en/code-security/dependabot/working-with-dependabot/dependabot-options-reference
Pull Request resolved: pytorch#160635
Approved by: https://github.com/ZainRizvi
markc-614 pushed a commit to markc-614/pytorch that referenced this pull request Sep 17, 2025
After pytorch#160635, I can see dependabot creating the PR to bump `transformers` version at pytorch#160807.  This a good start, but there are several tweaks we need:

1. Run inductor tests on the PR including one round of perf benchmark, which is always needed.  So, we need `ciflow/inductor` label and a `pull_request` trigger for the benchmark
2. Per @anijain2305 feedback, we don't need to update patch version.  So, I add a rule to ignore it.  Again, we would need to test this out after this lands.
Pull Request resolved: pytorch#160935
Approved by: https://github.com/anijain2305
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants