-
Notifications
You must be signed in to change notification settings - Fork 26.3k
[pytorch] [distributed] [easy] Corrected variable name and added test #26503
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
[pytorch] [distributed] Corrected variable name and added test Differential Revision: [D17488846](https://our.internmc.facebook.com/intern/diff/D17488846/) [ghstack-poisoned]
[pytorch] [distributed] Corrected variable name and added test Differential Revision: [D17488846](https://our.internmc.facebook.com/intern/diff/D17488846/) ghstack-source-id: 90454793 Pull Request resolved: #26503
| # TODO: add try-except and destroy _agent in all processes if any fails. | ||
| _agent = ProcessGroupAgent(self_name, group, num_send_recv_threads) | ||
| init_rref_context(_agent) | ||
| elif is_backend_registered(rpc_backend): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Was this code covered by tests earlier? Why didn't we see some sort of failure since rpc_backend wasn't initialized anywhere?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This wasn't covered by any tests, just added one for invalid backend.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
My bad, didn't spot this in last review.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Don't feel bad Shen, it was my diff, I am too used to letting c/c++ compiler catching undeclared variables, getting used to python.
| # TODO: add try-except and destroy _agent in all processes if any fails. | ||
| _agent = ProcessGroupAgent(self_name, group, num_send_recv_threads) | ||
| init_rref_context(_agent) | ||
| elif is_backend_registered(rpc_backend): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
My bad, didn't spot this in last review.
|
This pull request has been merged in b401e9d. |
Summary: Pull Request resolved: pytorch#26503 [pytorch] [distributed] Corrected variable name and added test ghstack-source-id: 90454793 Test Plan: Made sure pg based UT works. Differential Revision: D17488846 fbshipit-source-id: 6e6cba110a6f61ee1af3d37c5a41c69701de1a8b
Stack from ghstack:
[pytorch] [distributed] Corrected variable name and added test
Differential Revision: D17488846