Skip to content

Conversation

@zengk95
Copy link
Contributor

@zengk95 zengk95 commented May 17, 2022

Since we released on-green, some people have requested an all green option to include everything.

I was thinking of how to best add this into find_matching_merge_rule but I couldn't think of a good a great way since the option isn't really a merge_rule, rather overriding it so I just put it outside the method.

@facebook-github-bot
Copy link
Contributor

facebook-github-bot commented May 17, 2022

🔗 Helpful links

❌ 4 New Failures

As of commit f04e6a9 (more details on the Dr. CI page):

Expand to see more
  • 4/4 failures introduced in this PR

🕵️ 4 new failures recognized by patterns

The following CI failures do not appear to be due to upstream breakages

See GitHub Actions build pull / linux-docs / build-docs (cpp) (1/4)

Step: "Unknown" (full log | diagnosis details | 🔁 rerun)

2022-05-24T01:31:18.3357454Z ##[error]The operation was canceled.
2022-05-24T01:30:33.9796770Z Resolving deltas:  45% (684875/1516659)
2022-05-24T01:30:34.5771176Z Resolving deltas:  45% (696116/1516659)
2022-05-24T01:30:38.4504928Z Resolving deltas:  46% (702300/1516659)
2022-05-24T01:30:38.5563080Z Resolving deltas:  47% (722302/1516659)
2022-05-24T01:30:39.3411510Z Resolving deltas:  47% (722765/1516659)
2022-05-24T01:30:49.2381432Z Resolving deltas:  48% (728944/1516659)
2022-05-24T01:30:55.9015794Z Resolving deltas:  50% (772584/1516659)
2022-05-24T01:30:59.1222816Z Resolving deltas:  52% (800053/1516659)
2022-05-24T01:31:01.3679436Z Resolving deltas:  53% (813945/1516659)
2022-05-24T01:31:14.7048446Z Resolving deltas:  54% (824941/1516659)
2022-05-24T01:31:18.3357454Z ##[error]The operation was canceled.
2022-05-24T01:31:18.3380093Z Prepare all required actions
2022-05-24T01:31:18.3406545Z ##[group]Run ./.github/actions/chown-workspace
2022-05-24T01:31:18.3406906Z env:
2022-05-24T01:31:18.3407178Z   IN_CI: 1
2022-05-24T01:31:18.3407447Z   IS_GHA: 1
2022-05-24T01:31:18.3407814Z ##[endgroup]
2022-05-24T01:31:18.3429347Z ##[group]Run docker run --rm -v "$(pwd)":/v -w /v "${ALPINE_IMAGE}" chown -R "$(id -u):$(id -g)" .
2022-05-24T01:31:18.3430181Z �[36;1mdocker run --rm -v "$(pwd)":/v -w /v "${ALPINE_IMAGE}" chown -R "$(id -u):$(id -g)" .�[0m
2022-05-24T01:31:18.3445874Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2022-05-24T01:31:18.3446263Z env:

See GitHub Actions build pull / pytorch-xla-linux-bionic-py3.7-clang8 / test (xla, 1, 1, linux.2xlarge) (2/4)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-05-24T01:14:33.1151671Z AssertionError: Missing shape inference function.
2022-05-24T01:14:31.2765164Z PyTorch Commit ID: f04e6a9e25f25d303b0193fc1adf2ef9bafa5091
2022-05-24T01:14:31.2828973Z /var/lib/jenkins/workspace /var/lib/jenkins/workspace/xla
2022-05-24T01:14:32.4101165Z /var/lib/jenkins/workspace/xla
2022-05-24T01:14:33.1147597Z Traceback (most recent call last):
2022-05-24T01:14:33.1148170Z   File "/var/lib/jenkins/workspace/xla/scripts/gen_lazy_tensor.py", line 83, in <module>
2022-05-24T01:14:33.1148818Z     get_device_fn="torch_xla::bridge::GetXlaDevice")
2022-05-24T01:14:33.1149514Z   File "/opt/conda/lib/python3.7/site-packages/torchgen/gen_lazy_tensor.py", line 409, in run_gen_lazy_tensor
2022-05-24T01:14:33.1150110Z     validate_shape_inference_header(shape_inference_hdr, expected_shape_infr_decls)
2022-05-24T01:14:33.1151013Z   File "/opt/conda/lib/python3.7/site-packages/torchgen/gen_lazy_tensor.py", line 161, in validate_shape_inference_header
2022-05-24T01:14:33.1151402Z     {decl}"""
2022-05-24T01:14:33.1151671Z AssertionError: Missing shape inference function.
2022-05-24T01:14:33.1151823Z 
2022-05-24T01:14:33.1152096Z Please add declare this function in /var/lib/jenkins/workspace/torch/csrc/lazy/core/shape_inference.h:
2022-05-24T01:14:33.1152305Z 
2022-05-24T01:14:33.1152443Z and implement it in the the corresponding shape_inference.cpp file.
2022-05-24T01:14:33.1152668Z 
2022-05-24T01:14:33.1152884Z TORCH_API std::vector<torch::lazy::Shape> compute_shape_inverse(const at::Tensor & self);
2022-05-24T01:14:33.1890916Z Failed to generate lazy files: ['python', '/var/lib/jenkins/workspace/xla/scripts/gen_lazy_tensor.py']
2022-05-24T01:14:33.3810681Z + cleanup
2022-05-24T01:14:33.3810912Z + retcode=1
2022-05-24T01:14:33.3811072Z + set +x

See GitHub Actions build pull / linux-docs / build-docs (python) (3/4)

Step: "Build python docs" (full log | diagnosis details | 🔁 rerun)

2022-05-24T01:30:43.9319829Z FileNotFoundError:...rno 2] No such file or directory: 'katex': 'katex'
2022-05-24T01:30:43.9313986Z     nproc=self.app.parallel - 1)
2022-05-24T01:30:43.9314709Z   File "/opt/conda/lib/python3.7/site-packages/sphinx/builders/__init__.py", line 571, in _write_parallel
2022-05-24T01:30:43.9315294Z     tasks.add_task(write_process, arg)
2022-05-24T01:30:43.9316002Z   File "/opt/conda/lib/python3.7/site-packages/sphinx/util/parallel.py", line 103, in add_task
2022-05-24T01:30:43.9316528Z     self._join_one()
2022-05-24T01:30:43.9317190Z   File "/opt/conda/lib/python3.7/site-packages/sphinx/util/parallel.py", line 127, in _join_one
2022-05-24T01:30:43.9317768Z     raise SphinxParallelError(*result)
2022-05-24T01:30:43.9318575Z sphinx.errors.SphinxParallelError: FileNotFoundError: [Errno 2] No such file or directory: 'katex': 'katex'
2022-05-24T01:30:43.9319027Z 
2022-05-24T01:30:43.9319194Z Sphinx parallel build error:
2022-05-24T01:30:43.9319829Z FileNotFoundError: [Errno 2] No such file or directory: 'katex': 'katex'
2022-05-24T01:30:58.3654613Z make: *** [Makefile:42: html] Error 2
2022-05-24T01:30:58.3655691Z ++ code=2
2022-05-24T01:30:58.3656048Z ++ '[' 2 -ne 0 ']'
2022-05-24T01:30:58.3656434Z ++ set +x
2022-05-24T01:30:58.3656598Z =========================
2022-05-24T01:30:58.3666683Z =========================
2022-05-24T01:30:58.3666988Z Docs build failed. If the failure is not clear, scan back in the log
2022-05-24T01:30:58.3667397Z for any WARNINGS or for the line build finished with problems
2022-05-24T01:30:58.3667742Z (tried to echo the WARNINGS above the ==== line)
2022-05-24T01:30:58.3667970Z =========================

See GitHub Actions build pull / linux-xenial-py3.7-gcc5.4 / test (backwards_compat, 1, 1, linux.2xlarge) (4/4)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-05-24T01:05:21.8798862Z The PR is introduc...m to confirm whether this change is wanted or not.
2022-05-24T01:05:21.8786072Z processing existing schema:  text(__torch__.torch.classes.profiling.SourceRef _0) -> (str _0)
2022-05-24T01:05:21.8787396Z processing existing schema:  count(__torch__.torch.classes.profiling.InstructionStats _0) -> (int _0)
2022-05-24T01:05:21.8788565Z processing existing schema:  duration_ns(__torch__.torch.classes.profiling.InstructionStats _0) -> (int _0)
2022-05-24T01:05:21.8789920Z processing existing schema:  source(__torch__.torch.classes.profiling.SourceStats _0) -> (__torch__.torch.classes.profiling.SourceRef _0)
2022-05-24T01:05:21.8791590Z processing existing schema:  line_map(__torch__.torch.classes.profiling.SourceStats _0) -> (Dict(int, __torch__.torch.classes.profiling.InstructionStats) _0)
2022-05-24T01:05:21.8792662Z processing existing schema:  __init__(__torch__.torch.classes.profiling._ScriptProfile _0) -> (NoneType _0)
2022-05-24T01:05:21.8793822Z processing existing schema:  enable(__torch__.torch.classes.profiling._ScriptProfile _0) -> (NoneType _0)
2022-05-24T01:05:21.8795009Z processing existing schema:  disable(__torch__.torch.classes.profiling._ScriptProfile _0) -> (NoneType _0)
2022-05-24T01:05:21.8796790Z processing existing schema:  _dump_stats(__torch__.torch.classes.profiling._ScriptProfile _0) -> (__torch__.torch.classes.profiling.SourceStats[] _0)
2022-05-24T01:05:21.8798471Z processing existing schema:  __init__(__torch__.torch.classes.dist_rpc.WorkerInfo _0, str _1, int _2) -> (NoneType _0)
2022-05-24T01:05:21.8798862Z The PR is introducing backward incompatible changes to the operator library. Please contact PyTorch team to confirm whether this change is wanted or not. 
2022-05-24T01:05:21.8799538Z 
2022-05-24T01:05:21.8800476Z Broken ops: [
2022-05-24T01:05:21.8800861Z 	prims::uniform(int[] shape, *, Scalar low, Scalar high, int dtype, Device device) -> (Tensor)
2022-05-24T01:05:21.8801357Z 	prims::full_like(Tensor a, Scalar fill_value, *, int dtype, Device device, bool requires_grad) -> (Tensor)
2022-05-24T01:05:21.8801770Z 	prims::full(int[] shape, Scalar fill_value, *, int dtype, Device device, bool requires_grad) -> (Tensor)
2022-05-24T01:05:21.8802206Z 	prims::empty_strided(int[] shape, int[] strides, *, int dtype, Device device, bool requires_grad) -> (Tensor)
2022-05-24T01:05:21.8802586Z 	prims::empty(int[] shape, *, int dtype, Device device, bool requires_grad) -> (Tensor)
2022-05-24T01:05:21.8802963Z 	prims::any(Tensor inp, int[]? dims, *, int? output_dtype=None) -> (Tensor)
2022-05-24T01:05:21.8803255Z 	prims::all(Tensor inp, int[]? dims, *, int? output_dtype=None) -> (Tensor)
2022-05-24T01:05:21.8803525Z 	prims::amin(Tensor inp, int[]? dims, *, int? output_dtype=None) -> (Tensor)

This comment was automatically generated by Dr. CI (expand for details).

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Click here to manually regenerate this comment.

Copy link
Contributor

@janeyx99 janeyx99 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think the best way to do this while abiding by other checks is to pass all_green to find_matching_merge_rules still and then changing the code near

        if rule.mandatory_checks_name is not None:

to check all checks instead of just the mandatory ones if allgreen is true

if len(pending_checks) > 0:
reject_reason = f"Refusing to merge as mandatory check(s) {','.join(pending_checks)} are missing"
raise MandatoryChecksMissingError(reject_reason)
pr.merge_into(repo, dry_run=dry_run)
Copy link
Contributor

@janeyx99 janeyx99 May 20, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh I see, this calls the code that makes the find_matching_merge_rule. In that case go for it lol, but Eli's comment about the API limit is important since we did have SEVs about our GITHUB_TOKEN getting overused.

@zengk95
Copy link
Contributor Author

zengk95 commented May 20, 2022

@pytorchbot merge -g

@github-actions
Copy link
Contributor

Hey @zengk95.
You've committed this PR, but it does not have both a 'release notes: ...' and 'topics: ...' label. Please add one of each to the PR. The 'release notes: ...' label should represent the part of PyTorch that this PR changes (fx, autograd, distributed, etc) and the 'topics: ...' label should represent the kind of PR it is (not user facing, new feature, bug fix, perf improvement, etc). The list of valid labels can be found here for the 'release notes: ...' and here for the 'topics: ...'.
For changes that are 'topic: not user facing' there is no need for a release notes label.

@malfet
Copy link
Contributor

malfet commented May 20, 2022

@pytorchbot revert this as it broke lint, see https://github.com/pytorch/pytorch/runs/6532480582?check_suite_focus=true

@suo
Copy link
Member

suo commented May 21, 2022

Looks like a land race

@janeyx99 janeyx99 reopened this May 24, 2022
@janeyx99
Copy link
Contributor

@pytorchbot rebase

@pytorchmergebot
Copy link
Collaborator

Rebase failed due to Command git -C /home/runner/work/pytorch/pytorch rebase master pull/77660/head returned non-zero exit code 1

Rebasing (1/2)
Rebasing (2/2)
Auto-merging .github/scripts/trymerge.py
CONFLICT (content): Merge conflict in .github/scripts/trymerge.py
error: could not apply f2af3e2950... all green
hint: Resolve all conflicts manually, mark them as resolved with
hint: "git add/rm <conflicted_files>", then run "git rebase --continue".
hint: You can instead skip this commit: run "git rebase --skip".
hint: To abort and get back to the state before "git rebase", run "git rebase --abort".
Could not apply f2af3e2950... all green

Raised by https://github.com/pytorch/pytorch/actions/runs/2374794934

swang392 pushed a commit that referenced this pull request May 25, 2022
Since we released on-green, some people have requested an all green option to include everything.

I was thinking of how to best add this into find_matching_merge_rule but I couldn't think of a good a great way since the option isn't really a merge_rule, rather overriding it so I just put it outside the method.
Pull Request resolved: #77660
Approved by: https://github.com/janeyx99
@zengk95 zengk95 closed this May 31, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants