Add run_android_tests workflow #73494

kit1980 · 2022-02-28T02:34:38Z

Android emulator tests workflow on Linux Github hosted runners, for now triggers on master/main/release push.

Example successful run: https://github.com/pytorch/pytorch/runs/5488927387

pytorch-bot · 2022-02-28T02:34:42Z

CI Flow Status

⚛️ CI Flow

Ruleset - Version: v1
Ruleset - File: https://github.com/pytorch/pytorch/blob/978aaba761bf56cfdb63018617f04852037bec6f/.github/generated-ciflow-ruleset.json
PR ciflow labels: ciflow/default
Add ciflow labels to this PR to trigger more builds:

Workflows	Labels (bold enabled)	Status
Triggered Workflows
linux-binary-conda	`ciflow/binaries`, `ciflow/binaries_conda`, `ciflow/default`	✅ triggered
linux-binary-libtorch-cxx11-abi	`ciflow/binaries`, `ciflow/binaries_libtorch`, `ciflow/default`	✅ triggered
linux-binary-libtorch-pre-cxx11	`ciflow/binaries`, `ciflow/binaries_libtorch`, `ciflow/default`	✅ triggered
linux-binary-manywheel	`ciflow/binaries`, `ciflow/binaries_wheel`, `ciflow/default`	✅ triggered
linux-bionic-py3.7-clang9	`ciflow/all`, `ciflow/cpu`, `ciflow/default`, `ciflow/linux`, `ciflow/noarch`, `ciflow/trunk`	✅ triggered
linux-bionic-rocm4.5-py3.7	`ciflow/all`, `ciflow/default`, `ciflow/linux`, `ciflow/rocm`, `ciflow/trunk`	✅ triggered
linux-docs	`ciflow/all`, `ciflow/cpu`, `ciflow/default`, `ciflow/docs`, `ciflow/linux`, `ciflow/trunk`	✅ triggered
linux-vulkan-bionic-py3.7-clang9	`ciflow/all`, `ciflow/cpu`, `ciflow/default`, `ciflow/linux`, `ciflow/trunk`, `ciflow/vulkan`	✅ triggered
linux-xenial-cuda11.3-py3.7-gcc7	`ciflow/all`, `ciflow/cuda`, `ciflow/default`, `ciflow/linux`, `ciflow/trunk`	✅ triggered
linux-xenial-cuda11.3-py3.7-gcc7-bazel-test	`ciflow/all`, `ciflow/bazel`, `ciflow/cpu`, `ciflow/default`, `ciflow/linux`, `ciflow/trunk`	✅ triggered
linux-xenial-py3-clang5-mobile-build	`ciflow/all`, `ciflow/default`, `ciflow/linux`, `ciflow/mobile`, `ciflow/trunk`	✅ triggered
linux-xenial-py3-clang5-mobile-custom-build-static	`ciflow/all`, `ciflow/default`, `ciflow/linux`, `ciflow/mobile`, `ciflow/trunk`	✅ triggered
linux-xenial-py3.7-clang7-asan	`ciflow/all`, `ciflow/cpu`, `ciflow/default`, `ciflow/linux`, `ciflow/sanitizers`, `ciflow/trunk`	✅ triggered
linux-xenial-py3.7-clang7-onnx	`ciflow/all`, `ciflow/cpu`, `ciflow/default`, `ciflow/linux`, `ciflow/onnx`, `ciflow/trunk`	✅ triggered
linux-xenial-py3.7-gcc5.4	`ciflow/all`, `ciflow/cpu`, `ciflow/default`, `ciflow/linux`, `ciflow/trunk`	✅ triggered
linux-xenial-py3.7-gcc7	`ciflow/all`, `ciflow/cpu`, `ciflow/default`, `ciflow/linux`, `ciflow/trunk`	✅ triggered
linux-xenial-py3.7-gcc7-no-ops	`ciflow/all`, `ciflow/cpu`, `ciflow/default`, `ciflow/linux`, `ciflow/trunk`	✅ triggered
macos-arm64-binary-conda	`ciflow/binaries`, `ciflow/binaries_conda`, `ciflow/default`	✅ triggered
macos-arm64-binary-wheel	`ciflow/binaries`, `ciflow/binaries_wheel`, `ciflow/default`	✅ triggered
macos-binary-conda	`ciflow/binaries`, `ciflow/binaries_conda`, `ciflow/default`	✅ triggered
macos-binary-libtorch-cxx11-abi	`ciflow/binaries`, `ciflow/binaries_libtorch`, `ciflow/default`	✅ triggered
macos-binary-libtorch-pre-cxx11	`ciflow/binaries`, `ciflow/binaries_libtorch`, `ciflow/default`	✅ triggered
macos-binary-wheel	`ciflow/binaries`, `ciflow/binaries_wheel`, `ciflow/default`	✅ triggered
pytorch-linux-xenial-py3-clang5-android-ndk-r19c-gradle-custom-build-single	`ciflow/all`, `ciflow/android`, `ciflow/cpu`, `ciflow/default`, `ciflow/linux`, `ciflow/trunk`	✅ triggered
pytorch-linux-xenial-py3-clang5-android-ndk-r19c-gradle-custom-build-single-full-jit	`ciflow/all`, `ciflow/android`, `ciflow/cpu`, `ciflow/default`, `ciflow/linux`, `ciflow/trunk`	✅ triggered
win-vs2019-cpu-py3	`ciflow/all`, `ciflow/cpu`, `ciflow/default`, `ciflow/trunk`, `ciflow/win`	✅ triggered
win-vs2019-cuda11.3-py3	`ciflow/all`, `ciflow/cuda`, `ciflow/default`, `ciflow/trunk`, `ciflow/win`	✅ triggered
windows-binary-libtorch-cxx11-abi	`ciflow/binaries`, `ciflow/binaries_libtorch`, `ciflow/default`	✅ triggered
windows-binary-libtorch-pre-cxx11	`ciflow/binaries`, `ciflow/binaries_libtorch`, `ciflow/default`	✅ triggered
windows-binary-wheel	`ciflow/binaries`, `ciflow/binaries_wheel`, `ciflow/default`	✅ triggered
Skipped Workflows
caffe2-linux-xenial-py3.7-gcc5.4	`ciflow/all`, `ciflow/cpu`, `ciflow/linux`, `ciflow/trunk`	🚫 skipped
docker-builds	`ciflow/all`, `ciflow/trunk`	🚫 skipped
ios-12-5-1-arm64	`ciflow/all`, `ciflow/ios`, `ciflow/macos`, `ciflow/scheduled`	🚫 skipped
ios-12-5-1-arm64-coreml	`ciflow/all`, `ciflow/ios`, `ciflow/macos`, `ciflow/scheduled`	🚫 skipped
ios-12-5-1-arm64-custom-ops	`ciflow/all`, `ciflow/ios`, `ciflow/macos`, `ciflow/scheduled`	🚫 skipped
ios-12-5-1-arm64-metal	`ciflow/all`, `ciflow/ios`, `ciflow/macos`, `ciflow/scheduled`	🚫 skipped
ios-12-5-1-x86-64	`ciflow/all`, `ciflow/ios`, `ciflow/macos`, `ciflow/trunk`	🚫 skipped
ios-12-5-1-x86-64-coreml	`ciflow/all`, `ciflow/ios`, `ciflow/macos`, `ciflow/trunk`	🚫 skipped
libtorch-linux-xenial-cuda10.2-py3.7-gcc7	`ciflow/all`, `ciflow/cuda`, `ciflow/libtorch`, `ciflow/linux`, `ciflow/trunk`	🚫 skipped
libtorch-linux-xenial-cuda11.3-py3.7-gcc7	`ciflow/all`, `ciflow/cuda`, `ciflow/libtorch`, `ciflow/linux`, `ciflow/trunk`	🚫 skipped
linux-bionic-cuda10.2-py3.9-gcc7	`ciflow/all`, `ciflow/cuda`, `ciflow/linux`, `ciflow/slow`, `ciflow/trunk`	🚫 skipped
linux-docs-push	`ciflow/all`, `ciflow/cpu`, `ciflow/linux`, `ciflow/scheduled`	🚫 skipped
linux-xenial-cuda11.3-py3.7-gcc7-no-ops	`ciflow/all`, `ciflow/cuda`, `ciflow/linux`, `ciflow/trunk`	🚫 skipped
macos-10-15-py3-arm64	`ciflow/all`, `ciflow/macos`, `ciflow/trunk`	🚫 skipped
macos-10-15-py3-lite-interpreter-x86-64	`ciflow/all`, `ciflow/macos`, `ciflow/trunk`	🚫 skipped
macos-11-py3-x86-64	`ciflow/all`, `ciflow/macos`, `ciflow/trunk`	🚫 skipped
parallelnative-linux-xenial-py3.7-gcc5.4	`ciflow/all`, `ciflow/cpu`, `ciflow/linux`, `ciflow/trunk`	🚫 skipped
periodic-libtorch-linux-bionic-cuda11.5-py3.7-gcc7	`ciflow/all`, `ciflow/cuda`, `ciflow/libtorch`, `ciflow/linux`, `ciflow/scheduled`	🚫 skipped
periodic-linux-bionic-cuda11.5-py3.7-gcc7	`ciflow/all`, `ciflow/cuda`, `ciflow/linux`, `ciflow/scheduled`	🚫 skipped
periodic-linux-xenial-cuda10.2-py3-gcc7-slow-gradcheck	`ciflow/all`, `ciflow/cuda`, `ciflow/linux`, `ciflow/scheduled`, `ciflow/slow`, `ciflow/slow-gradcheck`	🚫 skipped
periodic-linux-xenial-cuda11.3-py3.7-gcc7-debug	`ciflow/all`, `ciflow/cuda`, `ciflow/linux`, `ciflow/scheduled`	🚫 skipped
periodic-win-vs2019-cuda11.5-py3	`ciflow/all`, `ciflow/cuda`, `ciflow/scheduled`, `ciflow/win`	🚫 skipped
pytorch-linux-xenial-py3-clang5-android-ndk-r19c-build	`ciflow/all`, `ciflow/android`, `ciflow/cpu`, `ciflow/linux`, `ciflow/trunk`	🚫 skipped
pytorch-xla-linux-bionic-py3.7-clang8	`ciflow/all`, `ciflow/cpu`, `ciflow/linux`, `ciflow/trunk`, `ciflow/xla`	🚫 skipped

facebook-github-bot · 2022-02-28T02:34:44Z

🔗 Helpful links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/73494
📄 Preview docs built from this PR
📄 Preview C++ docs built from this PR
↩️ [fb-only] Re-run with SSH instructions
🔧 Opt-in to CIFlow to control what jobs run on your PRs

💊 CI failures summary and remediations

As of commit 1dd9faa (more details on the Dr. CI page):

1/1 failures introduced in this PR

🕵️ 1 new failure recognized by patterns

The following CI failures do not appear to be due to upstream breakages:

linux-xenial-py3.7-gcc5.4 / test (backwards_compat, 1, 1, linux.2xlarge) (1/1)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-03-10T08:58:12.4932630Z RuntimeError:

2022-03-10T08:58:11.9536707Z Author: PyTorch Team
2022-03-10T08:58:11.9536962Z Author-email: [email protected]
2022-03-10T08:58:11.9537190Z License: BSD-3
2022-03-10T08:58:11.9537473Z Location: /opt/conda/lib/python3.7/site-packages
2022-03-10T08:58:11.9538056Z Requires: typing-extensions
2022-03-10T08:58:11.9538265Z Required-by: 
2022-03-10T08:58:11.9914116Z + python check_forward_backward_compatibility.py --existing-schemas nightly_schemas.txt
2022-03-10T08:58:12.4931480Z Traceback (most recent call last):
2022-03-10T08:58:12.4931878Z   File "check_forward_backward_compatibility.py", line 308, in <module>
2022-03-10T08:58:12.4932351Z     s = parse_schema(line.strip())
2022-03-10T08:58:12.4932630Z RuntimeError: 
2022-03-10T08:58:12.4932900Z Unknown custom class type profiler._RecordFunction. Please ensure it is registered.:
2022-03-10T08:58:12.4933508Z profiler::_call_end_callbacks_on_jit_fut._RecordFunction(__torch__.torch.classes.profiler._RecordFunction x, Future(t) y) -> (Future(t))
2022-03-10T08:58:12.4933945Z                                                                                           ~~~~~~~~~~~~~~~ <--- HERE
2022-03-10T08:58:12.4934086Z 
2022-03-10T08:58:12.5735140Z + cleanup
2022-03-10T08:58:12.5735389Z + retcode=1
2022-03-10T08:58:12.5735546Z + set +x
2022-03-10T08:58:12.5779183Z ##[error]Process completed with exit code 1.
2022-03-10T08:58:12.5809617Z ##[group]Run # Ensure the working directory gets chowned back to the current user
2022-03-10T08:58:12.5809960Z �[36;1m# Ensure the working directory gets chowned back to the current user�[0m

This comment was automatically generated by Dr. CI (expand for details).

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Click here to manually regenerate this comment.

.github/workflows/run_android_tests.yml

janeyx99 · 2022-02-28T15:11:43Z

Do you have a link to a successful run?

malfet

LGTM, but can you please elaborate what have changed from failed run that we've observed yesterday to this one?

.github/workflows/run_android_tests.yml

kit1980 · 2022-03-10T05:48:58Z

LGTM, but can you please elaborate what have changed from failed run that we've observed yesterday to this one?

The change is that older api-level: 25 is needed - that's what the test requires. Later we can update the test and the API level.

Co-authored-by: Nikita Shulga <[email protected]>

kit1980 · 2022-03-10T08:44:35Z

@pytorchbot merge this

github-actions · 2022-03-10T08:46:28Z

Hey @kit1980.
You've committed this PR, but it does not have both a 'release notes: ...' and 'topics: ...' label. Please add one of each to the PR. The 'release notes: ...' label should represent the part of PyTorch that this PR changes (fx, autograd, distributed, etc) and the 'topics: ...' label should represent the kind of PR it is (not user facing, new feature, bug fix, perf improvement, etc). The list of valid labels can be found here for the 'release notes: ...' and here for the 'topics: ...'.
For changes that are 'topic: not user facing' there is no need for a release notes label.

Summary: Android emulator tests workflow on Linux Github hosted runners, for now triggers on master/main/release push. Example successful run: https://github.com/pytorch/pytorch/runs/5488927387 Pull Request resolved: #73494 Approved by: https://github.com/malfet Test Plan: contbuild & OSS CI, see https://hud.pytorch.org/commit/pytorch/pytorch/bd13bc667e9a56e95b14bb3da88f170548880b91 Reviewed By: malfet Differential Revision: D34795701 fbshipit-source-id: 7aacb5688f9cb5c43ee3bdacb226474bc969737d

kit1980 requested review from atalman, janeyx99 and seemethere as code owners February 28, 2022 02:34

pytorch-bot bot added the ciflow/default label Feb 28, 2022

facebook-github-bot added the cla signed label Feb 28, 2022

kit1980 requested a review from malfet February 28, 2022 02:35

janeyx99 reviewed Feb 28, 2022

View reviewed changes

.github/workflows/run_android_tests.yml Outdated Show resolved Hide resolved

janeyx99 reviewed Feb 28, 2022

View reviewed changes

.github/workflows/run_android_tests.yml Outdated Show resolved Hide resolved

kit1980 marked this pull request as draft March 8, 2022 23:27

Add run_android_tests workflow.

72379ea

kit1980 force-pushed the sdym/gha-android-test branch from 9be94dd to 72379ea Compare March 10, 2022 03:20

kit1980 marked this pull request as ready for review March 10, 2022 03:25

malfet approved these changes Mar 10, 2022

View reviewed changes

.github/workflows/run_android_tests.yml Show resolved Hide resolved

kit1980 and others added 6 commits March 9, 2022 21:50

Update .github/workflows/run_android_tests.yml

b301359

Co-authored-by: Nikita Shulga <[email protected]>

Update run_android_tests.yml

6d35768

Temporary add trigger on pull_request.

4fe47da

Add concurrency.

f2e3520

Rename job to build-and-test

874c17e

Remove on pull_request trigger.

1dd9faa

pytorchmergebot closed this in bd13bc6 Mar 10, 2022

kit1980 added the topic: not user facing topic category label Mar 10, 2022

kit1980 deleted the sdym/gha-android-test branch April 29, 2022 01:31

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add run_android_tests workflow #73494

Add run_android_tests workflow #73494

Uh oh!

kit1980 commented Feb 28, 2022 •

edited

Loading

Uh oh!

pytorch-bot bot commented Feb 28, 2022

⚛️ CI Flow

Uh oh!

facebook-github-bot commented Feb 28, 2022 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

janeyx99 commented Feb 28, 2022

Uh oh!

malfet left a comment

Uh oh!

Uh oh!

kit1980 commented Mar 10, 2022

Uh oh!

kit1980 commented Mar 10, 2022

Uh oh!

github-actions bot commented Mar 10, 2022

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Add run_android_tests workflow #73494

Add run_android_tests workflow #73494

Uh oh!

Conversation

kit1980 commented Feb 28, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pytorch-bot bot commented Feb 28, 2022

⚛️ CI Flow

Uh oh!

facebook-github-bot commented Feb 28, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🔗 Helpful links

💊 CI failures summary and remediations

🕵️ 1 new failure recognized by patterns

linux-xenial-py3.7-gcc5.4 / test (backwards_compat, 1, 1, linux.2xlarge) (1/1)

Uh oh!

Uh oh!

Uh oh!

janeyx99 commented Feb 28, 2022

Uh oh!

malfet left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

kit1980 commented Mar 10, 2022

Uh oh!

kit1980 commented Mar 10, 2022

Uh oh!

github-actions bot commented Mar 10, 2022

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

kit1980 commented Feb 28, 2022 •

edited

Loading

facebook-github-bot commented Feb 28, 2022 •

edited

Loading