Skip to content

[CI] Lintrunner takes 60+ min #114913

@malfet

Description

@malfet

🐛 Describe the bug

See https://github.com/pytorch/pytorch/actions/runs/7052942128/job/19199060568?pr=114883 which is running for nearly 2 hours now
When sshed into it I see

$ ps axf
  PID TTY      STAT   TIME COMMAND
 8318 pts/2    Ss     0:00 bash
 8574 pts/2    R+     0:00  \_ ps axf
    8 pts/1    Ss+    0:00 bash /exec
 3900 pts/1    Sl+    0:07  \_ lintrunner --force-color --all-files --tee-json=lint.json
 3998 pts/1    Sl+    0:00      \_ python3 tools/linter/adapters/clangtidy_linter.py --binary=.lintbin/clang-tidy --build_dir=./build -- @/tmp/.tmpnytM6k
 8294 pts/1    R+    83:57          \_ /pytorch/pytorch/.lintbin/clang-tidy -p=/pytorch/pytorch/build --extra-arg -I/usr/lib/llvm-11/include/openmp --extra-arg -I/opt/conda/envs/py_3.9/include/python3.9 -

and the actual command is

$ python -c "print(' '.join(open('/proc/8294/cmdline').read().split('\0')))"
/pytorch/pytorch/.lintbin/clang-tidy -p=/pytorch/pytorch/build --extra-arg -I/usr/lib/llvm-11/include/openmp --extra-arg -I/opt/conda/envs/py_3.9/include/python3.9 --extra-arg -I/pytorch/pytorch/third_party/pybind11/include --extra-arg -I/usr/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11 --extra-arg -I/usr/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/x86_64-linux-gnu/c++/11 --extra-arg -I/usr/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/backward --extra-arg -I/usr/lib/llvm-14/lib/clang/14.0.0/include --extra-arg -I/usr/local/include --extra-arg -I/usr/include/x86_64-linux-gnu --extra-arg -I/usr/include /pytorch/pytorch/torch/csrc/utils/nested.cpp

Which takes less than min to finish:

$ time /pytorch/pytorch/.lintbin/clang-tidy -p=/pytorch/pytorch/build --extra-arg -I/usr/lib/llvm-11/include/openmp --extra-arg -I/opt/conda/envs/py_3.9/include/python3.9 --extra-arg -I/pytorch/pytorch/third_party/pybind11/include --extra-arg -I/usr/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11 --extra-arg -I/usr/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/x86_64-linux-gnu/c++/11 --extra-arg -I/usr/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/backward --extra-arg -I/usr/lib/llvm-14/lib/clang/14.0.0/include --extra-arg -I/usr/local/include --extra-arg -I/usr/include/x86_64-linux-gnu --extra-arg -I/usr/include /pytorch/pytorch/torch/csrc/utils/nested.cpp 
13787 warnings generated.
Suppressed 13906 warnings (13787 in non-user code, 119 NOLINT).
Use -header-filter=.* to display errors from all non-system headers. Use -system-headers to display errors from system headers as well.

real	0m59.745s
user	0m58.875s
sys	0m0.868s

Versions

CI

cc @ezyang @gchanan @zou3519 @kadeng @seemethere @pytorch/pytorch-dev-infra

Metadata

Metadata

Assignees

Labels

module: ciRelated to continuous integrationmodule: flaky-testsProblem is a flaky test in CItriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module

Type

No type

Projects

Status

Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions