-
Notifications
You must be signed in to change notification settings - Fork 2.4k
Installation issue: py-tensorflow #31229
Description
Steps to reproduce the issue
$ spack spec -I py-tensorflow
spack spec -I py-tensorflow
Input spec
--------------------------------
- py-tensorflow
Concretized
--------------------------------
- [email protected]%[email protected]~android~aws~computecpp~cuda~dynamic_kernels~gcp~gdr~hdfs~ignite~ios~jemalloc~kafka~mkl~monolithic~mpi~nccl~ngraph~numa~opencl~rocm~tensorrt~verbs~xla patches=2017b3e,3a839b1 arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected]+nodepfail patches=0f6940d,3e6448a,604423c,dbbf38b arch=darwin-monterey-skylake
[+] ^[email protected]_10%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected]+bz2+ctypes+dbm~debug+ensurepip+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93,4c24573,f2fd060 arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected]~debug~pic+shared arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] libs=shared,static arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected]~libbsd arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected]~symlinks+termlib abi=none arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected]+bzip2+curses+git~libunistring+libxml2+tar+xz arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected]~python arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected]~pic libs=shared,static arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected]+optimize+pic+shared patches=0d38234 arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] zip=pigz arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected]~docs~shared certs=system arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected]+cpanm+shared+threads arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected]+cxx~docs+stl patches=b231fcc arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected]+column_metadata+dynamic_extensions+fts~functions+rtree arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected]~ipo+python+shared build_type=RelWithDebInfo arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected]~doc+ncurses+ownlibs~qt build_type=Release arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected]~cxx~fortran+hl~ipo~java~mpi+shared~szip~threadsafe+tools api=default build_type=RelWithDebInfo arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected]+shared build_type=Release arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected]~ipo build_type=RelWithDebInfo arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^re2@2021-06-01%[email protected]~ipo+pic+shared build_type=RelWithDebInfo arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected]~mpi arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected]+blas+lapack patches=873745d arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected]~bignuma~consistent_fpcsr~ilp64+locking+pic+shared symbol_suffix=none threads=none arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected]~cpp arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+] ^[email protected]%[email protected]~jit+multibyte+utf arch=darwin-monterey-skylakeError message
Error message
40316 external/local_config_cc/wrapped_clang '-D_FORTIFY_SOURCE=1' -fstack-protector -fcolor-diagnostics -Wall -Wthread-safety -Wself-
assign -fno-omit-frame-pointer -g0 -O2 '-D_FORTIFY_SOURCE=1' -DNDEBUG '-DNS_BLOCK_ASSERTIONS=1' '-std=c++11' -fdebug-compilation-d
ir . -iquote . -iquote bazel-out/darwin-opt/bin -iquote external/com_google_protobuf -iquote bazel-out/darwin-opt/bin/external/com
_google_protobuf -MD -MF bazel-out/darwin-opt/bin/tensorflow/stream_executor/_objs/dnn_proto_cc_impl/dnn.pb.d '-frandom-seed=bazel
-out/darwin-opt/bin/tensorflow/stream_executor/_objs/dnn_proto_cc_impl/dnn.pb.o' -isysroot __BAZEL_XCODE_SDKROOT__ -F__BAZEL_XCODE
_SDKROOT__/System/Library/Frameworks -F__BAZEL_XCODE_DEVELOPER_DIR__/Platforms/MacOSX.platform/Developer/Library/Frameworks '-mmac
osx-version-min=12.1' -DGRPC_BAZEL_BUILD -w '-march=skylake' '-mtune=skylake' '-std=c++14' -Wno-unknown-warning-option -Wno-unused
-but-set-variable -Wno-sign-compare -no-canonical-prefixes -Wno-builtin-macro-redefined '-D__DATE__="redacted"' '-D__TIMESTAMP__="
redacted"' '-D__TIME__="redacted"' -c bazel-out/darwin-opt/bin/tensorflow/stream_executor/dnn.pb.cc -o bazel-out/darwin-opt/bin/te
nsorflow/stream_executor/_objs/dnn_proto_cc_impl/dnn.pb.o)
40317 Execution platform: @local_execution_config_platform//:platform
40318 In file included from bazel-out/darwin-opt/bin/tensorflow/stream_executor/dnn.pb.cc:4:
>> 40319 bazel-out/darwin-opt/bin/tensorflow/stream_executor/dnn.pb.h:10:10: fatal error: 'google/protobuf/port_def.inc' file not found
40320 #include
40321 ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
40322 1 error generated.
40323 Target //tensorflow/tools/pip_package:build_pip_package failed to build
40324 INFO: Elapsed time: 294.429s, Critical Path: 21.51s
40325 INFO: 540 processes: 141 internal, 399 local.
>> 40326 FAILED: Build did NOT complete successfully
>> 40327 FAILED: Build did NOT complete successfully
Information on your system
* **Spack:** 0.19.0.dev0 (cfc46504ac64049df98e5876396a59ccf3deebf9)
* **Python:** 3.8.9
* **Platform:** darwin-monterey-skylake
* **Concretizer:** clingo
Additional information
I've attached the requested files, along with various other files associated with the tensorflow build, including the .bazelrc. What appears to be happening is that the install path to the protobuf include files (which were installed correctly by spack) doesn't appear to be passed through to the compiler by bazel. A custom path to the include files is specified for linux in package.py and I've modified the package file to do the same for OSX (which I've attached here). I'm not sure how to proceed at this point (my suspicion is that this might be a bagel/tensorflow bug).
Mentioning the maintainers of py-tensorflow: @adamjstewart @aweits
spack-build-01-configure-out.txt
spack-build-02-build-out.txt
spack-build-env-mods.txt
spack-build-env.txt
spack-build-out.txt
bazelrc.txt
package.txt
General information
- I have run
spack debug reportand reported the version of Spack/Python/Platform - I have run
spack maintainers <name-of-the-package>and @mentioned any maintainers - I have uploaded the build log and environment files
- I have searched the issues of this repo and believe this is not a duplicate
Metadata
Metadata
Assignees
Labels
Type
Projects
Status