Skip to content

Installation issue: py-tensorflow #31229

@krcb

Description

@krcb

Steps to reproduce the issue

$ spack spec -I py-tensorflow

spack spec -I py-tensorflow
Input spec
--------------------------------
 -   py-tensorflow

Concretized
--------------------------------
 -   [email protected]%[email protected]~android~aws~computecpp~cuda~dynamic_kernels~gcp~gdr~hdfs~ignite~ios~jemalloc~kafka~mkl~monolithic~mpi~nccl~ngraph~numa~opencl~rocm~tensorrt~verbs~xla patches=2017b3e,3a839b1 arch=darwin-monterey-skylake
[+]      ^[email protected]%[email protected]+nodepfail patches=0f6940d,3e6448a,604423c,dbbf38b arch=darwin-monterey-skylake
[+]          ^[email protected]_10%[email protected] arch=darwin-monterey-skylake
[+]          ^[email protected]%[email protected]+bz2+ctypes+dbm~debug+ensurepip+libxml2+lzma~nis~optimizations+pic+pyexpat+pythoncmd+readline+shared+sqlite3+ssl~tix~tkinter~ucs4+uuid+zlib patches=0d98e93,4c24573,f2fd060 arch=darwin-monterey-skylake
[+]              ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]              ^[email protected]%[email protected]~debug~pic+shared arch=darwin-monterey-skylake
[+]                  ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]                      ^[email protected]%[email protected] libs=shared,static arch=darwin-monterey-skylake
[+]              ^[email protected]%[email protected]~libbsd arch=darwin-monterey-skylake
[+]              ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]                  ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]                      ^[email protected]%[email protected]~symlinks+termlib abi=none arch=darwin-monterey-skylake
[+]                          ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]              ^[email protected]%[email protected]+bzip2+curses+git~libunistring+libxml2+tar+xz arch=darwin-monterey-skylake
[+]                  ^[email protected]%[email protected]~python arch=darwin-monterey-skylake
[+]                      ^[email protected]%[email protected]~pic libs=shared,static arch=darwin-monterey-skylake
[+]                      ^[email protected]%[email protected]+optimize+pic+shared patches=0d38234 arch=darwin-monterey-skylake
[+]                  ^[email protected]%[email protected] zip=pigz arch=darwin-monterey-skylake
[+]                      ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]              ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]              ^[email protected]%[email protected]~docs~shared certs=system arch=darwin-monterey-skylake
[+]                  ^[email protected]%[email protected]+cpanm+shared+threads arch=darwin-monterey-skylake
[+]                      ^[email protected]%[email protected]+cxx~docs+stl patches=b231fcc arch=darwin-monterey-skylake
[+]              ^[email protected]%[email protected]+column_metadata+dynamic_extensions+fts~functions+rtree arch=darwin-monterey-skylake
[+]      ^[email protected]%[email protected]~ipo+python+shared build_type=RelWithDebInfo arch=darwin-monterey-skylake
[+]          ^[email protected]%[email protected]~doc+ncurses+ownlibs~qt build_type=Release arch=darwin-monterey-skylake
[+]          ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]          ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]              ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]      ^[email protected]%[email protected]~cxx~fortran+hl~ipo~java~mpi+shared~szip~threadsafe+tools api=default build_type=RelWithDebInfo arch=darwin-monterey-skylake
[+]      ^[email protected]%[email protected]+shared build_type=Release arch=darwin-monterey-skylake
[+]      ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]          ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]              ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]      ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]      ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]      ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]      ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]          ^[email protected]%[email protected]~ipo build_type=RelWithDebInfo arch=darwin-monterey-skylake
[+]          ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]          ^re2@2021-06-01%[email protected]~ipo+pic+shared build_type=RelWithDebInfo arch=darwin-monterey-skylake
[+]      ^[email protected]%[email protected]~mpi arch=darwin-monterey-skylake
[+]          ^[email protected]%[email protected]+blas+lapack patches=873745d arch=darwin-monterey-skylake
[+]              ^[email protected]%[email protected]~bignuma~consistent_fpcsr~ilp64+locking+pic+shared symbol_suffix=none threads=none arch=darwin-monterey-skylake
[+]          ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]              ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]      ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]      ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]      ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]      ^[email protected]%[email protected]~cpp arch=darwin-monterey-skylake
[+]      ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]      ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]          ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]      ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]      ^[email protected]%[email protected] arch=darwin-monterey-skylake
[+]          ^[email protected]%[email protected]~jit+multibyte+utf arch=darwin-monterey-skylake

Error message

Error message
     40316      external/local_config_cc/wrapped_clang '-D_FORTIFY_SOURCE=1' -fstack-protector -fcolor-diagnostics -Wall -Wthread-safety -Wself-
              assign -fno-omit-frame-pointer -g0 -O2 '-D_FORTIFY_SOURCE=1' -DNDEBUG '-DNS_BLOCK_ASSERTIONS=1' '-std=c++11' -fdebug-compilation-d
              ir . -iquote . -iquote bazel-out/darwin-opt/bin -iquote external/com_google_protobuf -iquote bazel-out/darwin-opt/bin/external/com
              _google_protobuf -MD -MF bazel-out/darwin-opt/bin/tensorflow/stream_executor/_objs/dnn_proto_cc_impl/dnn.pb.d '-frandom-seed=bazel
              -out/darwin-opt/bin/tensorflow/stream_executor/_objs/dnn_proto_cc_impl/dnn.pb.o' -isysroot __BAZEL_XCODE_SDKROOT__ -F__BAZEL_XCODE
              _SDKROOT__/System/Library/Frameworks -F__BAZEL_XCODE_DEVELOPER_DIR__/Platforms/MacOSX.platform/Developer/Library/Frameworks '-mmac
              osx-version-min=12.1' -DGRPC_BAZEL_BUILD -w '-march=skylake' '-mtune=skylake' '-std=c++14' -Wno-unknown-warning-option -Wno-unused
              -but-set-variable -Wno-sign-compare -no-canonical-prefixes -Wno-builtin-macro-redefined '-D__DATE__="redacted"' '-D__TIMESTAMP__="
              redacted"' '-D__TIME__="redacted"' -c bazel-out/darwin-opt/bin/tensorflow/stream_executor/dnn.pb.cc -o bazel-out/darwin-opt/bin/te
              nsorflow/stream_executor/_objs/dnn_proto_cc_impl/dnn.pb.o)
     40317    Execution platform: @local_execution_config_platform//:platform
     40318    In file included from bazel-out/darwin-opt/bin/tensorflow/stream_executor/dnn.pb.cc:4:
  >> 40319    bazel-out/darwin-opt/bin/tensorflow/stream_executor/dnn.pb.h:10:10: fatal error: 'google/protobuf/port_def.inc' file not found
     40320    #include 
     40321             ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
     40322    1 error generated.
     40323    Target //tensorflow/tools/pip_package:build_pip_package failed to build
     40324    INFO: Elapsed time: 294.429s, Critical Path: 21.51s
     40325    INFO: 540 processes: 141 internal, 399 local.
  >> 40326    FAILED: Build did NOT complete successfully
  >> 40327    FAILED: Build did NOT complete successfully

Information on your system

* **Spack:** 0.19.0.dev0 (cfc46504ac64049df98e5876396a59ccf3deebf9)
* **Python:** 3.8.9
* **Platform:** darwin-monterey-skylake
* **Concretizer:** clingo

Additional information

I've attached the requested files, along with various other files associated with the tensorflow build, including the .bazelrc. What appears to be happening is that the install path to the protobuf include files (which were installed correctly by spack) doesn't appear to be passed through to the compiler by bazel. A custom path to the include files is specified for linux in package.py and I've modified the package file to do the same for OSX (which I've attached here). I'm not sure how to proceed at this point (my suspicion is that this might be a bagel/tensorflow bug).

Mentioning the maintainers of py-tensorflow: @adamjstewart @aweits

spack-build-01-configure-out.txt
spack-build-02-build-out.txt
spack-build-env-mods.txt
spack-build-env.txt
spack-build-out.txt
bazelrc.txt
package.txt

General information

  • I have run spack debug report and reported the version of Spack/Python/Platform
  • I have run spack maintainers <name-of-the-package> and @mentioned any maintainers
  • I have uploaded the build log and environment files
  • I have searched the issues of this repo and believe this is not a duplicate

Metadata

Metadata

Assignees

Type

No type

Projects

Status

Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions