-
Notifications
You must be signed in to change notification settings - Fork 63
Installation failed with julia 0.6.1 #316
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
Hi, thanks for your quick reply! I must note that I'm a complete julia noob and just wanted to try MXNet to get into it :) Since I don't know how to set CUDA_HOME on my system: julia> Pkg.checkout("MXNet")
INFO: Checking out MXNet master...
INFO: Pulling MXNet latest master...
INFO: Installing MacroTools v0.4.0
INFO: Installing TakingBroadcastSeriously v0.1.1
julia> Pkg.build("MXNet")
INFO: Building MXNet
INFO: Found a CUDA installation.
============================================================[ ERROR: MXNet ]============================================================
LoadError: KeyError: key "CUDA_HOME" not found
while loading /home/fps/.julia/v0.6/MXNet/deps/build.jl, in expression starting on line 66
========================================================================================================================================
============================================================[ BUILD ERRORS ]============================================================
WARNING: MXNet had build errors.
- packages with build errors remain installed in /home/fps/.julia/v0.6
- build the package(s) and all dependencies with `Pkg.build("MXNet")`
- build a single package by running its `deps/build.jl` script
========================================================================================================================================
I had to change: fps@mango 01:16:01 ~/.../v0.6/MXNet (master)* $ git diff
diff --git a/deps/build.jl b/deps/build.jl
index 86d6a98..766e736 100644
--- a/deps/build.jl
+++ b/deps/build.jl
@@ -38,14 +38,16 @@ end
HAS_CUDA = false
HAS_CUDNN = false
let cudalib = Libdl.find_library(["libcuda", "nvcuda.dll"], CUDAPATHS)
- HAS_CUDA = !isempty(cudalib) && Libdl.dlopen_e(cudalib) != C_NULL
+ # HAS_CUDA = !isempty(cudalib) && Libdl.dlopen_e(cudalib) != C_NULL
+ HAS_CUDA = false
end
if !HAS_CUDA && is_windows()
# TODO: this needs to be improved.
try
run(`nvcc --version`)
- HAS_CUDA = true
+ # HAS_CUDA = true
+ HAS_CUDA = false
end
end
but still I get: julia> Pkg.build("MXNet")
INFO: Building MXNet
INFO: Did not find a CUDA installation, using CPU-only version of MXNet.
INFO: Attempting to Create directory /home/fps/.julia/v0.6/MXNet/deps/src
INFO: Directory /home/fps/.julia/v0.6/MXNet/deps/src already created
INFO: Attempting to Create directory /home/fps/.julia/v0.6/MXNet/deps/usr/lib
INFO: Directory /home/fps/.julia/v0.6/MXNet/deps/usr/lib already created
INFO: Attempting to Create directory /home/fps/.julia/v0.6/MXNet/deps/src/mxnet
INFO: Directory /home/fps/.julia/v0.6/MXNet/deps/src/mxnet already created
INFO: Changing Directory to /home/fps/.julia/v0.6/MXNet/deps/src/mxnet
Cleared directory 'cub'
Submodule 'cub' (https://github.com/NVlabs/cub) unregistered for path 'cub'
Cleared directory 'dmlc-core'
Submodule 'dmlc-core' (https://github.com/dmlc/dmlc-core.git) unregistered for path 'dmlc-core'
Cleared directory 'mshadow'
Submodule 'mshadow' (https://github.com/dmlc/mshadow.git) unregistered for path 'mshadow'
Cleared directory 'nnvm'
Submodule 'nnvm' (https://github.com/dmlc/nnvm) unregistered for path 'nnvm'
Cleared directory 'ps-lite'
Submodule 'ps-lite' (https://github.com/dmlc/ps-lite) unregistered for path 'ps-lite'
INFO: Changing Directory to /home/fps/.julia/v0.6/MXNet/deps/src/mxnet
remote: Counting objects: 44, done.
remote: Compressing objects: 100% (17/17), done.
remote: Total 44 (delta 25), reused 27 (delta 21), pack-reused 6
Unpacking objects: 100% (44/44), done.
From https://github.com/dmlc/mxnet
a9f11a0..35ceea7 master -> origin/master
INFO: Changing Directory to /home/fps/.julia/v0.6/MXNet/deps/src/mxnet
HEAD is now at 8713d25... [R][DOC] update R installation guide (#6457)
INFO: Changing Directory to /home/fps/.julia/v0.6/MXNet/deps/src/mxnet
Submodule 'cub' (https://github.com/NVlabs/cub) registered for path 'cub'
Submodule 'dmlc-core' (https://github.com/dmlc/dmlc-core.git) registered for path 'dmlc-core'
Submodule 'mshadow' (https://github.com/dmlc/mshadow.git) registered for path 'mshadow'
Submodule 'nnvm' (https://github.com/dmlc/nnvm) registered for path 'nnvm'
Submodule 'ps-lite' (https://github.com/dmlc/ps-lite) registered for path 'ps-lite'
fatal: reference is not a tree: 89de7ab20167909bc2c4f8acd397671c47cf3c0d
Submodule path 'dmlc-core': checked out 'a6c5701219e635fea808d264aefc5b03c3aec314'
Submodule path 'mshadow': checked out 'c037b06ddd810d39322cd056650f8b1f4763dd9d'
Submodule path 'nnvm': checked out 'b279286304ac954098d94a2695bca599e832effb'
Submodule path 'nnvm/dmlc-core': checked out '3a51614d39b69fdb5de1efcf1016426626d267a6'
Submodule path 'nnvm/plugin/nnvm-fusion': checked out '86853a73e93fdbcdaec6fd3eda39e8f11d554c92'
Submodule path 'ps-lite': checked out 'acdb698fa3bb80929ef83bb37c705f025e119b82'
Unable to checkout '89de7ab20167909bc2c4f8acd397671c47cf3c0d' in submodule path 'cub'
============================================================[ ERROR: MXNet ]============================================================
LoadError: failed process: Process(`git submodule update --init --recursive`, ProcessExited(1)) [1]
while loading /home/fps/.julia/v0.6/MXNet/deps/build.jl, in expression starting on line 83
========================================================================================================================================
============================================================[ BUILD ERRORS ]============================================================
WARNING: MXNet had build errors.
- packages with build errors remain installed in /home/fps/.julia/v0.6
- build the package(s) and all dependencies with `Pkg.build("MXNet")`
- build a single package by running its `deps/build.jl` script
========================================================================================================================================
|
|
It's totally possible I do something brandead :) In that case feel free to close this issue and ignore me - still learning... |
|
Just FYI and I don't know if it just adds to the noise, but I also tried fps@mango 01:16:02 ~/.../v0.6/MXNet (master)* $ julia deps/build.jl
INFO: Did not find a CUDA installation, using CPU-only version of MXNet.
INFO: Attempting to Create directory /home/fps/.julia/v0.6/deps/src
INFO: Attempting to Create directory /home/fps/.julia/v0.6/deps/usr/lib
INFO: Attempting to Create directory /home/fps/.julia/v0.6/deps/src/mxnet
INFO: Changing Directory to /home/fps/.julia/v0.6/deps/src
Cloning into 'mxnet'...
remote: Counting objects: 50874, done.
remote: Compressing objects: 100% (21/21), done.
remote: Total 50874 (delta 9), reused 8 (delta 2), pack-reused 50851
Receiving objects: 100% (50874/50874), 27.65 MiB | 929.00 KiB/s, done.
Resolving deltas: 100% (32502/32502), done.
Checking connectivity... done.
INFO: Changing Directory to /home/fps/.julia/v0.6/deps/src/mxnet
Cleared directory 'cub'
Cleared directory 'dlpack'
Cleared directory 'dmlc-core'
Cleared directory 'mshadow'
Cleared directory 'nnvm'
Cleared directory 'ps-lite'
INFO: Changing Directory to /home/fps/.julia/v0.6/deps/src/mxnet
INFO: Changing Directory to /home/fps/.julia/v0.6/deps/src/mxnet
Already up-to-date.
INFO: Changing Directory to /home/fps/.julia/v0.6/deps/src/mxnet
Submodule 'cub' (https://github.com/dmlc/cub) registered for path 'cub'
Submodule 'dlpack' (https://github.com/dmlc/dlpack) registered for path 'dlpack'
Submodule 'dmlc-core' (https://github.com/dmlc/dmlc-core.git) registered for path 'dmlc-core'
Submodule 'mshadow' (https://github.com/dmlc/mshadow.git) registered for path 'mshadow'
Submodule 'nnvm' (https://github.com/dmlc/nnvm) registered for path 'nnvm'
Submodule 'ps-lite' (https://github.com/dmlc/ps-lite) registered for path 'ps-lite'
Cloning into 'cub'...
remote: Counting objects: 190, done.
remote: Total 190 (delta 0), reused 0 (delta 0), pack-reused 190
Receiving objects: 100% (190/190), 498.22 KiB | 517.00 KiB/s, done.
Resolving deltas: 100% (58/58), done.
Checking connectivity... done.
Submodule path 'cub': checked out '05eb57faa0a4cac37c2a86fdf4b4dc865a95a1a3'
Cloning into 'dlpack'...
remote: Counting objects: 124, done.
remote: Compressing objects: 100% (11/11), done.
remote: Total 124 (delta 5), reused 16 (delta 4), pack-reused 104
Receiving objects: 100% (124/124), 50.63 KiB | 0 bytes/s, done.
Resolving deltas: 100% (39/39), done.
Checking connectivity... done.
Submodule path 'dlpack': checked out 'a6e09b58dc00ee0065f5b7879800e646fbb01d1e'
Cloning into 'dmlc-core'...
remote: Counting objects: 4481, done.
remote: Compressing objects: 100% (4/4), done.
remote: Total 4481 (delta 0), reused 2 (delta 0), pack-reused 4476
Receiving objects: 100% (4481/4481), 1.02 MiB | 765.00 KiB/s, done.
Resolving deltas: 100% (2654/2654), done.
Checking connectivity... done.
Submodule path 'dmlc-core': checked out '595d02c0e87be8a0846700462b6f45f1b1031e39'
Cloning into 'mshadow'...
remote: Counting objects: 4500, done.
remote: Total 4500 (delta 0), reused 0 (delta 0), pack-reused 4500
Receiving objects: 100% (4500/4500), 1.42 MiB | 712.00 KiB/s, done.
Resolving deltas: 100% (3087/3087), done.
Checking connectivity... done.
Submodule path 'mshadow': checked out '2d7780c3f2eefe4453fa419862d1b2089bedb8d5'
Cloning into 'nnvm'...
remote: Counting objects: 2728, done.
remote: Compressing objects: 100% (59/59), done.
remote: Total 2728 (delta 24), reused 46 (delta 18), pack-reused 2651
Receiving objects: 100% (2728/2728), 945.55 KiB | 755.00 KiB/s, done.
Resolving deltas: 100% (1537/1537), done.
Checking connectivity... done.
Submodule path 'nnvm': checked out '8d79cfd0b42fbe9f6ad75886d495065d5500b9dd'
Submodule 'dmlc-core' (https://github.com/dmlc/dmlc-core) registered for path 'dmlc-core'
Submodule 'tvm' (https://github.com/dmlc/tvm) registered for path 'tvm'
Cloning into 'dmlc-core'...
remote: Counting objects: 4481, done.
remote: Compressing objects: 100% (4/4), done.
remote: Total 4481 (delta 0), reused 2 (delta 0), pack-reused 4476
Receiving objects: 100% (4481/4481), 1.02 MiB | 741.00 KiB/s, done.
Resolving deltas: 100% (2654/2654), done.
Checking connectivity... done.
Submodule path 'nnvm/dmlc-core': checked out '04f91953ace74aced3bb317990515304c5425849'
Cloning into 'tvm'...
remote: Counting objects: 9442, done.
remote: Compressing objects: 100% (66/66), done.
remote: Total 9442 (delta 24), reused 33 (delta 11), pack-reused 9364
Receiving objects: 100% (9442/9442), 2.60 MiB | 901.00 KiB/s, done.
Resolving deltas: 100% (6280/6280), done.
Checking connectivity... done.
Submodule path 'nnvm/tvm': checked out 'eb761f36302d24c740b77281ecdcdddb588edf36'
Submodule 'HalideIR' (https://github.com/dmlc/HalideIR) registered for path 'HalideIR'
Submodule 'dlpack' (https://github.com/dmlc/dlpack) registered for path 'dlpack'
Submodule 'dmlc-core' (https://github.com/dmlc/dmlc-core) registered for path 'dmlc-core'
Cloning into 'HalideIR'...
remote: Counting objects: 175, done.
remote: Total 175 (delta 0), reused 0 (delta 0), pack-reused 175
Receiving objects: 100% (175/175), 174.70 KiB | 0 bytes/s, done.
Resolving deltas: 100% (82/82), done.
Checking connectivity... done.
Submodule path 'nnvm/tvm/HalideIR': checked out 'cb3c025d5b91ab994b063a85bc935fc364d8f491'
Cloning into 'dlpack'...
remote: Counting objects: 124, done.
remote: Compressing objects: 100% (11/11), done.
remote: Total 124 (delta 5), reused 16 (delta 4), pack-reused 104
Receiving objects: 100% (124/124), 50.63 KiB | 0 bytes/s, done.
Resolving deltas: 100% (39/39), done.
Checking connectivity... done.
Submodule path 'nnvm/tvm/dlpack': checked out '9422e98f3f4dafc6bc3473cf8484543ad376aab6'
Cloning into 'dmlc-core'...
remote: Counting objects: 4481, done.
remote: Compressing objects: 100% (4/4), done.
remote: Total 4481 (delta 0), reused 2 (delta 0), pack-reused 4476
Receiving objects: 100% (4481/4481), 1.02 MiB | 749.00 KiB/s, done.
Resolving deltas: 100% (2654/2654), done.
Checking connectivity... done.
Submodule path 'nnvm/tvm/dmlc-core': checked out '04f91953ace74aced3bb317990515304c5425849'
Cloning into 'ps-lite'...
remote: Counting objects: 1910, done.
remote: Total 1910 (delta 0), reused 0 (delta 0), pack-reused 1910
Receiving objects: 100% (1910/1910), 581.93 KiB | 349.00 KiB/s, done.
Resolving deltas: 100% (1217/1217), done.
Checking connectivity... done.
Submodule path 'ps-lite': checked out 'bdd4c67e9e34dc0b8350ce306b0caa737eb31c83'
INFO: Changing Directory to /home/fps/.julia/v0.6/deps/src/mxnet
INFO: Changing Directory to /home/fps/.julia/v0.6/deps/src/mxnet
Makefile:218: WARNING: Significant performance increases can be achieved by installing and enabling gperftools or jemalloc development packages
rm -rf python/mxnet/*/*.so python/mxnet/*/*.cpp
rm -f build/tests/cpp/mxnet_unit_tests build/tests/cpp/test_main.o build/tests/cpp/misc/memory_test.o build/tests/cpp/storage/storage_test.o build/tests/cpp/operator/krprod_test.o build/tests/cpp/operator/activation_perf.o build/tests/cpp/operator/coreop_perf.o build/tests/cpp/operator/fully_conn_perf.o build/tests/cpp/operator/batchnorm_test.o build/tests/cpp/operator/core_op_runner_test.o build/tests/cpp/engine/threaded_engine_test.o
rm -f -r build lib bin *~ */*~ */*/*~ */*/*/*~ R-package/NAMESPACE R-package/man R-package/R/mxnet_generated.R \
R-package/inst R-package/src/image_recordio.h R-package/src/*.o R-package/src/*.so mxnet_*.tar.gz
cd /home/fps/.julia/v0.6/deps/src/mxnet/dmlc-core; make clean; cd -
make[1]: Entering directory '/home/fps/.julia/v0.6/deps/src/mxnet/dmlc-core'
rm -f line_split.o indexed_recordio_split.o recordio_split.o input_split_base.o io.o filesys.o local_filesys.o data.o recordio.o config.o libdmlc.a test/filesys_test test/dataiter_test test/iostream_test test/recordio_test test/split_read_test test/stream_read_test test/split_test test/libsvm_parser_test test/libfm_parser_test test/split_repeat_read_test test/strtonum_test test/logging_test test/parameter_test test/registry_test test/csv_parser_test test/unittest/dmlc_unittest test/unittest/unittest_main.o test/unittest/unittest_json.o test/unittest/unittest_threaditer.o test/unittest/unittest_optional.o test/unittest/unittest_any.o test/unittest/unittest_array_view.o test/unittest/unittest_param.o test/unittest/unittest_serializer.o test/unittest/unittest_logging.o test/unittest/unittest_config.o *~ src/*~ src/*/*~ include/dmlc/*~ test/*~
make[1]: Leaving directory '/home/fps/.julia/v0.6/deps/src/mxnet/dmlc-core'
/home/fps/.julia/v0.6/deps/src/mxnet
cd /home/fps/.julia/v0.6/deps/src/mxnet/ps-lite; make clean; cd -
make[1]: Entering directory '/home/fps/.julia/v0.6/deps/src/mxnet/ps-lite'
rm -rf build tests/test_connection tests/test_simple_app tests/test_kv_app tests/*.d
find src -name "*.pb.[ch]*" -delete
make[1]: Leaving directory '/home/fps/.julia/v0.6/deps/src/mxnet/ps-lite'
/home/fps/.julia/v0.6/deps/src/mxnet
cd /home/fps/.julia/v0.6/deps/src/mxnet/nnvm; make clean; cd -
make[1]: Entering directory '/home/fps/.julia/v0.6/deps/src/mxnet/nnvm'
rm -f -rf build lib bin *~ */*~ */*/*~ */*/*/*~ */*.o */*/*.o */*/*/*.o cli_test
make[1]: Leaving directory '/home/fps/.julia/v0.6/deps/src/mxnet/nnvm'
/home/fps/.julia/v0.6/deps/src/mxnet
cd /home/fps/.julia/v0.6/deps/src/mxnet/amalgamation; make clean; cd -
make[1]: Entering directory '/home/fps/.julia/v0.6/deps/src/mxnet/amalgamation'
rm -f *.d *.o *.so *.a *.js *.js.mem mxnet_predict-all.cc nnvm.cc
make[1]: Leaving directory '/home/fps/.julia/v0.6/deps/src/mxnet/amalgamation'
/home/fps/.julia/v0.6/deps/src/mxnet
INFO: Changing Directory to /home/fps/.julia/v0.6/deps/src/mxnet
cp: cannot stat '../../cblas.h': No such file or directory
ERROR: LoadError: failed process: Process(`cp ../../cblas.h include/cblas.h`, ProcessExited(1)) [1]
Stacktrace:
[1] pipeline_error(::Base.Process) at ./process.jl:682
[2] run(::Cmd) at ./process.jl:651
[3] run(::BinDeps.SynchronousStepCollection) at /home/fps/.julia/v0.6/BinDeps/src/BinDeps.jl:519 (repeats 2 times)
[4] satisfy!(::BinDeps.LibraryDependency, ::Array{DataType,1}) at /home/fps/.julia/v0.6/BinDeps/src/dependencies.jl:874
[5] satisfy!(::BinDeps.LibraryDependency) at /home/fps/.julia/v0.6/BinDeps/src/dependencies.jl:852
[6] macro expansion at /home/fps/.julia/v0.6/BinDeps/src/dependencies.jl:907 [inlined]
[7] macro expansion at /home/fps/.julia/v0.6/MXNet/deps/build.jl:235 [inlined]
[8] anonymous at ./:?
[9] include_from_node1(::String) at ./loading.jl:576
[10] include(::String) at ./sysimg.jl:14
[11] process_options(::Base.JLOptions) at ./client.jl:305
[12] _start() at ./client.jl:371
while loading /home/fps/.julia/v0.6/MXNet/deps/build.jl, in expression starting on line 83
1 fps@mango 01:20:33 ~/.../v0.6/MXNet (master)* $
|
oh... this KeyError might be my fault For setting the julia> ENV["CUDA_HOME"] = "..." # e.g: on Arch Linux, it's /opt/cuda
...
julia> Pkg.build("MXNet")For second post:
well, is your |
|
hmm... turning this issue into a PR makes the post owner changed ?! |
|
Anyways, I disabled the check for CUDA_HOME in [...] fatal: reference is not a tree: 89de7ab20167909bc2c4f8acd397671c47cf3c0d [...] Unable to checkout '89de7ab20167909bc2c4f8acd397671c47cf3c0d' in submodule path 'cub' [...] Regarding the error from calling fps@mango 05:46:13 ~/.../v0.6/MXNet (master) $ pwd /home/fps/.julia/v0.6/MXNet fps@mango 05:46:47 ~/.../v0.6/MXNet (master) $ ls deps/cblas.h deps/cblas.h Possibly something about my installation is broken? I just got a tarball from julialang, extracted it, |
|
I think I possibly just called |
|
Problem solved (on irc). For record, restart Julia session, then issue: julia> ENV["MXNET_COMMIT"] = "0.12.0"
julia> Pkg.build("MXNet") |
julia> Pkg.add("MXNet") INFO: Installing Formatting v0.3.0 INFO: Installing JSON v0.15.2 INFO: Installing MXNet v0.2.3 INFO: Building MXNet INFO: Found a CUDA installation. INFO: Attempting to Create directory /home/fps/.julia/v0.6/MXNet/deps/src INFO: Directory /home/fps/.julia/v0.6/MXNet/deps/src already created INFO: Attempting to Create directory /home/fps/.julia/v0.6/MXNet/deps/usr/lib INFO: Directory /home/fps/.julia/v0.6/MXNet/deps/usr/lib already created INFO: Attempting to Create directory /home/fps/.julia/v0.6/MXNet/deps/src/mxnet INFO: Directory /home/fps/.julia/v0.6/MXNet/deps/src/mxnet already created INFO: Changing Directory to /home/fps/.julia/v0.6/MXNet/deps/src/mxnet INFO: Changing Directory to /home/fps/.julia/v0.6/MXNet/deps/src/mxnet INFO: Changing Directory to /home/fps/.julia/v0.6/MXNet/deps/src/mxnet M cub HEAD is now at 8713d25... [R][DOC] update R installation guide (#6457) INFO: Changing Directory to /home/fps/.julia/v0.6/MXNet/deps/src/mxnet fatal: reference is not a tree: 89de7ab20167909bc2c4f8acd397671c47cf3c0d Unable to checkout '89de7ab20167909bc2c4f8acd397671c47cf3c0d' in submodule path 'cub' ============================================================[ ERROR: MXNet ]============================================================ LoadError: failed process: Process(`git submodule update --init`, ProcessExited(1)) [1] while loading /home/fps/.julia/v0.6/MXNet/deps/build.jl, in expression starting on line 58 ======================================================================================================================================== ============================================================[ BUILD ERRORS ]============================================================ WARNING: MXNet had build errors. - packages with build errors remain installed in /home/fps/.julia/v0.6 - build the package(s) and all dependencies with `Pkg.build("MXNet")` - build a single package by running its `deps/build.jl` script ======================================================================================================================================== INFO: Package database updated