Skip to content

Conversation

@gchanan
Copy link
Contributor

@gchanan gchanan commented Oct 6, 2018

This reverts commit 14b48a2.

Copy link
Contributor

@facebook-github-bot facebook-github-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

gchanan has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

@gchanan
Copy link
Contributor Author

gchanan commented Oct 6, 2018

Looks like the reverted commit broke the windows build.

@ilia-cher
Copy link
Contributor

Windows build was broken because of unrelated to commit issue - linker falls back (because it runs out of memory) to another linker that didn't support a command line option.

@gchanan
Copy link
Contributor Author

gchanan commented Oct 6, 2018

@peterjc123 / @yf225 have you seen the error on https://ci.pytorch.org/jenkins/job/pytorch-builds/job/pytorch-win-ws2016-cuda9-cudnn7-py3-build/23709//console before? In particular what @ilia-cher is referring to is this:

06:02:02 LINK : the 32-bit linker (C:\PROGRA~2\MIB055~1\2017\COMMUN~1\VC\Tools\MSVC\1411~1.255\bin\Hostx86\x64\link.exe) ran out of heap space; restarting link with the 64-bit linker (C:\Program Files\Git\usr\bin\link.exe)
06:02:02 link: unknown option -- L

is this an actual problem with the commit or do we need to change the build / build config?

@ilia-cher
Copy link
Contributor

cc. @Yangqing

@ilia-cher ilia-cher self-requested a review October 6, 2018 06:29
@ilia-cher
Copy link
Contributor

I'm pretty sure it is a build script issue and not the commit, but I can accept and send a new pr and lets recheck everything

@gchanan
Copy link
Contributor Author

gchanan commented Oct 6, 2018

leaving this open for discussion, but don't commit because phabricator diff isn't valid.

Copy link
Collaborator

@ssnl ssnl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If the build script can't be fixed soon, let's unbreak build first.

@peterjc123
Copy link
Collaborator

@gchanan According to this post, this problem can be solved by setting the environmental variable PreferredToolArchitecture to x64.

@ezyang
Copy link
Contributor

ezyang commented Oct 8, 2018

I'm a little confused by the discussion here, because the CI results seem to claim the Windows builds passed?

@peterjc123
Copy link
Collaborator

@ezyang I guess that this PR reverts the change that may cause the aforementioned error. Let's switch the default to the x64 toolchain and then it'll be fine.

facebook-github-bot pushed a commit that referenced this pull request Oct 8, 2018
Summary:
A possible fix for the problem stated in #12410.
Pull Request resolved: #12446

Differential Revision: D10238572

Pulled By: soumith

fbshipit-source-id: 17ade148c4036d2481b878e5cd7d9d67c1e3626e
@Orvid
Copy link
Contributor

Orvid commented Oct 8, 2018

06:02:02 LINK : the 32-bit linker (C:\PROGRA~2\MIB055~1\2017\COMMUN~1\VC\Tools\MSVC\1411~1.255\bin\Hostx86\x64\link.exe) ran out of heap space; restarting link with the 64-bit linker (C:\Program Files\Git\usr\bin\link.exe)

Isn't a build error. The build will succeed, but it will take longer to link, as it's basically trying to link with the 32-bit hosted linker, which fails because the 32-bit address space is too small to be able to link successfully, so it runs the 64-bit hosted linker which then links successfully.

TLDR; The x86_amd64 MSVC toolchain is 32-bit binaries cross-compiling for amd64, and if the linker runs out of memory, it starts the linker from the amd64 (aka. amd64_amd64) toolchain, which is a 64-bit binary and has enough memory to complete.

@gchanan gchanan closed this Oct 8, 2018
@peterjc123
Copy link
Collaborator

@Orvid Yes, you are right. But the alternative x64 linker C:\Program Files\Git\usr\bin\link.exe is not what we want here. So #12446 is created.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants