Skip to content

Conversation

@izdeby
Copy link
Contributor

@izdeby izdeby commented Jun 7, 2019

Stack from ghstack:

Enabled storage to support BFloat16 type.
Tested via unit tests

Differential Revision: D15819368

@pytorchbot pytorchbot added module: build Build system issues module: cpu CPU specific problem (e.g., perf, algorithm) module: cuda Related to torch.cuda, and CUDA support in general module: internals Related to internal abstractions in c10 and ATen module: operators labels Jun 7, 2019
@izdeby izdeby mentioned this pull request Jun 7, 2019
@izdeby izdeby changed the title Enabled BFloat16 storage [WIP] Enabled BFloat16 storage Jun 7, 2019
izdeby added 2 commits June 7, 2019 10:39
Enabled BFloat16 storage

gh-metadata: pytorch pytorch 21523 gh/izdeby/9/head
Enabled BFloat16 storage

gh-metadata: pytorch pytorch 21523 gh/izdeby/9/head
@izdeby izdeby changed the title [WIP] Enabled BFloat16 storage Enabled BFloat16 storage Jun 7, 2019
@izdeby izdeby changed the title Enabled BFloat16 storage [WIP] Enabled BFloat16 storage Jun 10, 2019
Enabled BFloat16 storage

gh-metadata: pytorch pytorch 21523 gh/izdeby/9/head
@izdeby izdeby changed the title [WIP] Enabled BFloat16 storage Enabled BFloat16 storage Jun 10, 2019
@izdeby izdeby requested a review from gchanan June 10, 2019 20:21
@ezyang
Copy link
Contributor

ezyang commented Jun 11, 2019

This LGTM. I'll let Greg do final approval

Copy link
Contributor

@gchanan gchanan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

testing? I'm presuming we have tests for bool around conversion, moving to cuda and back, etc. We should have those here.

Enabled BFloat16 storage

gh-metadata: pytorch pytorch 21523 gh/izdeby/9/head
@izdeby izdeby requested review from ezyang and gchanan June 12, 2019 20:46
Enabled BFloat16 storage

gh-metadata: pytorch pytorch 21523 gh/izdeby/9/head
@izdeby izdeby changed the title Enabled BFloat16 storage [WIP] Enabled BFloat16 storage Jun 17, 2019
Enabled BFloat16 storage

gh-metadata: pytorch pytorch 21523 gh/izdeby/9/head
izdeby added 4 commits June 21, 2019 11:42
Enabled BFloat16 storage

gh-metadata: pytorch pytorch 21523 gh/izdeby/9/head
Enabled BFloat16 storage

gh-metadata: pytorch pytorch 21523 gh/izdeby/9/head
Enabled BFloat16 storage

gh-metadata: pytorch pytorch 21523 gh/izdeby/9/head
Enabled BFloat16 storage

gh-metadata: pytorch pytorch 21523 gh/izdeby/9/head
@izdeby izdeby requested a review from bddppq June 25, 2019 22:00
izdeby added 4 commits June 26, 2019 08:21
Enabled BFloat16 storage

gh-metadata: pytorch pytorch 21523 gh/izdeby/9/head
Enabled BFloat16 storage

gh-metadata: pytorch pytorch 21523 gh/izdeby/9/head
Enabled BFloat16 storage

gh-metadata: pytorch pytorch 21523 gh/izdeby/9/head
Enabled BFloat16 storage

gh-metadata: pytorch pytorch 21523 gh/izdeby/9/head
@izdeby izdeby changed the title [WIP] Enabled BFloat16 storage Enabled BFloat16 storage Jun 28, 2019
Enabled BFloat16 storage

gh-metadata: pytorch pytorch 21523 gh/izdeby/9/head
@soumyarooproy
Copy link

I am curious if this is currently being gated by just the two build failures above or even a reviewer.

@soumith
Copy link
Contributor

soumith commented Jul 3, 2019

@soumyarooproy i think Iurii will land this along with other BFloat16 diffs at once. If you see the PR description (the first comment), this is a stack of diffs that he is building up.

Enabled BFloat16 storage

gh-metadata: pytorch pytorch 21523 gh/izdeby/9/head
This was referenced Jul 9, 2019
Enabled BFloat16 storage

gh-metadata: pytorch pytorch 21523 gh/izdeby/9/head
@zou3519 zou3519 deleted the gh/izdeby/9/head branch July 10, 2019 04:53
@facebook-github-bot
Copy link
Contributor

@izdeby merged this pull request in 3a8d746.

zdevito pushed a commit to zdevito/ATen that referenced this pull request Jul 10, 2019
Summary:
Pull Request resolved: pytorch/pytorch#21523
ghimport-source-id: 698b3cbd6b21c09b9ff8bf8011980df8e35c33b0

Test Plan: Imported from OSS

Differential Revision: D15819368

Pulled By: izdeby

fbshipit-source-id: f6b3bba7b3ca8ee677bd80a231dbb3920c07d61c
@nottombrown
Copy link

Thanks for adding this! I'm having trouble using it from the python API. Have we not yet implemented casting to and from bfloat16?

@izdeby
Copy link
Contributor Author

izdeby commented Jul 22, 2019

Hey, @nottombrown, what are you trying to do? i added conversion method in this PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Merged module: build Build system issues module: cpu CPU specific problem (e.g., perf, algorithm) module: cuda Related to torch.cuda, and CUDA support in general module: internals Related to internal abstractions in c10 and ATen

Projects

None yet

Development

Successfully merging this pull request may close these issues.