Skip to content

Conversation

@jotsif
Copy link
Contributor

@jotsif jotsif commented May 23, 2019

Attention mask should be of shape (L, S) since it is added to attn_output_weights.

@pytorchbot pytorchbot added the module: nn Related to torch.nn label May 23, 2019
@jotsif jotsif changed the title Fix documentation for attention mask shape [#20851] Fix documentation for attention mask shape May 23, 2019
@jotsif jotsif changed the title [#20851] Fix documentation for attention mask shape Fix documentation for attention mask shape May 23, 2019
Copy link
Contributor

@facebook-github-bot facebook-github-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ezyang is landing this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

@facebook-github-bot
Copy link
Contributor

@ezyang merged this pull request in 87040af.

@jotsif jotsif deleted the fix_attention_documentation branch May 27, 2019 09:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants