Skip to content

A typo in Adam docs #142041

@Tony-Y

Description

@Tony-Y

📚 The doc issue

https://pytorch.org/docs/stable/generated/torch.optim.Adam.html describes AMSGrad algorithm as follows:

amsgrad

The first equation should be:
correction

https://pytorch.org/docs/stable/generated/torch.optim.AdamW.html also has the same issue.

Suggest a potential alternative/fix

&\hspace{10mm}\widehat{v_t}^{max} \leftarrow \mathrm{max}(\widehat{v_t}^{max},

It should be revised as the following:

&\hspace{10mm}\widehat{v_t}^{max} \leftarrow \mathrm{max}(\widehat{v_{t-1}}^{max},

cc @svekars @brycebortree @sekyondaMeta @AlannaBurke @vincentqb @jbschlosser @albanD @janeyx99 @crcrpar

Metadata

Metadata

Assignees

No one assigned

    Labels

    module: docsRelated to our documentation, both in docs/ and docblocksmodule: optimizerRelated to torch.optimtriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions