Skip to content

Add Nesterov Momentum #766

@ajbrock

Description

@ajbrock

Hi guys,

Would you be interested in adding Nesterov momentum to the SGD optimizer? I've got a version based on this parameterization that just drops in a quick couple of changes to the SGD file. I'm not entirely sure what test files would need to be modified to make this appropriate, but I'd be down to submit a pull request and hash that out if there's interest.

Best,

Andy

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions