Skip to content

Conversation

@shchur
Copy link
Collaborator

@shchur shchur commented Apr 15, 2024

Description of changes:

  • Increment the random seed used to train each consecutive model by 1. This fixes a weird regression for GluonTS models: when we use the same seed for all GluonTS models, their performance becomes correlated and sometimes leads to an overall performance regression. This likely happens because, when the seed is fixed, the GluonTS dataloaders returns batches in the same order.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

@shchur shchur requested a review from canerturkmen April 15, 2024 12:26
@yinweisu
Copy link
Contributor

Previous CI Run Current CI Run

Copy link
Contributor

@canerturkmen canerturkmen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thanks 🦸

@shchur shchur merged commit 949a781 into autogluon:master Apr 15, 2024
@shchur shchur deleted the increment-seed branch April 15, 2024 13:31
LennartPurucker pushed a commit to LennartPurucker/autogluon that referenced this pull request Jun 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants