Skip to content
This repository was archived by the owner on Apr 8, 2025. It is now read-only.

Add warmup run to component benchmark#504

Merged
tholor merged 1 commit intomasterfrom
warmup_run
Sep 2, 2020
Merged

Add warmup run to component benchmark#504
tholor merged 1 commit intomasterfrom
warmup_run

Conversation

@brandenchan
Copy link
Copy Markdown
Contributor

We saw cases where the first run in the loop of question_answering_components.py took longer or showed different time profile characteristics. This PR adds a warm up run in order to combat this fluctuation, which we suspect comes from the GPU warming up.

@brandenchan brandenchan requested a review from tholor August 27, 2020 15:19
Copy link
Copy Markdown
Member

@tholor tholor left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems reasonable! Did you try running it and checked whether the timing is now more consistent?

@tholor
Copy link
Copy Markdown
Member

tholor commented Sep 2, 2020

I did a test run and the timing seems now consistent 👍

@tholor tholor merged commit 33afbd3 into master Sep 2, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants