Skip to content
This repository was archived by the owner on Apr 8, 2025. It is now read-only.

Fixed conversion of BertForMaskedLM to transformers#555

Merged
Timoeller merged 1 commit intodeepset-ai:masterfrom
himanshurawlani:fix_BertForMaskedLM_conversion_transformers
Sep 24, 2020
Merged

Fixed conversion of BertForMaskedLM to transformers#555
Timoeller merged 1 commit intodeepset-ai:masterfrom
himanshurawlani:fix_BertForMaskedLM_conversion_transformers

Conversation

@himanshurawlani
Copy link
Copy Markdown
Contributor

Fix for issue #533

Made the following changes:

  1. Added layer_dims attribute in FARM's BertLMHead class as described in the issue.
  2. Added check for the conversion of AdaptiveModel with 2 prediction heads (where the first prediction head is "language_modelling") in AdaptiveModel.convert_to_transformers()

Copy link
Copy Markdown
Contributor

@Timoeller Timoeller left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking good, thanks for this simple yet powerful addition.

@Timoeller Timoeller merged commit 23d3177 into deepset-ai:master Sep 24, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants