Skip to content

convert_beam_search supports large gpt2 model#11989

Merged
tianleiwu merged 1 commit intomasterfrom
tlwu/add_convert_beam_search_options
Jun 28, 2022
Merged

convert_beam_search supports large gpt2 model#11989
tianleiwu merged 1 commit intomasterfrom
tlwu/add_convert_beam_search_options

Conversation

@tianleiwu
Copy link
Contributor

Description:
(1) add --run_shape_inference to make shape inference optional
(2) add --vocab_mask to make the input optional
(3) add --overwrite in gpt2 convert_to_onnx to allow overwrite existed raw onnx from PyTorch
(4) save gpt2 model tensors to one external data file by default
(5) group convert_beam_search arguments to multiple groups
(6) make --decoder_onnx optional for gpt2 model
(7) replace print by logger
(8) update shape inference function to support external data.
(9) when saving external data, show warning if onnx version < 1.12

Motivation and Context

  • Why is this change required? What problem does it solve?
  • If it fixes an open issue, please link to the issue here.

@tianleiwu tianleiwu requested review from viboga and wangyems June 25, 2022 00:06
@tianleiwu tianleiwu merged commit 9be2b60 into master Jun 28, 2022
@tianleiwu tianleiwu deleted the tlwu/add_convert_beam_search_options branch June 28, 2022 17:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants