System Info

Optimum main branch with pytorch=2.0 and cuda version 11.7.

Who can help?

No response

Information

• The official example scripts
• My own modified scripts

Tasks

• An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• My own task or dataset (give details below)

Reproduction

Running training with a model transformed with BetterTransformer.transform yields an error message on not supporting training (https://github.com/huggingface/optimum/blob/main/optimum/bettertransformer/models/base.py#L134).

However, the documentation states that BetterTransformer already supports training.
https://github.com/huggingface/optimum/blob/main/docs/source/bettertransformer/tutorials/convert.mdx#training-compatibility

Expected behavior

Either the documentation should be updated or feature branch should be merged to main.