Feature request
Longformer takes global_attention_mask as input in the current transformers onnx export. Hence, it is currently not supported with ORTModel.
Motivation
Before going forward, it could be good to benchmark longformer with transformers onnx export vs the custom https://github.com/microsoft/onnxruntime/tree/main/onnxruntime/python/tools/transformers/models/longformer
Your contribution
Can see how we can support, but I'm worried adding custom cases like this to ORTModel adds overhead.
Feature request
Longformer takes
global_attention_maskas input in the current transformers onnx export. Hence, it is currently not supported with ORTModel.Motivation
Before going forward, it could be good to benchmark longformer with transformers onnx export vs the custom https://github.com/microsoft/onnxruntime/tree/main/onnxruntime/python/tools/transformers/models/longformer
Your contribution
Can see how we can support, but I'm worried adding custom cases like this to ORTModel adds overhead.