Feature request

• In the Hubert model convolutional positional encoding - add a support for batch norm instead of weight norm as added in Fairseq at - facebookresearch/fairseq@4db2649
• This in turn will allow supporting mhubert-base-25hz which was introduced in - https://arxiv.org/abs/2305.13009

Motivation

• This will give the opportunity to support other textlesslib/fairseq models and specifically the newer, better HuBERT model - mhubert-base-25hz which uses this and is currently unsupported.
• This model is frequently used for training speech language models, and would benefit the community as well as myself in a project I am working on.

Your contribution

I can create a PR to implement this, but would love some guidance @ylacombe