Feature request
Support of a new version of the mamba architecture. See paper @ https://arxiv.org/abs/2405.21060. Base code has been released in their repo https://github.com/state-spaces/mamba.
Motivation
It's still very competitive in NLP (according to the benchmarks) but also a good chunk faster due to new parallelism mechanisms.
Your contribution
Not sure, I could look into it but it's definitely a bigger undertaking :)
Feature request
Support of a new version of the mamba architecture. See paper @ https://arxiv.org/abs/2405.21060. Base code has been released in their repo https://github.com/state-spaces/mamba.
Motivation
It's still very competitive in NLP (according to the benchmarks) but also a good chunk faster due to new parallelism mechanisms.
Your contribution
Not sure, I could look into it but it's definitely a bigger undertaking :)