ToggleButtons use RawMaterialButton which is scheduled to be deprecated and removed (eventually).
We need to refactor them to use the new button universe, either TextButton, OutlinedButton or ElevatedButton.

cc @TahaTesser and @HansMuller

Completing this will likely resolve #97302 as well.