[Python] Change use_legacy_dataset default and deprecate no-longer supported keywords in parquet.write_to_dataset #31531

Currently, the pq.write_to_dataset function also had a use_legacy_dataset keyword, but we should:

1. in case of use_legacy_dataset=True, ensure we raise deprecation warnings for all keywords that won't be supported in the new implementation (eg partition_filename_cb)
2. raise a deprecation warning for use_legacy_dataset=True, and/or already switch the default?

Reporter: Joris Van den Bossche / @jorisvandenbossche
Assignee: Alenka Frim / @AlenkaF

PRs and other links:

• GitHub Pull Request #12811

_{Note: This issue was originally created as ARROW-16122. Please see the migration documentation for further details.}