Enable hdfs test(s) in ci

Currently hdfs support is behind a feature configuration flag and so any tests that are related to hdfs are not run in ci.

We should have an additional test pipeline to enable these tests

Related https://github.com/apache/datafusion-comet/issues/1367