-
Notifications
You must be signed in to change notification settings - Fork 2.2k
Closed
Description
Search before asking
- I had searched in the feature and found no similar feature requirement.
Description
https://github.com/apache/seatunnel/blob/dev/seatunnel-engine/seatunnel-engine-storage/imap-storage-plugins/imap-storage-file/src/main/java/org/apache/seatunnel/engine/imap/storage/file/config/HdfsConfiguration.java
We use hazelcast imap to store the job status, and it will lose when cluster restart as it's only in memory, so we need persistence the data to avoid missing history data after restart.
Now we can store them to hdfs, localfile, oss. But i find the HDFS configuration only setted the fs.defaultFS parameter.
We can improve it add more parameter like hdfs_site_file_path, some config related kerberos
Usage Scenario
No response
Related issues
No response
Are you willing to submit a PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct
Metadata
Metadata
Assignees
Labels
No labels