Description
Currently, we can only pass custom Image name to DataprocClusterCreateOperator(),
as the custom image expires after 60 days, we either need to update the image or we need to pass the expiration token.
Functionality is already available in gcloud and REST.
gcloud dataproc clusters test_cluster ...... --image projects/<custom_image_project_id>/global/images/family/<family_name> .......
Use case / motivation
The user should be able to pass either Custom Image or Custom Image family name,
so we don't have to update the image up on expiration or use expiration token.
Are you willing to submit a PR?
Yes
Related Issues
None