Skip to content

Passing Custom Image Family Name to the DataprocClusterCreateOperator() #15245

@pateash

Description

@pateash

Description
Currently, we can only pass custom Image name to DataprocClusterCreateOperator(),
as the custom image expires after 60 days, we either need to update the image or we need to pass the expiration token.

Functionality is already available in gcloud and REST.

gcloud dataproc clusters test_cluster ...... --image projects/<custom_image_project_id>/global/images/family/<family_name> .......

Use case / motivation
The user should be able to pass either Custom Image or Custom Image family name,
so we don't have to update the image up on expiration or use expiration token.

Are you willing to submit a PR?
Yes

Related Issues
None

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions