airflow.providers.google.cloud.hooks.kubernetes_engine

This module contains a Google Kubernetes Engine Hook.

Module Contents

airflow.providers.google.cloud.hooks.kubernetes_engine.OPERATIONAL_POLL_INTERVAL = 15[source]
class airflow.providers.google.cloud.hooks.kubernetes_engine.GKEHook(gcp_conn_id: str = 'google_cloud_default', delegate_to: Optional[str] = None, location: Optional[str] = None, impersonation_chain: Optional[Union[str, Sequence[str]]] = None)[source]

Bases: airflow.providers.google.common.hooks.base_google.GoogleBaseHook

Hook for Google Kubernetes Engine APIs.

All the methods in the hook where project_id is used must be called with keyword arguments rather than positional.

get_conn(self)[source]

Returns ClusterManagerCLinet object.

Return type

google.cloud.container_v1.ClusterManagerClient

get_client(self)[source]
wait_for_operation(self, operation: Operation, project_id: Optional[str] = None)[source]

Given an operation, continuously fetches the status from Google Cloud until either completion or an error occurring

Parameters

  • operation (google.cloud.container_V1.gapic.enums.Operation) -- The Operation to wait for

  • project_id (str) -- Google Cloud project ID

Returns

A new, updated operation fetched from Google Cloud

get_operation(self, operation_name: str, project_id: Optional[str] = None)[source]

Fetches the operation from Google Cloud

Parameters

  • operation_name (str) -- Name of operation to fetch

  • project_id (str) -- Google Cloud project ID

Returns

The new, updated operation from Google Cloud

delete_cluster(self, name: str, project_id: str, retry: Retry = DEFAULT, timeout: float = DEFAULT)[source]

Deletes the cluster, including the Kubernetes endpoint and all worker nodes. Firewalls and routes that were configured during cluster creation are also deleted. Other Google Compute Engine resources that might be in use by the cluster (e.g. load balancer resources) will not be deleted if they were not present at the initial create time.

Parameters

  • name (str) -- The name of the cluster to delete

  • project_id (str) -- Google Cloud project ID

  • retry (google.api_core.retry.Retry) -- Retry object used to determine when/if to retry requests. If None is specified, requests will not be retried.

  • timeout (float) -- The amount of time, in seconds, to wait for the request to complete. Note that if retry is specified, the timeout applies to each individual attempt.

Returns

The full url to the delete operation if successful, else None

create_cluster(self, cluster: Union[Dict, Cluster], project_id: str, retry: Retry = DEFAULT, timeout: float = DEFAULT)[source]

Creates a cluster, consisting of the specified number and type of Google Compute Engine instances.

Parameters
Returns

The full url to the new, or existing, cluster

Raises

ParseError: On JSON parsing problems when trying to convert dict AirflowException: cluster is not dict type nor Cluster proto type

get_cluster(self, name: str, project_id: str, retry: Retry = DEFAULT, timeout: float = DEFAULT)[source]

Gets details of specified cluster

Parameters

  • name (str) -- The name of the cluster to retrieve

  • project_id (str) -- Google Cloud project ID

  • retry (google.api_core.retry.Retry) -- A retry object used to retry requests. If None is specified, requests will not be retried.

  • timeout (float) -- The amount of time, in seconds, to wait for the request to complete. Note that if retry is specified, the timeout applies to each individual attempt.

Returns

google.cloud.container_v1.types.Cluster

Was this entry helpful?