Run ephemeral Docker Swarm services
DockerSwarmOperator(*, image: str, enable_logging: bool = True, **kwargs)¶
Execute a command as an ephemeral docker swarm service. Example use-case - Using Docker Swarm orchestration to make one-time scripts highly available.
A temporary directory is created on the host and mounted into a container to allow storing files that together exceed the default disk size of 10GB in a container. The path to the mounted directory can be accessed via the environment variable
If a login to a private registry is required prior to pulling the image, a Docker connection needs to be configured in Airflow and the connection ID be provided with the parameter
image (str) -- Docker image from which to create the container. If image tag is omitted, "latest" will be used.
api_version (str) -- Remote API version. Set to
autoto automatically detect the server's version.
auto_remove (bool) -- Auto-removal of the container on daemon side when the container's process exits. The default is False.
docker_url (str) -- URL of the host running the docker daemon. Default is unix://var/run/docker.sock
environment (dict) -- Environment variables to set in the container. (templated)
force_pull (bool) -- Pull the docker image on every run. Default is False.
tls_ca_cert (str) -- Path to a PEM-encoded certificate authority to secure the docker connection.
tls_client_cert (str) -- Path to the PEM-encoded certificate used to authenticate docker client.
tls_client_key (str) -- Path to the PEM-encoded key used to authenticate docker client.
tls_ssl_version (str) -- Version of SSL to use when communicating with docker daemon.
tmp_dir (str) -- Mount point inside the container to a temporary directory created on the host by the operator. The path is also made available via the environment variable
AIRFLOW_TMP_DIRinside the container.
tty (bool) -- Allocate pseudo-TTY to the container of this service This needs to be set see logs of the Docker container / service.
enable_logging (bool) -- Show the application's logs in operator's logs. Supported only if the Docker engine is using json-file or journald logging drivers. The tty parameter should be set to use this with Python applications.