airflow.providers.postgres.hooks.postgres¶
Module Contents¶
Classes¶
Interact with Postgres. |
Attributes¶
- class airflow.providers.postgres.hooks.postgres.PostgresHook(*args, **kwargs)[source]¶
Bases:
airflow.hooks.dbapi.DbApiHookInteract with Postgres.
You can specify ssl parameters in the extra field of your connection as
{"sslmode": "require", "sslcert": "/path/to/cert.pem", etc}. Also you can choose cursor as{"cursor": "dictcursor"}. Refer to the psycopg2.extras for more details.Note: For Redshift, use keepalives_idle in the extra connection parameters and set it to less than 300 seconds.
Note: For AWS IAM authentication, use iam in the extra connection parameters and set it to true. Leave the password field empty. This will use the "aws_default" connection to get the temporary token unless you override in extras. extras example:
{"iam":true, "aws_conn_id":"my_aws_conn"}For Redshift, also use redshift in the extra connection parameters and set it to true. The cluster-identifier is extracted from the beginning of the host field, so is optional. It can however be overridden in the extra field. extras example:{"iam":true, "redshift":true, "cluster-identifier": "my_cluster_id"}- Parameters
postgres_conn_id -- The postgres conn id reference to a specific postgres database.
- copy_expert(self, sql, filename)[source]¶
Executes SQL using psycopg2 copy_expert method. Necessary to execute COPY command without access to a superuser.
Note: if this method is called with a "COPY FROM" statement and the specified input file does not exist, it creates an empty file and no data is loaded, but the operation succeeds. So if users want to be aware when the input file does not exist, they have to check its existence by themselves.