airflow.providers.apache.pig.operators.pig
¶
Module Contents¶
Classes¶
Executes pig script. |
- class airflow.providers.apache.pig.operators.pig.PigOperator(*, pig, pig_cli_conn_id='pig_cli_default', pigparams_jinja_translate=False, pig_opts=None, pig_properties=None, **kwargs)[source]¶
Bases:
airflow.models.BaseOperator
Executes pig script.
- Parameters
pig (str) – the pig latin script to be executed. (templated)
pig_cli_conn_id (str) – reference to the Hive database
pigparams_jinja_translate (bool) – when True, pig params-type templating ${var} gets translated into jinja-type templating {{ var }}. Note that you may want to use this along with the
DAG(user_defined_macros=myargs)
parameter. View the DAG object documentation for more details.pig_opts (str | None) – pig options, such as: -x tez, -useHCatalog, … - space separated list
pig_properties (list[str] | None) – pig properties, additional pig properties passed as list
- prepare_template()[source]¶
Hook triggered after the templated fields get replaced by their content.
If you need your object to alter the content of the file before the template is rendered, it should override this method to do so.