tests.system.databricks.example_databricks_sql¶
This is an example DAG which uses the DatabricksSqlOperator and DatabricksCopyIntoOperator. The first task creates the table and inserts values into it. The second task uses DatabricksSqlOperator to select the data. The third task selects the data and stores the output of selected data in file path and format specified. The fourth task runs the select SQL statement written in the test.sql file. The final task using DatabricksCopyIntoOperator loads the data from the file_location passed into Delta table.