Upload data from Local Filesystem to Azure Data Lake¶

The Azure Data Lake (ADL) make it easy to store data of any size, shape, and speed. This page shows how to upload data from local filesystem to ADL.

Prerequisite Tasks

Prerequisite Tasks ¶

LocalToAzureDataLakeStorageOperator¶

LocalToAzureDataLakeStorageOperator allows you to upload data from local filesystem to ADL.

Below is an example of using this operator to upload a file to ADL.

airflow/providers/microsoft/azure/example_dags/example_local_to_adls.pyView Source

    upload_file = LocalToAzureDataLakeStorageOperator(
        task_id='upload_task',
        local_path=LOCAL_FILE_PATH,
        remote_path=REMOTE_FILE_PATH,
    )

Reference¶

For further information, look at:

Azure Data lake Storage Documentation

Was this entry helpful?