How-to Guides¶
Setting up the sandbox in the Quick Start section was easy; building a production-grade environment requires a bit more work!
These how-to guides will step you through common tasks in using and configuring an Airflow environment.
- Using the CLI
- Set Up Bash/Zsh Completion
- Creating a Connection
- Exporting DAG structure as an image
- Display DAGs structure
- Formatting commands output
- Purge history from metadata database
- Export the purged records from the archive tables
- Dropping the archived tables
- Upgrading Airflow
- Downgrading Airflow
- Exporting Connections
- Testing for DAG Import Errors
- Add tags to DAGs and use it for filtering in the UI
- Add Owner Links to DAG
- Creating a notifier
- Setting Configuration Options
- Configuring local settings
- Configuring Flask Application for Airflow Webserver
- Set up a Database Backend
- Using Operators
- BashOperator
- BashSensor
- BranchDateTimeOperator
- FileSensor
- PythonOperator
- PythonVirtualenvOperator
- ExternalPythonOperator
- PythonBranchOperator
- BranchPythonVirtualenvOperator
- BranchExternalPythonOperator
- ShortCircuitOperator
- PythonSensor
- TimeDeltaSensor
- TimeDeltaSensorAsync
- TimeSensor
- TimeSensorAsync
- BranchDayOfWeekOperator
- DayOfWeekSensor
- Cross-DAG Dependencies
- Customizing DAG Scheduling with Timetables
- Customize view of Apache from Airflow web UI
- Listener Plugin of Airflow
- Customizing the UI
- Creating a custom Operator
- Creating Custom
@task
Decorators - (Optional) Adding IDE auto-completion support
- Export dynamic environment variables available for operators to use
- Managing Connections
- Managing Variables
- Setup and Teardown
- Running Airflow behind a reverse proxy
- Running Airflow with systemd
- Define an operator extra link
- Email Configuration
- Dynamic DAG Generation
- Running Airflow in Docker
- Before you begin
- Fetching
docker-compose.yaml
- Initializing Environment
- Cleaning-up the environment
- Running Airflow
- Accessing the environment
- Cleaning up
- Using custom images
- Special case - adding dependencies via requirements.txt file
- Networking
- Debug Airflow inside docker container using PyCharm
- FAQ: Frequently asked questions
- What’s Next?
- Environment variables supported by Docker Compose
- Upgrading from 1.10 to 2