Common AI

incubation

apache-airflow-providers-common-ai

AI/LLM hooks and operators for Airflow pipelines using pydantic-ai.

Works with Airflow 3.0+
Install:
pip install apache-airflow-providers-common-ai==0.1.0

Airflow

3.0+

Python

>=3.10

Dependencies (4)

Show all Hide apache-airflow>=3.0.0 apache-airflow-providers-common-compat>=1.14.1 apache-airflow-providers-standard>=1.12.1 pydantic-ai-slim>=1.34.0

Connections (5)

Modules

O

AgentOperator

Run a pydantic-ai Agent with tools and multi-turn reasoning.

airflow.providers.common.ai.operators.agent.AgentOperator
O

LLMOperator

Call an LLM with a prompt and return the output.

airflow.providers.common.ai.operators.llm.LLMOperator
O

LLMFileAnalysisOperator

Analyze files from object storage or local storage using a single LLM call.

airflow.providers.common.ai.operators.llm_file_analysis.LLMFileAnalysisOperator
O

LLMBranchOperator

Ask an LLM to choose which downstream task(s) to execute.

airflow.providers.common.ai.operators.llm_branch.LLMBranchOperator
O

LLMSQLQueryOperator

Generate SQL queries from natural language using an LLM.

airflow.providers.common.ai.operators.llm_sql.LLMSQLQueryOperator
O

LLMSchemaCompareOperator

Compare schemas across different database systems and detect drift using LLM reasoning.

airflow.providers.common.ai.operators.llm_schema_compare.LLMSchemaCompareOperator
H

PydanticAIAzureHook

Hook for Azure OpenAI via pydantic-ai.

airflow.providers.common.ai.hooks.pydantic_ai.PydanticAIAzureHook
H

PydanticAIBedrockHook

Hook for AWS Bedrock via pydantic-ai.

airflow.providers.common.ai.hooks.pydantic_ai.PydanticAIBedrockHook
H

PydanticAIHook

Hook for LLM access via pydantic-ai.

airflow.providers.common.ai.hooks.pydantic_ai.PydanticAIHook
H

PydanticAIVertexHook

Hook for Google Vertex AI (or Generative Language API) via pydantic-ai.

airflow.providers.common.ai.hooks.pydantic_ai.PydanticAIVertexHook
H

MCPHook

Hook for connecting to MCP (Model Context Protocol) servers.

airflow.providers.common.ai.hooks.mcp.MCPHook
D

@task.agent

Wrap a function that returns a prompt into an agentic LLM task.

airflow.providers.common.ai.decorators.agent.agent_task
D

@task.llm

Wrap a function that returns a prompt into a general-purpose LLM task.

airflow.providers.common.ai.decorators.llm.llm_task
D

@task.llm_file_analysis

Wrap a callable that returns a prompt into an LLM-backed file-analysis task.

airflow.providers.common.ai.decorators.llm_file_analysis.llm_file_analysis_task
D

@task.llm_branch

Wrap a function that returns a prompt into an LLM-driven branching task.

airflow.providers.common.ai.decorators.llm_branch.llm_branch_task
D

@task.llm_sql

Wrap a function that returns a natural language prompt into an LLM SQL task.

airflow.providers.common.ai.decorators.llm_sql.llm_sql_task
D

@task.llm_schema_compare

Wrap a function that returns a prompt into an LLM schema comparison task.

airflow.providers.common.ai.decorators.llm_schema_compare.llm_schema_compare_task