apache-airflow-providers-weaviate

Changelog¶

2.1.0¶

Note

This release of provider is only available for Airflow 2.8+ as explained in the Apache Airflow providers support policy.

Misc¶

Bump minimum Airflow version in providers to Airflow 2.8.0 (#41396)

2.0.0¶

Breaking changes¶

Warning

We bumped the minimum version of weaviate-client to 4.4.0. Many of the concepts and methods have been changed. We suggest you read Migrate from v3 to v4 before you upgrade to this version

Summary of the key changes:

Add columns Port, gRPC host, gRPC port and Use https, Use a secure channel for the underlying gRPC API options to the Weaviate connection. The default values from Airflow providers may not be suitable for using Weaviate correctly, so we recommend explicitly specifying these values.
Update WeaviateIngestOperator and WeaviateDocumentIngestOperator to use WeaviateHook with weaviate-client v4 API. The major changes are changing argument class_name to collection_name and removing batch_params.
Update WeaviateHook to utilize weaviate-client v4 API. The implementation has been extensively changed. We recommend reading Migrate from v3 to v4 to understand the changes on the Weaviate side before using the updated WeaviateHook.
Migrate the following WeaviateHook public methods to v4 API: test_connections, query_with_vector, create_object, get_object, delete_object, update_object, replace_object, object_exists, batch_data, get_or_create_object, create_or_replace_document_objects
Rename WeaviateHook public methods update_schema as update_collection_configuration, create_class as create_collection, get_schema as get_collection_configuration, delete_classes as delete_collections and query_without_vector as query_with_text.
Remove the following WeaviateHook public methods: validate_object, update_schema, create_schema, delete_all_schema, check_subset_of_schema
Remove deprecated method WeaviateHook.get_client
Remove unused argument retry_status_codes in WeaviateHook.__init__

Upgrade to weaviate-client to v4 (#40194)

Bug Fixes¶

Fix mypy problems in new weaviate client (#40330)

1.4.2¶

Misc¶

Update pandas minimum requirement for Python 3.12 (#40272)
Add dependency to httpx >= 0.25.0 everywhere (#40256)

1.4.1¶

Misc¶

Faster 'airflow_version' imports (#39552)
Simplify 'airflow_version' imports (#39497)

1.4.0¶

Note

This release of provider is only available for Airflow 2.7+ as explained in the Apache Airflow providers support policy.

Misc¶

Bump minimum Airflow version in providers to Airflow 2.7.0 (#39240)

1.3.4¶

Bug Fixes¶

Fix 'WeaviateIngestOperator'/'WeaviateDocumentIngestOperator' arguments in 'MappedOperator' (#38402)

1.3.3¶

Misc¶

Limit 'pandas' to '<2.2' (#37748)

1.3.2¶

Misc¶

feat: Switch all class, functions, methods deprecations to decorators (#36876)

1.3.1¶

Bug Fixes¶

Fix stacklevel in warnings.warn into the providers (#36831)
init templated field explicitly in constructor (#36908)

1.3.0¶

Features¶

Add WeaviateDocumentIngestOperator (#36402)
Add 'uuid_column', 'tenant' params to WeaviateIngestOperator (#36387)
Add create_or_replace_document_objects method to weaviate provider (#36177)

Bug Fixes¶

Remove 'insertion_errors' as required argument (#36435)
Handle list like input objects in weavaite's 'create_or_replace_document_objects' hook method (#36475)

1.2.0¶

Features¶

Add helper function for CRUD operations on weaviate's schema and class objects (#35919)
Add retry mechanism and dataframe support for WeaviateIngestOperator (#36085)

Bug Fixes¶

Fixing template_fields for WeaviateIngestOperator (#36359)

1.1.0¶

Note

This release of provider is only available for Airflow 2.6+ as explained in the Apache Airflow providers support policy.

Features¶

Add object methods in weaviate hook (#35934)
Add a cache for weaviate client (#35983)
Add more ways to connect to weaviate (#35864)

Misc¶

Bump minimum Airflow version in providers to Airflow 2.6.0 (#36017)

1.0.0¶

Initial version of the provider.