Amazon S3 Vectors¶

Amazon S3 Vectors provides native vector storage in Amazon S3 for AI/ML applications. Use the operators below to manage S3 Vectors resources.

Create a Vector Bucket¶

To create an Amazon S3 Vectors vector bucket, use S3VectorsCreateVectorBucketOperator.

tests/system/amazon/aws/example_s3_vectors.py[source]

create_vector_bucket = S3VectorsCreateVectorBucketOperator(
    task_id="create_vector_bucket",
    vector_bucket_name=bucket_name,
)

Create an Index¶

To create an index in an Amazon S3 Vectors vector bucket, use S3VectorsCreateIndexOperator.

tests/system/amazon/aws/example_s3_vectors.py[source]

create_index = S3VectorsCreateIndexOperator(
    task_id="create_index",
    vector_bucket_name=bucket_name,
    index_name=index_name,
    data_type="float32",
    dimension=128,
    distance_metric="cosine",
)

Delete an Index¶

To delete an index from an Amazon S3 Vectors vector bucket, use S3VectorsDeleteIndexOperator.

tests/system/amazon/aws/example_s3_vectors.py[source]

delete_index = S3VectorsDeleteIndexOperator(
    task_id="delete_index",
    vector_bucket_name=bucket_name,
    index_name=index_name,
    trigger_rule=TriggerRule.ALL_DONE,
)

Delete a Vector Bucket¶

To delete an Amazon S3 Vectors vector bucket, use S3VectorsDeleteVectorBucketOperator.

tests/system/amazon/aws/example_s3_vectors.py[source]

delete_vector_bucket = S3VectorsDeleteVectorBucketOperator(
    task_id="delete_vector_bucket",
    vector_bucket_name=bucket_name,
    trigger_rule=TriggerRule.ALL_DONE,
)

Reference¶

AWS boto3 Library Documentation for S3 Vectors