You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Chris Wensel (Jira)" <ji...@apache.org> on 2021/10/28 20:42:00 UTC

[jira] [Created] (HADOOP-17983) S3AFileSystem to add object tags on a PutObjectRequest to S3

Chris Wensel created HADOOP-17983:
-------------------------------------

             Summary: S3AFileSystem to add object tags on a PutObjectRequest to S3
                 Key: HADOOP-17983
                 URL: https://issues.apache.org/jira/browse/HADOOP-17983
             Project: Hadoop Common
          Issue Type: Improvement
          Components: fs/s3
    Affects Versions: 3.3.1
            Reporter: Chris Wensel


AWS S3 lifecycle rules can filter on object tags allowing for data retention policies to be more granular than a bucket or prefix.

 

It would be useful if during write, tags could be applied to the PutObjectRequest.

 

For our use-case, we are simply writing Parquet files through S3A to a target bucket, without a cluster. I believe a Configuration property would be sufficient for our needs.

 

But i'm unsure what the general use case would be for a HDFS cluster and the user wanted unique tags per job.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org