You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (Jira)" <ji...@apache.org> on 2021/07/01 15:42:00 UTC
[jira] [Commented] (HADOOP-17784) hadoop-aws landsat-pds test
bucket will be deleted on Jul 1, 2021
[ https://issues.apache.org/jira/browse/HADOOP-17784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17372895#comment-17372895 ]
Steve Loughran commented on HADOOP-17784:
-----------------------------------------
Apparently it'll be moving to requester pays to give a warning that it'll go:
https://lists.osgeo.org/pipermail/landsat-pds/2021-June/000181.html
What do we want from a new file?
* AWS fund the data reads, so keeping costs down, especially for open source developers without someone paying their bills.
* eliminates the overhead of creating a multi MB dataset on test runs
* CSV.GZ so we can verify the code can read .csv.gz data created through other applications
* supports S3 select
* world/anonymous readable
* read-only so we can do permission and credential tests
> hadoop-aws landsat-pds test bucket will be deleted on Jul 1, 2021
> -----------------------------------------------------------------
>
> Key: HADOOP-17784
> URL: https://issues.apache.org/jira/browse/HADOOP-17784
> Project: Hadoop Common
> Issue Type: Test
> Components: fs/s3, test
> Reporter: Leona Yoda
> Priority: Major
>
> I found an anouncement that landsat-pds buket will be deleted on July 1, 2021
> (https://registry.opendata.aws/landsat-8/)
> and I think this bucket is used in th test of hadoop-aws module use
> [https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/S3ATestConstants.java#L93]
>
> At this time I can access the bucket but we might have to change the test bucket in someday.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org