You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2018/04/04 22:20:00 UTC
[jira] [Created] (HADOOP-15364) Add support for S3 Select to S3A
Steve Loughran created HADOOP-15364:
---------------------------------------
Summary: Add support for S3 Select to S3A
Key: HADOOP-15364
URL: https://issues.apache.org/jira/browse/HADOOP-15364
Project: Hadoop Common
Issue Type: Sub-task
Components: fs/s3
Reporter: Steve Loughran
Assignee: Steve Loughran
Expect a PoC patch for this in a couple of days;
* it'll depend on an SDK update to work, plus a couple of of other minor changes
* Adds command line option too
{code}
hadoop s3guard select -header use -compression gzip -limit 100 s3a://landsat-pds/scene_list.gz" \
"SELECT s.entityId FROM S3OBJECT s WHERE s.cloudCover = '0.0' "
{code}
For wider use we'll need to implement the HADOOP-15229 so that callers can pass down the expression along with any other parameters
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org