Apache Drill support for S3 Version 4 API | Hadoop new version libraries

[Harsh Choudhary <sh...@gmail.com>]

Hi

As I can see Apache Drill is still running on the libraries of Hadoop 2.7.4
version. One thing which does not work with this version of Hadoop is AWS
S3 Signature Version 4 API, which is the only APIs available in newer Data
Centers like Mumbai. This I first noticed in June 2017. I thought
eventually Hadoop version would be upgraded and it would be fixed but
Hadoop Version is still not 2.8. Is there any specific reason for this? Can
you refer me to any open ticket on this and what are the other challenges
which I am not seeing? Maybe I can contribute to this.

*Thanks!*
Harsh Choudhary

Re: Apache Drill support for S3 Version 4 API | Hadoop new version libraries

[Arina Yelchiyeva <ar...@gmail.com>]

Hi Harsh,

there is an open Jira ticket for this with the details [1]. Contributions
are definitely are welcomed.

[1] https://issues.apache.org/jira/browse/DRILL-6540

Kind regards,
Arina

On Wed, Jan 23, 2019 at 7:38 PM Harsh Choudhary <sh...@gmail.com>
wrote:

> Hi
>
> As I can see Apache Drill is still running on the libraries of Hadoop 2.7.4
> version. One thing which does not work with this version of Hadoop is AWS
> S3 Signature Version 4 API, which is the only APIs available in newer Data
> Centers like Mumbai. This I first noticed in June 2017. I thought
> eventually Hadoop version would be upgraded and it would be fixed but
> Hadoop Version is still not 2.8. Is there any specific reason for this? Can
> you refer me to any open ticket on this and what are the other challenges
> which I am not seeing? Maybe I can contribute to this.
>
> *Thanks!*
> Harsh Choudhary
>