You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues-all@impala.apache.org by "Quanlong Huang (Jira)" <ji...@apache.org> on 2021/03/19 07:47:00 UTC

[jira] [Resolved] (IMPALA-7712) Impala read from and write to GCS

     [ https://issues.apache.org/jira/browse/IMPALA-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Quanlong Huang resolved IMPALA-7712.
------------------------------------
    Fix Version/s: Impala 4.0
       Resolution: Fixed

> Impala read from and write to GCS
> ---------------------------------
>
>                 Key: IMPALA-7712
>                 URL: https://issues.apache.org/jira/browse/IMPALA-7712
>             Project: IMPALA
>          Issue Type: New Feature
>          Components: Backend
>    Affects Versions: Impala 3.3.0
>            Reporter: Haaris
>            Assignee: Quanlong Huang
>            Priority: Critical
>              Labels: cloudera, connector, google-cloud-storage, impala
>             Fix For: Impala 4.0
>
>
> Can Impala read from and write to google cloud storage GCS like the way it does with amazon s3
> I have tested the use case with S3, but when talking to GCS impala errors out with:
> Query: create table gcs_impala2 (title string) location 'gs://mybucket-gcs/some_data/' ERROR: AnalysisException: null CAUSED BY: RuntimeException: java.lang.ClassNotFoundException: Class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem not found CAUSED BY: ClassNotFoundException: Class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem not found
>  On the same cluster i have Hive talking to GCS using the GCS connector jar provided by google form :
> [https://cloud.google.com/dataproc/docs/concepts/connectors/install-storage-connector]
>  
> Also, HDFS reads and writes from/to GCS.
>  
> Made sure java version matches and appropriate values are in classpath.
>  
> Appreciate your time and effort.
> Thanks



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org