You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues-all@impala.apache.org by "gaoxiaoqing (Jira)" <ji...@apache.org> on 2023/03/10 10:12:00 UTC

[jira] [Assigned] (IMPALA-7712) Impala read from and write to GCS

     [ https://issues.apache.org/jira/browse/IMPALA-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

gaoxiaoqing reassigned IMPALA-7712:
-----------------------------------

    Assignee: Quanlong Huang  (was: gaoxiaoqing)

> Impala read from and write to GCS
> ---------------------------------
>
>                 Key: IMPALA-7712
>                 URL: https://issues.apache.org/jira/browse/IMPALA-7712
>             Project: IMPALA
>          Issue Type: New Feature
>          Components: Backend
>    Affects Versions: Impala 3.3.0
>            Reporter: Haaris
>            Assignee: Quanlong Huang
>            Priority: Critical
>              Labels: cloudera, connector, google-cloud-storage, impala
>             Fix For: Impala 4.0.0
>
>
> Can Impala read from and write to google cloud storage GCS like the way it does with amazon s3
> I have tested the use case with S3, but when talking to GCS impala errors out with:
> Query: create table gcs_impala2 (title string) location 'gs://mybucket-gcs/some_data/' ERROR: AnalysisException: null CAUSED BY: RuntimeException: java.lang.ClassNotFoundException: Class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem not found CAUSED BY: ClassNotFoundException: Class com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem not found
>  On the same cluster i have Hive talking to GCS using the GCS connector jar provided by google form :
> [https://cloud.google.com/dataproc/docs/concepts/connectors/install-storage-connector]
>  
> Also, HDFS reads and writes from/to GCS.
>  
> Made sure java version matches and appropriate values are in classpath.
>  
> Appreciate your time and effort.
> Thanks



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org