You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kenneth Knowles (Jira)" <ji...@apache.org> on 2020/04/17 18:13:00 UTC
[jira] [Updated] (BEAM-9776) Beam SQL shell doesn't support
creating an external table pointing to GCS, i.e., "gs://..."
[ https://issues.apache.org/jira/browse/BEAM-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kenneth Knowles updated BEAM-9776:
----------------------------------
Priority: Major (was: Minor)
> Beam SQL shell doesn't support creating an external table pointing to GCS, i.e., "gs://..."
> -------------------------------------------------------------------------------------------
>
> Key: BEAM-9776
> URL: https://issues.apache.org/jira/browse/BEAM-9776
> Project: Beam
> Issue Type: Bug
> Components: dsl-sql
> Reporter: David Sabater
> Assignee: David Sabater
> Priority: Major
>
> We are getting the below exception when creating an [external table|[https://beam.apache.org/documentation/dsls/sql/extensions/create-external-table/#text]] pointing to GCS from the [Beam SQL shell|[https://beam.apache.org/documentation/dsls/sql/shell/]]:
> Caused by: java.lang.IllegalArgumentException: No filesystem found for scheme gs
> It appears the interface [FileSystemRegistrar|[https://beam.apache.org/releases/javadoc/2.19.0/index.html?org/apache/beam/sdk/io/FileSystemRegistrar.html]] is not called before Calcite checks the contents of the file from the method:
> org.apache.beam.sdk.extensions.sql.impl.BeamCalciteTable.getStatistic
> Hence getting the exception as the GCS filesystem registrar is not initialised as part of the pipeline creation.
> We should change the logic to create the pipeline and being able to register GCS before making these calls to validate the SQL statements.
>
> Kind regards.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)