[jira] [Created] (FLINK-24057) Flink SQL client Hadoop is not in the classpath/dependencies error even thugh Hadoop S3 File system plugin was added

["James Kim (Jira)" <ji...@apache.org>]

James Kim created FLINK-24057:
---------------------------------

             Summary: Flink SQL client Hadoop is not in the classpath/dependencies error even thugh Hadoop S3 File system plugin was added
                 Key: FLINK-24057
                 URL: https://issues.apache.org/jira/browse/FLINK-24057
             Project: Flink
          Issue Type: Bug
          Components: Table SQL / API, Table SQL / Client
    Affects Versions: 1.13.2
         Environment: VirtualBox Ubuntu 18.03 
            Reporter: James Kim


I'm trying use a CSV file on an S3 compliant object store and query through Flink SQL client.

As docs (https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/deployment/filesystems/s3/#hadooppresto-s3-file-systems-plugins) have stated, I have added the s3.access-key, s3.secret-key, s3.endpoint, and s3.path.style.access to flink-conf.yaml.

 

However, when I ran Flink SQL, created a table with  connector as filesystem, path as the s3a path and format as csv.

 

However, when I run select * on the table, it hangs for couple minutes so I checked the logs and it gives me "INFO org.apache.flink.core.fs.FileSystem [] - Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available". This should have been taken care of according to the docs by adding the Hadoop S3 File System plugins, however, it does not work as expected.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)