You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Vikram Bohra (Jira)" <ji...@apache.org> on 2020/06/03 19:59:00 UTC

[jira] [Created] (GOBBLIN-1180) Remove dependency on gobblin-parquet

Vikram Bohra created GOBBLIN-1180:
-------------------------------------

             Summary: Remove dependency on gobblin-parquet
                 Key: GOBBLIN-1180
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1180
             Project: Apache Gobblin
          Issue Type: Improvement
            Reporter: Vikram Bohra


gobblin-parquet has dependencies on com.twitter  parquet libraries.

'com.twitter:parquet-protobuf:1.5.0' (including higher versions) is not resolvable from MavenCentral because it's missing some of its transitive dependencies. This makes the 'gobblin-parquet' module _also not resolvable_ from MavenCentral (e.g. 'org.apache.gobblin:gobblin-parquet:0.14.0' does not resolve from Central as of today).

To fix this, I suggest using "gobblin-parquet-apache" (which has org.apache parquet libraries) instead of "gobblin-parquet" 

This also unblocks automated consumption of gobblin external artifact at LinkedIn

After this change, gobblin-parquet module can safely be removed.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)