You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zeppelin.apache.org by "Prasad Wagle (JIRA)" <ji...@apache.org> on 2016/06/07 17:42:21 UTC
[jira] [Created] (ZEPPELIN-972) Remove scalding profile and include
it in the module list
Prasad Wagle created ZEPPELIN-972:
-------------------------------------
Summary: Remove scalding profile and include it in the module list
Key: ZEPPELIN-972
URL: https://issues.apache.org/jira/browse/ZEPPELIN-972
Project: Zeppelin
Issue Type: Task
Reporter: Prasad Wagle
Assignee: Prasad Wagle
Priority: Minor
From the comment in https://github.com/apache/incubator-zeppelin/pull/917
Remove scalding profile and includes in the module list result release script creates a binary package with scalding interpreter included. Therefore, we need to take care few more things for binary package release.
One thing is Zeppelin want to avoid build binary package for release with 3rd party repository but scalding interpreter needs two 3rd party repositories (conjars.org/repo, maven.twttr.com).
Another thing updating LICENSE for binary package, while scalding interpreter brings new dependency libraries into binary package. mvn -DskipTests -pl 'zeppelin-interpreter,scalding' package dependency:tree will give detailed list of dependencies (and transitive dependency).
Here's partial list of dependencies of scalding interpreter.
[INFO] +- com.twitter:scalding-core_2.11:jar:0.16.1-RC1:compile
[INFO] | +- com.twitter:scalding-serialization_2.11:jar:0.16.1-RC1:compile
[INFO] | +- com.twitter:maple:jar:0.16.1-RC1:compile
[INFO] | +- cascading:cascading-core:jar:2.6.1:compile
[INFO] | | +- riffle:riffle:jar:0.1-dev:compile
[INFO] | | +- thirdparty:jgrapht-jdk1.6:jar:0.8.1:compile
[INFO] | | \- org.codehaus.janino:janino:jar:2.7.5:compile
[INFO] | | \- org.codehaus.janino:commons-compiler:jar:2.7.5:compile
[INFO] | +- cascading:cascading-hadoop:jar:2.6.1:compile
[INFO] | +- cascading:cascading-local:jar:2.6.1:compile
[INFO] | | \- com.google.guava:guava:jar:15.0:compile
[INFO] | +- com.twitter:chill-hadoop:jar:0.7.3:compile
[INFO] | | \- com.esotericsoftware.kryo:kryo:jar:2.21:compile
[INFO] | | +- com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07:compile
[INFO] | | | \- org.ow2.asm:asm:jar:4.0:compile
[INFO] | | +- com.esotericsoftware.minlog:minlog:jar:1.2:compile
[INFO] | | \- org.objenesis:objenesis:jar:1.2:compile
[INFO] | +- com.twitter:chill-java:jar:0.7.3:compile
[INFO] | +- com.twitter:chill-bijection_2.11:jar:0.7.3:compile
[INFO] | +- com.twitter:algebird-core_2.11:jar:0.12.0:compile
[INFO] | | \- com.googlecode.javaewah:JavaEWAH:jar:0.6.6:compile
[INFO] | +- com.twitter:bijection-core_2.11:jar:0.9.1:compile
[INFO] | +- com.twitter:bijection-macros_2.11:jar:0.9.1:compile
[INFO] | +- com.twitter:chill_2.11:jar:0.7.3:compile
[INFO] | \- com.twitter:chill-algebird_2.11:jar:0.7.3:compile
[INFO] +- com.twitter:scalding-args_2.11:jar:0.16.1-RC1:compile
[INFO] +- com.twitter:scalding-date_2.11:jar:0.16.1-RC1:compile
[INFO] +- com.twitter:scalding-commons_2.11:jar:0.16.1-RC1:compile
[INFO] | +- com.google.protobuf:protobuf-java:jar:2.4.1:compile
[INFO] | +- com.twitter.elephantbird:elephant-bird-cascading2:jar:4.8:compile
[INFO] | +- com.twitter.elephantbird:elephant-bird-core:jar:4.8:compile
[INFO] | | +- com.twitter.elephantbird:elephant-bird-hadoop-compat:jar:4.8:compile
[INFO] | | \- com.googlecode.json-simple:json-simple:jar:1.1:compile
[INFO] | \- com.hadoop.gplcompression:hadoop-lzo:jar:0.4.19:compile
[INFO] | \- commons-logging:commons-logging:jar:1.1.1:compile
[INFO] +- com.twitter:scalding-avro_2.11:jar:0.16.1-RC1:compile
[INFO] | +- cascading.avro:avro-scheme:jar:2.1.2:compile
[INFO] | | +- org.apache.avro:avro-mapred:jar:1.7.4:compile
[INFO] | | | +- org.apache.avro:avro-ipc:jar:1.7.4:compile
[INFO] | | | | +- org.mortbay.jetty:jetty:jar:6.1.26:compile
[INFO] | | | | +- org.apache.velocity:velocity:jar:1.7:compile
[INFO] | | | | \- org.mortbay.jetty:servlet-api:jar:2.5-20081211:compile
[INFO] | | | \- org.apache.avro:avro-ipc:jar:tests:1.7.4:compile
[INFO] | | \- cascading:cascading-xml:jar:2.1.6:compile
[INFO] | | \- org.ccil.cowan.tagsoup:tagsoup:jar:1.2:compile
[INFO] | \- org.apache.avro:avro:jar:1.7.4:compile
[INFO] | +- org.codehaus.jackson:jackson-core-asl:jar:1.8.8:compile
[INFO] | +- org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8:compile
[INFO] | +- com.thoughtworks.paranamer:paranamer:jar:2.3:compile
[INFO] | +- org.xerial.snappy:snappy-java:jar:1.0.4.1:compile
[INFO] | \- org.apache.commons:commons-compress:jar:1.4.1:compile
[INFO] | \- org.tukaani:xz:jar:1.0:compile
[INFO] +- com.twitter:scalding-parquet_2.11:jar:0.16.1-RC1:compile
[INFO] | +- org.apache.parquet:parquet-column:jar:1.8.1:compile
[INFO] | | +- org.apache.parquet:parquet-common:jar:1.8.1:compile
[INFO] | | +- org.apache.parquet:parquet-encoding:jar:1.8.1:compile
[INFO] | | \- commons-codec:commons-codec:jar:1.5:compile
[INFO] | +- org.apache.parquet:parquet-hadoop:jar:1.8.1:compile
[INFO] | | +- org.apache.parquet:parquet-format:jar:2.3.0-incubating:compile
[INFO] | | \- org.apache.parquet:parquet-jackson:jar:1.8.1:compile
[INFO] | \- org.apache.parquet:parquet-thrift:jar:1.8.1:compile
[INFO] +- com.twitter:scalding-repl_2.11:jar:0.16.1-RC1:compile
[INFO] | \- jline:jline:jar:2.11:compile
[INFO] +- org.scala-lang:scala-library:jar:2.11.8:compile
[INFO] +- org.scala-lang:scala-compiler:jar:2.11.8:compile
[INFO] | +- org.scala-lang.modules:scala-xml_2.11:jar:1.0.4:compile
[INFO] | \- org.scala-lang.modules:scala-parser-combinators_2.11:jar:1.0.4:compile
[INFO] +- org.scala-lang:scala-reflect:jar:2.11.8:compile
They need to be addressed in zeppelin-distribution/src/bin_license/LICENSE file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)