You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2019/01/16 18:32:17 UTC

[GitHub] drcrallen edited a comment on issue #6814: [Discuss] Replacing hyperUnique as 'default' distinct count sketch

drcrallen edited a comment on issue #6814: [Discuss] Replacing hyperUnique as 'default' distinct count sketch
URL: https://github.com/apache/incubator-druid/issues/6814#issuecomment-454888977
 
 
   *side note*
   
   Dependency wise the extension looks really clean. The only extra it brings in is apache commons math3 and stuff from `com.yahoo.datasketches`.
   
   What is the likelihood `com.yahoo.datasketches` or `org.apache.commons:commons-math3` will have the same kind of problems Jackson or Guava have with version incompatibilities with other big data handling systems (spark, hive, hadoop, flink, etc)?
   
   
   ```
   $ mvn dependency:tree -pl extensions-core/datasketches
   [INFO] Scanning for projects...
   [INFO] 
   [INFO] -----------< org.apache.druid.extensions:druid-datasketches >-----------
   [INFO] Building druid-datasketches 0.13.0-incubating-SNAPSHOT
   [INFO] --------------------------------[ jar ]---------------------------------
   [INFO] 
   [INFO] --- maven-dependency-plugin:2.8:tree (default-cli) @ druid-datasketches ---
   [INFO] org.apache.druid.extensions:druid-datasketches:jar:0.13.0-incubating-SNAPSHOT
   [INFO] +- com.yahoo.datasketches:sketches-core:jar:0.12.0:compile
   [INFO] |  \- com.yahoo.datasketches:memory:jar:0.12.0:compile
   [INFO] +- org.apache.commons:commons-math3:jar:3.6.1:compile
   [INFO] +- org.apache.druid:druid-core:jar:0.13.0-incubating-SNAPSHOT:provided
   [INFO] |  +- commons-codec:commons-codec:jar:1.7:provided
   [INFO] |  +- commons-io:commons-io:jar:2.5:provided
   [INFO] |  +- commons-lang:commons-lang:jar:2.6:provided
   [INFO] |  +- org.apache.commons:commons-compress:jar:1.16:provided
   [INFO] |  +- org.apache.commons:commons-dbcp2:jar:2.0.1:provided
   [INFO] |  |  +- org.apache.commons:commons-pool2:jar:2.2:provided
   [INFO] |  |  \- commons-logging:commons-logging:jar:1.1.1:provided
   [INFO] |  +- commons-pool:commons-pool:jar:1.6:provided
   [INFO] |  +- org.skife.config:config-magic:jar:0.9:provided
   [INFO] |  +- org.hibernate:hibernate-validator:jar:5.1.3.Final:provided
   [INFO] |  |  +- org.jboss.logging:jboss-logging:jar:3.1.3.GA:provided
   [INFO] |  |  \- com.fasterxml:classmate:jar:1.0.0:provided
   [INFO] |  +- javax.el:javax.el-api:jar:3.0.0:provided
   [INFO] |  +- com.google.guava:guava:jar:16.0.1:provided
   [INFO] |  +- com.google.inject:guice:jar:4.1.0:provided
   [INFO] |  |  +- javax.inject:javax.inject:jar:1:provided
   [INFO] |  |  \- aopalliance:aopalliance:jar:1.0:provided
   [INFO] |  +- com.google.inject.extensions:guice-multibindings:jar:4.1.0:provided
   [INFO] |  +- org.jdbi:jdbi:jar:2.63.1:provided
   [INFO] |  +- joda-time:joda-time:jar:2.9.9:provided
   [INFO] |  +- org.apache.logging.log4j:log4j-api:jar:2.5:provided
   [INFO] |  +- org.apache.logging.log4j:log4j-core:jar:2.5:provided
   [INFO] |  +- org.apache.logging.log4j:log4j-slf4j-impl:jar:2.5:provided
   [INFO] |  +- org.apache.logging.log4j:log4j-jul:jar:2.5:provided
   [INFO] |  +- org.apache.logging.log4j:log4j-1.2-api:jar:2.5:provided
   [INFO] |  +- org.slf4j:slf4j-api:jar:1.6.4:compile
   [INFO] |  +- org.slf4j:jcl-over-slf4j:jar:1.7.12:provided
   [INFO] |  +- io.airlift:airline:jar:0.7:provided
   [INFO] |  +- io.dropwizard.metrics:metrics-core:jar:4.0.0:provided
   [INFO] |  +- net.thisptr:jackson-jq:jar:0.0.7:provided
   [INFO] |  |  \- org.jruby.joni:joni:jar:2.1.11:provided
   [INFO] |  |     \- org.jruby.jcodings:jcodings:jar:1.0.13:provided
   [INFO] |  +- it.unimi.dsi:fastutil:jar:8.1.0:provided
   [INFO] |  +- com.opencsv:opencsv:jar:4.2:provided
   [INFO] |  |  +- org.apache.commons:commons-lang3:jar:3.7:provided
   [INFO] |  |  +- org.apache.commons:commons-text:jar:1.3:provided
   [INFO] |  |  +- commons-beanutils:commons-beanutils:jar:1.9.3:provided
   [INFO] |  |  |  \- commons-collections:commons-collections:jar:3.2.2:provided
   [INFO] |  |  \- org.apache.commons:commons-collections4:jar:4.1:provided
   [INFO] |  +- org.mozilla:rhino:jar:1.7R5:provided
   [INFO] |  +- org.tukaani:xz:jar:1.8:provided
   [INFO] |  +- com.github.luben:zstd-jni:jar:1.3.3-1:provided
   [INFO] |  +- com.jayway.jsonpath:json-path:jar:2.3.0:provided
   [INFO] |  |  \- net.minidev:json-smart:jar:2.3:provided
   [INFO] |  |     \- net.minidev:accessors-smart:jar:1.2:provided
   [INFO] |  +- org.antlr:antlr4-runtime:jar:4.5.1:provided
   [INFO] |  +- com.lmax:disruptor:jar:3.3.6:provided
   [INFO] |  +- com.google.code.findbugs:jsr305:jar:2.0.1:provided
   [INFO] |  +- net.java.dev.jna:jna:jar:4.5.1:provided
   [INFO] |  +- javax.validation:validation-api:jar:1.1.0.Final:provided
   [INFO] |  +- org.asynchttpclient:async-http-client:jar:2.5.3:provided
   [INFO] |  |  +- org.asynchttpclient:async-http-client-netty-utils:jar:2.5.3:provided
   [INFO] |  |  |  \- io.netty:netty-buffer:jar:4.1.29.Final:provided
   [INFO] |  |  +- io.netty:netty-codec-http:jar:4.1.29.Final:provided
   [INFO] |  |  |  \- io.netty:netty-codec:jar:4.1.29.Final:provided
   [INFO] |  |  +- io.netty:netty-handler:jar:4.1.29.Final:provided
   [INFO] |  |  |  \- io.netty:netty-transport:jar:4.1.29.Final:provided
   [INFO] |  |  +- io.netty:netty-codec-socks:jar:4.1.29.Final:provided
   [INFO] |  |  +- io.netty:netty-handler-proxy:jar:4.1.29.Final:provided
   [INFO] |  |  +- io.netty:netty-transport-native-epoll:jar:linux-x86_64:4.1.29.Final:provided
   [INFO] |  |  |  +- io.netty:netty-common:jar:4.1.29.Final:provided
   [INFO] |  |  |  \- io.netty:netty-transport-native-unix-common:jar:4.1.29.Final:provided
   [INFO] |  |  +- io.netty:netty-resolver-dns:jar:4.1.29.Final:provided
   [INFO] |  |  |  +- io.netty:netty-resolver:jar:4.1.29.Final:provided
   [INFO] |  |  |  \- io.netty:netty-codec-dns:jar:4.1.29.Final:provided
   [INFO] |  |  +- org.reactivestreams:reactive-streams:jar:1.0.2:provided
   [INFO] |  |  +- com.typesafe.netty:netty-reactive-streams:jar:2.0.0:provided
   [INFO] |  |  \- com.sun.activation:javax.activation:jar:1.2.0:provided
   [INFO] |  +- org.hyperic:sigar:jar:1.6.5.132:provided
   [INFO] |  +- org.gridkit.lab:jvm-attach-api:jar:1.2:provided
   [INFO] |  \- io.netty:netty:jar:3.10.6.Final:provided
   [INFO] +- org.apache.druid:druid-processing:jar:0.13.0-incubating-SNAPSHOT:provided
   [INFO] |  +- org.apache.druid:druid-hll:jar:0.13.0-incubating-SNAPSHOT:provided
   [INFO] |  +- org.apache.druid:extendedset:jar:0.13.0-incubating-SNAPSHOT:provided
   [INFO] |  +- org.roaringbitmap:RoaringBitmap:jar:0.7.36:provided
   [INFO] |  |  \- org.roaringbitmap:shims:jar:0.7.36:provided
   [INFO] |  +- com.ning:compress-lzf:jar:1.0.4:provided
   [INFO] |  +- com.google.errorprone:error_prone_annotations:jar:2.3.2:provided
   [INFO] |  +- com.ibm.icu:icu4j:jar:54.1.1:provided
   [INFO] |  +- org.lz4:lz4-java:jar:1.5.0:provided
   [INFO] |  +- org.mapdb:mapdb:jar:1.0.8:provided
   [INFO] |  +- org.ow2.asm:asm:jar:5.2:provided
   [INFO] |  +- org.ow2.asm:asm-commons:jar:5.2:provided
   [INFO] |  |  \- org.ow2.asm:asm-tree:jar:5.2:provided
   [INFO] |  +- org.checkerframework:checker:jar:2.5.7:provided
   [INFO] |  \- org.apache.maven:maven-artifact:jar:3.6.0:provided
   [INFO] |     \- org.codehaus.plexus:plexus-utils:jar:3.0.15:provided
   [INFO] +- com.fasterxml.jackson.core:jackson-annotations:jar:2.6.7:provided
   [INFO] +- com.fasterxml.jackson.core:jackson-core:jar:2.6.7:provided
   [INFO] +- com.fasterxml.jackson.core:jackson-databind:jar:2.6.7:provided
   [INFO] +- com.fasterxml.jackson.datatype:jackson-datatype-guava:jar:2.6.7:provided
   [INFO] +- com.fasterxml.jackson.datatype:jackson-datatype-joda:jar:2.6.7:provided
   [INFO] +- com.fasterxml.jackson.dataformat:jackson-dataformat-smile:jar:2.6.7:provided
   [INFO] +- com.fasterxml.jackson.jaxrs:jackson-jaxrs-json-provider:jar:2.6.7:provided
   [INFO] |  +- com.fasterxml.jackson.jaxrs:jackson-jaxrs-base:jar:2.6.7:provided
   [INFO] |  \- com.fasterxml.jackson.module:jackson-module-jaxb-annotations:jar:2.6.7:provided
   [INFO] +- com.fasterxml.jackson.jaxrs:jackson-jaxrs-smile-provider:jar:2.6.7:provided
   [INFO] +- junit:junit:jar:4.12:test
   [INFO] |  \- org.hamcrest:hamcrest-core:jar:1.3:test
   [INFO] +- org.easymock:easymock:jar:3.4:test
   [INFO] |  \- org.objenesis:objenesis:jar:2.2:provided
   [INFO] +- org.apache.druid:druid-core:test-jar:tests:0.13.0-incubating-SNAPSHOT:test
   [INFO] \- org.apache.druid:druid-processing:test-jar:tests:0.13.0-incubating-SNAPSHOT:test
   [INFO] ------------------------------------------------------------------------
   [INFO] BUILD SUCCESS
   [INFO] ------------------------------------------------------------------------
   [INFO] Total time:  2.167 s
   [INFO] Finished at: 2019-01-16T10:29:03-08:00
   [INFO] ------------------------------------------------------------------------
   
   ```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org