You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2019/07/16 12:30:26 UTC

[GitHub] [incubator-druid] JackyYangPassion edited a comment on issue #7594: [for master] general exactly count distinct support in Druid

JackyYangPassion edited a comment on issue #7594: [for master] general exactly count distinct support in Druid
URL: https://github.com/apache/incubator-druid/pull/7594#issuecomment-511795351
 
 
   when i use quickstart example wikiticker-2015-09-12-sampled.json with unique user:
   ### record:
   `{"time":"2015-09-12T00:47:44.963Z","channel":"#ru.wikipedia","cityName":null,"comment":"/* Донецкая Народная Республика */","countryIsoCode":null,"countryName":null,"isAnonymous":false,"isMinor":false,"isNew":false,"isRobot":false,"isUnpatrolled":false,"metroCode":null,"namespace":"Main","page":"Караман, Александр Акимович","regionIsoCode":null,"regionName":null,"user":"Камарад Че","delta":0,"added":0,"deleted":0}`
   
   ### Error:
   `java.lang.Exception: io.druid.java.util.common.RE: Failure on row[{"time":"2015-09-12T00:47:44.963Z","channel":"#ru.wikipedia","cityName":null,"comment":"/* Донецкая Народная Республика */","countryIsoCode":null,"countryName":null,"isAnonymous":false,"isMinor":false,"isNew":false,"isRobot":false,"isUnpatrolled":false,"metroCode":null,"namespace":"Main","page":"Караман, Александр Акимович","regionIsoCode":null,"regionName":null,"user":"Камарад Че","delta":0,"added":0,"deleted":0}]
   	at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462) ~[hadoop-mapreduce-client-common-2.7.3.jar:?]
   	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522) [hadoop-mapreduce-client-common-2.7.3.jar:?]
   Caused by: io.druid.java.util.common.RE: Failure on row[{"time":"2015-09-12T00:47:44.963Z","channel":"#ru.wikipedia","cityName":null,"comment":"/* Донецкая Народная Республика */","countryIsoCode":null,"countryName":null,"isAnonymous":false,"isMinor":false,"isNew":false,"isRobot":false,"isUnpatrolled":false,"metroCode":null,"namespace":"Main","page":"Караман, Александр Акимович","regionIsoCode":null,"regionName":null,"user":"Камарад Че","delta":0,"added":0,"deleted":0}]
   	at io.druid.indexer.HadoopDruidIndexerMapper.map(HadoopDruidIndexerMapper.java:93) ~[druid-indexing-hadoop-0.12.4-SNAPSHOT.jar:0.12.4-SNAPSHOT]
   	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) ~[hadoop-mapreduce-client-core-2.7.3.jar:?]
   	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787) ~[hadoop-mapreduce-client-core-2.7.3.jar:?]
   	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) ~[hadoop-mapreduce-client-core-2.7.3.jar:?]
   	at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243) ~[hadoop-mapreduce-client-common-2.7.3.jar:?]
   	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_171]
   	at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_171]
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_171]
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_171]
   	at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_171]
   Caused by: java.lang.IllegalArgumentException: Value : Камарад Че not exists
   	at org.apache.kylin.common.util.Dictionary.getIdFromValue(Dictionary.java:107) ~[kylin-core-common-2.5.2.jar:2.5.2]
   	at org.apache.kylin.common.util.Dictionary.getIdFromValue(Dictionary.java:85) ~[kylin-core-common-2.5.2.jar:2.5.2]
   	at io.druid.segment.incremental.IncrementalIndex$1InputRowDictWrap.getDimension(IncrementalIndex.java:180) ~[druid-processing-0.12.4-SNAPSHOT.jar:0.12.4-SNAPSHOT]
   	at io.druid.query.aggregation.unique.RoaringBitmapComplexMetricSerde$1.extractValue(RoaringBitmapComplexMetricSerde.java:70) ~[druid-uniq-0.12.4-SNAPSHOT.jar:0.12.4-SNAPSHOT]
   	at io.druid.query.aggregation.unique.RoaringBitmapComplexMetricSerde$1.extractValue(RoaringBitmapComplexMetricSerde.java:52) ~[druid-uniq-0.12.4-SNAPSHOT.jar:0.12.4-SNAPSHOT]
   	at io.druid.segment.incremental.IncrementalIndex$1IncrementalIndexInputRowColumnSelectorFactory$1.getObject(IncrementalIndex.java:264) ~[druid-processing-0.12.4-SNAPSHOT.jar:0.12.4-SNAPSHOT]
   	at io.druid.query.aggregation.unique.UniqueBuildAggregator.aggregate(UniqueBuildAggregator.java:53) ~[druid-uniq-0.12.4-SNAPSHOT.jar:0.12.4-SNAPSHOT]
   	at io.druid.indexer.InputRowSerde.toBytes(InputRowSerde.java:281) ~[druid-indexing-hadoop-0.12.4-SNAPSHOT.jar:0.12.4-SNAPSHOT]
   	at io.druid.indexer.IndexGeneratorJob$IndexGeneratorMapper.innerMap(IndexGeneratorJob.java:371) ~[druid-indexing-hadoop-0.12.4-SNAPSHOT.jar:0.12.4-SNAPSHOT]
   	at io.druid.indexer.HadoopDruidIndexerMapper.map(HadoopDruidIndexerMapper.java:88) ~[druid-indexing-hadoop-0.12.4-SNAPSHOT.jar:0.12.4-SNAPSHOT]
   	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) ~[hadoop-mapreduce-client-core-2.7.3.jar:?]
   	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787) ~[hadoop-mapreduce-client-core-2.7.3.jar:?]
   	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) ~[hadoop-mapreduce-client-core-2.7.3.jar:?]
   	at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243) ~[hadoop-mapreduce-client-common-2.7.3.jar:?]
   	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_171]
   	at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_171]
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_171]
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_171]
   	at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_171]
   2019-07-16T12:19:08,346 INFO [task-runner-0-priority-0] org.apac`

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org