You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2020/08/18 23:12:00 UTC
[GitHub] [druid] mounikanakkala opened a new issue #10297: Reindexing of One Datasource using another Input Datasource gives 0 Hyperloglog values
mounikanakkala opened a new issue #10297:
URL: https://github.com/apache/druid/issues/10297
I am facing an issue with reindexing a datasource (which involves HLL Metrics using Datasketches HLLSketch) using another datasource.
Original_Datasource - Dimensions D1,D2,D3,D4. Metrics - M1, M2, M3, M4
Cardinality_Datasource - Dimensions D1, D2. Metrics - D3Cardinality, D4Cardinality using HLLSketch. (I want to maintain cardinality of dimensions D3 and D4 for each combination of D1 and D2).
I want to reindex Cardinality_Datasource using Original_Datasource, using the following spec
`{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "Cardinality_Datasource",
"timestampSpec": {
"column": "_time",
"format": "auto"
},
"dimensionsSpec": {
"dimensions": [
"D1",
"D2"
]
},
"metricsSpec": [
{
"name": "D3Cardinality",
"type": "HLLSketchBuild",
"fieldName": "D3"
},
{
"name": "D4Cardinality",
"type": "HLLSketchBuild",
"fieldName": "D4"
}
],
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "hour",
"queryGranularity": "hour"
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "druid",
"dataSource" : "Original_Datasource",
"interval": "2020-08-11T00/2020-08-11T01"
}
},
"tuningConfig": {
"type": "index_parallel",
"maxNumConcurrentSubTasks": 3
}
}
}`
With this specification, I can see D1 and D2 dimensions in Cardinality_Datasource table but D3Cardinality and D4Cardinality values are all 0. Can someone please help me with this issue?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] mounikanakkala commented on issue #10297: Reindexing of One Datasource using another Input Datasource gives 0 Hyperloglog values
Posted by GitBox <gi...@apache.org>.
mounikanakkala commented on issue #10297:
URL: https://github.com/apache/druid/issues/10297#issuecomment-737285076
May I know if anyone can help me on this issue?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] mounikanakkala closed issue #10297: Reindexing of One Datasource using another Input Datasource gives 0 Hyperloglog values
Posted by GitBox <gi...@apache.org>.
mounikanakkala closed issue #10297:
URL: https://github.com/apache/druid/issues/10297
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] mounikanakkala commented on issue #10297: Reindexing of One Datasource using another Input Datasource gives 0 Hyperloglog values
Posted by GitBox <gi...@apache.org>.
mounikanakkala commented on issue #10297:
URL: https://github.com/apache/druid/issues/10297#issuecomment-788649551
Thank you for sharing the link. That helped!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] abhishekagarwal87 commented on issue #10297: Reindexing of One Datasource using another Input Datasource gives 0 Hyperloglog values
Posted by GitBox <gi...@apache.org>.
abhishekagarwal87 commented on issue #10297:
URL: https://github.com/apache/druid/issues/10297#issuecomment-737297206
You may be running into https://github.com/apache/druid/issues/9914
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org