You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2020/05/04 12:05:25 UTC
[GitHub] [druid] sixtus opened a new issue #9820: "taskLockHelper is not initialized yet"
sixtus opened a new issue #9820:
URL: https://github.com/apache/druid/issues/9820
I am running `index_parallel` tasks on the experimental druid indexer.
They fail immediately with the error message above.
### Affected Version
Druid 0.18 (0.17 was fine)
### Description
This seems to be independent of cluster size.
Based on the stack trace I tried this patch: https://github.com/liquidm/druid/commit/a815e3571f17ce31f62f47529e4258bfe8c52f8a
But it didn't help. So I tried this one:
https://github.com/liquidm/druid/commit/ef1cfc696105c813fba900ef137ba9a3194d4466
which likely is not in the spirit of the assertion, but it all started working again.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] vikramsinghchandel commented on issue #9820: "taskLockHelper is not initialized yet"
Posted by GitBox <gi...@apache.org>.
vikramsinghchandel commented on issue #9820:
URL: https://github.com/apache/druid/issues/9820#issuecomment-663476911
@jihoonson creted a ticket with all the details.
https://github.com/apache/druid/issues/10210
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] vikramsinghchandel commented on issue #9820: "taskLockHelper is not initialized yet"
Posted by GitBox <gi...@apache.org>.
vikramsinghchandel commented on issue #9820:
URL: https://github.com/apache/druid/issues/9820#issuecomment-661907766
Same issue here. index_parallel with dynamic partitioning seeing this issue. With hashed partitioning strategy works file.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] guptha308 commented on issue #9820: "taskLockHelper is not initialized yet"
Posted by GitBox <gi...@apache.org>.
guptha308 commented on issue #9820:
URL: https://github.com/apache/druid/issues/9820#issuecomment-787893874
Using .20.1. Facing issue while using index_parallel tasks.
Any workaround for this.
{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "aws",
"timestampSpec": {
"column": "epoch_time",
"format": "iso",
"missingValue": null
},
"dimensionsSpec": {
"dimensions": [
"events"
{
"type": "string",
"name": "event_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "event_section",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
]
},
"metricsSpec": [
{
"type": "count",
"name": "count"
}
]
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "s3",
"prefixes" : [
"s3://andromeda"
]
},
"inputFormat": {
"type": "orc",
"flattenSpec": {
"useFieldDiscovery": true,
"fields": []
}
},
"appendToExisting": true
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 1000000,
"maxBytesInMemory": 0,
"maxTotalRows": null,
"numShards": null,
"splitHintSpec": null,
"partitionsSpec": {
"type": "dynamic",
"maxRowsPerSegment": 5000000,
"maxTotalRows": null
},
"indexSpec": {
"bitmap": {
"type": "roaring",
"compressRunOnSerialization": true
},
"dimensionCompression": "lz4",
"metricCompression": "lz4",
"longEncoding": "longs",
"segmentLoader": null
},
"indexSpecForIntermediatePersists": {
"bitmap": {
"type": "roaring",
"compressRunOnSerialization": true
},
"dimensionCompression": "lz4",
"metricCompression": "lz4",
"longEncoding": "longs",
"segmentLoader": null
},
"maxPendingPersists": 0,
"forceGuaranteedRollup": false,
"reportParseExceptions": false,
"pushTimeout": 0,
"segmentWriteOutMediumFactory": null,
"maxNumConcurrentSubTasks": 5,
"maxRetry": 3,
"taskStatusCheckPeriodMs": 1000,
"chatHandlerTimeout": "PT10S",
"chatHandlerNumRetries": 5,
"maxNumSegmentsToMerge": 100,
"totalNumMergeTasks": 10,
"logParseExceptions": false,
"maxParseExceptions": 2147483647,
"maxSavedParseExceptions": 0,
"buildV9Directly": true,
"partitionDimensions": []
}
}
}
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] vikramsinghchandel edited a comment on issue #9820: "taskLockHelper is not initialized yet"
Posted by GitBox <gi...@apache.org>.
vikramsinghchandel edited a comment on issue #9820:
URL: https://github.com/apache/druid/issues/9820#issuecomment-661907766
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] cloventt edited a comment on issue #9820: "taskLockHelper is not initialized yet"
Posted by GitBox <gi...@apache.org>.
cloventt edited a comment on issue #9820:
URL: https://github.com/apache/druid/issues/9820#issuecomment-687969450
We see this same issue using `index` tasks that are appending to an existing interval, on indexers with Druid 0.18.1.
```java
2020-09-07 01:16:43,897 ERROR [[index_ssp-hour_jjejaoee_2020-09-07T01:16:43.738Z]-threading-task-runner-executor-4] logger.Logger (Logger.java:226) - Encountered exception in BUILD_SEGMENTS.
java.lang.NullPointerException: taskLockHelper is not initialized yet
at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:229) ~[guava-16.0.1.jar:?]
at org.apache.druid.indexing.common.task.AbstractBatchIndexTask.getTaskLockHelper(AbstractBatchIndexTask.java:184) ~[druid-indexing-service-0.18.1.jar:0.18.1]
at org.apache.druid.indexing.common.task.IndexTask.generateAndPublishSegments(IndexTask.java:905) ~[druid-indexing-service-0.18.1.jar:0.18.1]
at org.apache.druid.indexing.common.task.IndexTask.runTask(IndexTask.java:526) [druid-indexing-service-0.18.1.jar:0.18.1]
at org.apache.druid.indexing.common.task.AbstractBatchIndexTask.run(AbstractBatchIndexTask.java:123) [druid-indexing-service-0.18.1.jar:0.18.1]
at org.apache.druid.indexing.overlord.ThreadingTaskRunner$1.call(ThreadingTaskRunner.java:209) [druid-indexing-service-0.18.1.jar:0.18.1]
at org.apache.druid.indexing.overlord.ThreadingTaskRunner$1.call(ThreadingTaskRunner.java:149) [druid-indexing-service-0.18.1.jar:0.18.1]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_265]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_265]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_265]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_265]
```
Our ingestion spec:
```json
{
"type": "index",
"spec": {
"dataSchema": {
"dataSource": "datasource",
"parser": {
"type": "string",
"parseSpec": {
"format": "json",
"timestampSpec": {
"column": "timestamp",
"format": "iso"
},
"dimensionsSpec": {
"dimensions": ["redacted" ]
}
}
},
"metricsSpec": ["redacted"],
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "hour",
"queryGranularity": "hour",
"rollup": true,
"intervals": [
"2020-09-07T00:00Z/2020-09-07T01:00Z"
]
}
},
"tuningConfig": {
"type": "index",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 100000
},
"ioConfig": {
"type": "index",
"appendToExisting": true,
"firehose": {
"type": "static-s3",
"fetchTimeout": 180000,
"maxFetchRetry": 5,
"prefixes": [
"s3://path-to-files"
]
}
}
},
"context": {
"forceTimeChunkLock": false
}
}
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] sixtus commented on issue #9820: "taskLockHelper is not initialized yet"
Posted by GitBox <gi...@apache.org>.
sixtus commented on issue #9820:
URL: https://github.com/apache/druid/issues/9820#issuecomment-629231647
> Facing the same issue even with a native index (non-parallel) task.
on expérimental indexer or middle manager?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] jihoonson closed issue #9820: "taskLockHelper is not initialized yet"
Posted by GitBox <gi...@apache.org>.
jihoonson closed issue #9820:
URL: https://github.com/apache/druid/issues/9820
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] guptha308 edited a comment on issue #9820: "taskLockHelper is not initialized yet"
Posted by GitBox <gi...@apache.org>.
guptha308 edited a comment on issue #9820:
URL: https://github.com/apache/druid/issues/9820#issuecomment-787893874
Using .20.1. Facing issue while using index_parallel tasks.
Any workaround for this.
`{
"type": "index_parallel",
"spec": {
"dataSchema": {
"dataSource": "aws",
"timestampSpec": {
"column": "epoch_time",
"format": "iso",
"missingValue": null
},
"dimensionsSpec": {
"dimensions": [
"events"
{
"type": "string",
"name": "event_name",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
},
{
"type": "string",
"name": "event_section",
"multiValueHandling": "SORTED_ARRAY",
"createBitmapIndex": true
}
]
},
"metricsSpec": [
{
"type": "count",
"name": "count"
}
]
}
},
"ioConfig": {
"type": "index_parallel",
"inputSource": {
"type": "s3",
"prefixes" : [
"s3://andromeda"
]
},
"inputFormat": {
"type": "orc",
"flattenSpec": {
"useFieldDiscovery": true,
"fields": []
}
},
"appendToExisting": true
},
"tuningConfig": {
"type": "index_parallel",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 1000000,
"maxBytesInMemory": 0,
"maxTotalRows": null,
"numShards": null,
"splitHintSpec": null,
"partitionsSpec": {
"type": "dynamic",
"maxRowsPerSegment": 5000000,
"maxTotalRows": null
},
"indexSpec": {
"bitmap": {
"type": "roaring",
"compressRunOnSerialization": true
},
"dimensionCompression": "lz4",
"metricCompression": "lz4",
"longEncoding": "longs",
"segmentLoader": null
},
"indexSpecForIntermediatePersists": {
"bitmap": {
"type": "roaring",
"compressRunOnSerialization": true
},
"dimensionCompression": "lz4",
"metricCompression": "lz4",
"longEncoding": "longs",
"segmentLoader": null
},
"maxPendingPersists": 0,
"forceGuaranteedRollup": false,
"reportParseExceptions": false,
"pushTimeout": 0,
"segmentWriteOutMediumFactory": null,
"maxNumConcurrentSubTasks": 5,
"maxRetry": 3,
"taskStatusCheckPeriodMs": 1000,
"chatHandlerTimeout": "PT10S",
"chatHandlerNumRetries": 5,
"maxNumSegmentsToMerge": 100,
"totalNumMergeTasks": 10,
"logParseExceptions": false,
"maxParseExceptions": 2147483647,
"maxSavedParseExceptions": 0,
"buildV9Directly": true,
"partitionDimensions": []
}
}
}`
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] jihoonson commented on issue #9820: "taskLockHelper is not initialized yet"
Posted by GitBox <gi...@apache.org>.
jihoonson commented on issue #9820:
URL: https://github.com/apache/druid/issues/9820#issuecomment-662626582
> I already have set intervals in granularitySpec
@vikramsinghchandel Hmm, OK. Let me dig into this more.
> Let me know if you need detailed numbers for infra and ingestion, can create a separate ticket with the details.
That would be great! Could you open a new issue about performance? And could you share the tuningConfigs of hadoop and native tasks as well as the cluster setup above if possible?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] cloventt commented on issue #9820: "taskLockHelper is not initialized yet"
Posted by GitBox <gi...@apache.org>.
cloventt commented on issue #9820:
URL: https://github.com/apache/druid/issues/9820#issuecomment-687969450
We see this same issue using `index` tasks that are appending to an existing interval, on indexers with Druid 0.18.1.
```2020-09-07 01:16:43,897 ERROR [[index_ssp-hour_jjejaoee_2020-09-07T01:16:43.738Z]-threading-task-runner-executor-4] logger.Logger (Logger.java:226) - Encountered exception in BUILD_SEGMENTS.
java.lang.NullPointerException: taskLockHelper is not initialized yet
at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:229) ~[guava-16.0.1.jar:?]
at org.apache.druid.indexing.common.task.AbstractBatchIndexTask.getTaskLockHelper(AbstractBatchIndexTask.java:184) ~[druid-indexing-service-0.18.1.jar:0.18.1]
at org.apache.druid.indexing.common.task.IndexTask.generateAndPublishSegments(IndexTask.java:905) ~[druid-indexing-service-0.18.1.jar:0.18.1]
at org.apache.druid.indexing.common.task.IndexTask.runTask(IndexTask.java:526) [druid-indexing-service-0.18.1.jar:0.18.1]
at org.apache.druid.indexing.common.task.AbstractBatchIndexTask.run(AbstractBatchIndexTask.java:123) [druid-indexing-service-0.18.1.jar:0.18.1]
at org.apache.druid.indexing.overlord.ThreadingTaskRunner$1.call(ThreadingTaskRunner.java:209) [druid-indexing-service-0.18.1.jar:0.18.1]
at org.apache.druid.indexing.overlord.ThreadingTaskRunner$1.call(ThreadingTaskRunner.java:149) [druid-indexing-service-0.18.1.jar:0.18.1]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_265]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_265]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_265]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_265]
```
Our ingestion spec:
```json
{
"type": "index",
"spec": {
"dataSchema": {
"dataSource": "datasource",
"parser": {
"type": "string",
"parseSpec": {
"format": "json",
"timestampSpec": {
"column": "timestamp",
"format": "iso"
},
"dimensionsSpec": {
"dimensions": ["redacted" ]
}
}
},
"metricsSpec": ["redacted"],
"granularitySpec": {
"type": "uniform",
"segmentGranularity": "hour",
"queryGranularity": "hour",
"rollup": true,
"intervals": [
"2020-09-07T00:00Z/2020-09-07T01:00Z"
]
}
},
"tuningConfig": {
"type": "index",
"maxRowsPerSegment": 5000000,
"maxRowsInMemory": 100000
},
"ioConfig": {
"type": "index",
"appendToExisting": true,
"firehose": {
"type": "static-s3",
"fetchTimeout": 180000,
"maxFetchRetry": 5,
"prefixes": [
"s3://path-to-files"
]
}
}
},
"context": {
"forceTimeChunkLock": false
}
}```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] jihoonson commented on issue #9820: "taskLockHelper is not initialized yet"
Posted by GitBox <gi...@apache.org>.
jihoonson commented on issue #9820:
URL: https://github.com/apache/druid/issues/9820#issuecomment-661983517
Hi @vikramsinghchandel, I bet you can workaround this bug by setting `intervals` in the granularitySpec. Can you try with explicit intervals?
> @sixtus were you able to find any solution/workaround. With hashed partitioner & forcedGranularityRollUp the performance of indexing is very bad almost twice as bad compared to EMR based indexing
BTW, this is interesting. Was the setup exactly same for both ingestion methods? Could you share how they are different in what setup if possible?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] vikramsinghchandel commented on issue #9820: "taskLockHelper is not initialized yet"
Posted by GitBox <gi...@apache.org>.
vikramsinghchandel commented on issue #9820:
URL: https://github.com/apache/druid/issues/9820#issuecomment-662016019
> Hi @vikramsinghchandel, I bet you can workaround this bug by setting `intervals` in the granularitySpec. Can you try with explicit intervals?
>
> > @sixtus were you able to find any solution/workaround. With hashed partitioner & forcedGranularityRollUp the performance of indexing is very bad almost twice as bad compared to EMR based indexing
>
> BTW, this is interesting. Was the setup exactly same for both ingestion methods? Could you share how they are different in what setup if possible?
@jihoonson
I already have set intervals in granularitySpec
this is how it looks
`"granularitySpec": {
"type": "uniform",
"segmentGranularity": "HOUR",
"queryGranularity": "HOUR",
"rollup": true,
"intervals": [
"2020-07-16/2020-07-18"
]
}`
Sure Following is the setup
EMR:: 22 * m5.2xl nodes == 176 vCPU
Native (K8S indexer nodes) = 50 nodes each with 4 CPU and 26G memory (200 vCPU)
Each node has 3 worker so a total of 150 workers are spawned for native ingestion.
Let me know if you need detailed numbers for infra and ingestion, can create a separate ticket with the details.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] jihoonson commented on issue #9820: "taskLockHelper is not initialized yet"
Posted by GitBox <gi...@apache.org>.
jihoonson commented on issue #9820:
URL: https://github.com/apache/druid/issues/9820#issuecomment-759980015
Closing as #10631 is merged. Please feel free to reopen if you still see the same issue.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] cloventt commented on issue #9820: "taskLockHelper is not initialized yet"
Posted by GitBox <gi...@apache.org>.
cloventt commented on issue #9820:
URL: https://github.com/apache/druid/issues/9820#issuecomment-691746701
We've tested and also observed this issue on 0.19.0.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] dene14 commented on issue #9820: "taskLockHelper is not initialized yet"
Posted by GitBox <gi...@apache.org>.
dene14 commented on issue #9820:
URL: https://github.com/apache/druid/issues/9820#issuecomment-629230478
Facing the same issue even with a native index (non-parallel) task.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] cloventt commented on issue #9820: "taskLockHelper is not initialized yet"
Posted by GitBox <gi...@apache.org>.
cloventt commented on issue #9820:
URL: https://github.com/apache/druid/issues/9820#issuecomment-687990145
We discovered a workaround. Deleting `intervals` from our `granularitySpec` allowed the append task to complete as normal (note that we are using an `index` task rather than an `index_parallel` task).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] vikramsinghchandel edited a comment on issue #9820: "taskLockHelper is not initialized yet"
Posted by GitBox <gi...@apache.org>.
vikramsinghchandel edited a comment on issue #9820:
URL: https://github.com/apache/druid/issues/9820#issuecomment-661907766
Same issue here. index_parallel with dynamic partitioning, seeing this issue. With hashed partitioning strategy works fine.
@sixtus were you able to find any solution/workaround. With hashed partitioner & forcedGranularityRollUp the performance of indexing is very bad almost twice as bad compared to EMR based indexing
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] vikramsinghchandel edited a comment on issue #9820: "taskLockHelper is not initialized yet"
Posted by GitBox <gi...@apache.org>.
vikramsinghchandel edited a comment on issue #9820:
URL: https://github.com/apache/druid/issues/9820#issuecomment-661907766
Same issue here. index_parallel with dynamic partitioning seeing this issue. With hashed partitioning strategy works file.
@sixtus were you able to find any solution/woraround. With hashed partiitoner & forcedGranularityRollUp the performance of indexing is very bad almost twice as bad compared to EMR based indexing
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] gianm commented on issue #9820: "taskLockHelper is not initialized yet"
Posted by GitBox <gi...@apache.org>.
gianm commented on issue #9820:
URL: https://github.com/apache/druid/issues/9820#issuecomment-738582813
#10631 should fix this.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org