You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2019/05/06 05:26:25 UTC
[GitHub] [incubator-druid] mihai-cazacu-adswizz opened a new issue #7597:
[materialized view] The generated specification is too big
mihai-cazacu-adswizz opened a new issue #7597: [materialized view] The generated specification is too big
URL: https://github.com/apache/incubator-druid/issues/7597
**Affected Version**
0.13.0-incubating
**Description**
Processing an interval with many segments (100 - 400) throws this exception:
```
Length of raw bytes for znode[/.../indexer/tasks/server:8091/ds_2019-04-30T12:48:57.577Z] too large[655,019 > 524,288]
```
The generated JSON has `~2.5 MB` (each segment containing a lot of data, especially dimensions and metrics) and the Druid's limit is `512K` (while the Zookeeper's limit appears to be `1MB`).
I have seen that we can modify the value of [druid.indexer.runner.maxZnodeBytes](https://github.com/metabase/druid/blob/master/docs/content/configuration/indexing-service.md) but is this recommended (over the time, the number of our segments could double)?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org