You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@druid.apache.org by Don Bowman <do...@agilicus.com> on 2019/03/20 17:29:02 UTC

historical druid.segmentCache error

One of my historical nodes crashes on startup, yielding this error (below).
Can someone suggest how to start debugging this?

The 2 lines in the config that refer to segmentCache:
historical/runtime.properties:druid.segmentCache.locations=[{"path":
"var/druid/segment-cache", "maxSize": 32000000000, "freeSpacePercent": 1.0}]
historical/runtime.properties:druid.segmentCache.numLoadingThreads=10

The other historical (the one that is not crashing) shows files in the
var/druid/segment-cache as expected. and they are configured the same.

The log message
"Unable to provision, see the following errors:

1) Problem parsing object at prefix[druid.segmentCache]: Can not
deserialize instance of java.util.ArrayList out of VALUE_STRING token
 at [Source: N/A; line: -1, column: -1] (through reference chain:
org.apache.druid.segment.loading.SegmentLoaderConfig[\"locations\"]).
  at
org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:151)
(via modules: com.google.inject.util.Modules$OverrideModule ->
com.google.inject.util.Modules$OverrideModule ->
org.apache.druid.guice.StorageNodeModule)
  at
org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:151)
(via modules: com.google.inject.util.Modules$OverrideModule ->
com.google.inject.util.Modules$OverrideModule ->
org.apache.druid.guice.StorageNodeModule)
  while locating
com.google.common.base.Supplier<org.apache.druid.segment.loading.SegmentLoaderConfig>
at
org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:152)
(via modules: com.google.inject.util.Modules$OverrideModule ->
com.google.inject.util.Modules$OverrideModule ->
org.apache.druid.guice.StorageNodeModule)
  while locating org.apache.druid.segment.loading.SegmentLoaderConfig
    for the 2nd parameter of
org.apache.druid.segment.loading.SegmentLoaderLocalCacheManager.<init>(SegmentLoaderLocalCacheManager.java:89)
  while locating
org.apache.druid.segment.loading.SegmentLoaderLocalCacheManager
  at
org.apache.druid.guice.LocalDataStorageDruidModule.configure(LocalDataStorageDruidModule.java:51)
(via modules: com.google.inject.util.Modules$OverrideModule ->
com.google.inject.util.Modules$OverrideModule ->
org.apache.druid.guice.LocalDataStorageDruidModule)
  while locating org.apache.druid.segment.loading.SegmentLoader
    for the 1st parameter of
org.apache.druid.server.SegmentManager.<init>(SegmentManager.java:100)
  at
org.apache.druid.cli.CliHistorical.lambda$getModules$0(CliHistorical.java:88)
(via modules: com.google.inject.util.Modules$OverrideModule ->
com.google.inject.util.Modules$OverrideModule ->
org.apache.druid.cli.CliHistorical$$Lambda$8/1213871206)
  while locating org.apache.druid.server.SegmentManager
    for the 8th parameter of
org.apache.druid.server.coordination.ServerManager.<init>(ServerManager.java:101)
  at
org.apache.druid.cli.CliHistorical.lambda$getModules$0(CliHistorical.java:87)
(via modules: com.google.inject.util.Modules$OverrideModule ->
com.google.inject.util.Modules$OverrideModule ->
org.apache.druid.cli.CliHistorical$$Lambda$8/1213871206)
  while locating org.apache.druid.server.coordination.ServerManager
  at
org.apache.druid.cli.CliHistorical.lambda$getModules$0(CliHistorical.java:90)
(via modules: com.google.inject.util.Modules$OverrideModule ->
com.google.inject.util.Modules$OverrideModule ->
org.apache.druid.cli.CliHistorical$$Lambda$8/1213871206)
  while locating org.apache.druid.query.QuerySegmentWalker
    for the 2nd parameter of
org.apache.druid.server.QueryLifecycleFactory.<init>(QueryLifecycleFactory.java:52)
  at
org.apache.druid.server.QueryLifecycleFactory.class(QueryLifecycleFactory.java:52)
  while locating org.apache.druid.server.QueryLifecycleFactory
    for the 1st parameter of
org.apache.druid.server.QueryResource.<init>(QueryResource.java:113)
  at org.apache.druid.server.QueryResource.class(QueryResource.java:78)
  while locating org.apache.druid.server.QueryResource

1 error"

Re: historical druid.segmentCache error

Posted by Gian Merlino <gi...@apache.org>.
Nothing comes to mind - is it possible there is some slight difference
between the working and nonworking files, maybe in the whitespace?

On Wed, Mar 20, 2019 at 10:29 AM Don Bowman <do...@agilicus.com> wrote:

> One of my historical nodes crashes on startup, yielding this error (below).
> Can someone suggest how to start debugging this?
>
> The 2 lines in the config that refer to segmentCache:
> historical/runtime.properties:druid.segmentCache.locations=[{"path":
> "var/druid/segment-cache", "maxSize": 32000000000, "freeSpacePercent":
> 1.0}]
> historical/runtime.properties:druid.segmentCache.numLoadingThreads=10
>
> The other historical (the one that is not crashing) shows files in the
> var/druid/segment-cache as expected. and they are configured the same.
>
> The log message
> "Unable to provision, see the following errors:
>
> 1) Problem parsing object at prefix[druid.segmentCache]: Can not
> deserialize instance of java.util.ArrayList out of VALUE_STRING token
>  at [Source: N/A; line: -1, column: -1] (through reference chain:
> org.apache.druid.segment.loading.SegmentLoaderConfig[\"locations\"]).
>   at
> org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:151)
> (via modules: com.google.inject.util.Modules$OverrideModule ->
> com.google.inject.util.Modules$OverrideModule ->
> org.apache.druid.guice.StorageNodeModule)
>   at
> org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:151)
> (via modules: com.google.inject.util.Modules$OverrideModule ->
> com.google.inject.util.Modules$OverrideModule ->
> org.apache.druid.guice.StorageNodeModule)
>   while locating
>
> com.google.common.base.Supplier<org.apache.druid.segment.loading.SegmentLoaderConfig>
> at
> org.apache.druid.guice.JsonConfigProvider.bind(JsonConfigProvider.java:152)
> (via modules: com.google.inject.util.Modules$OverrideModule ->
> com.google.inject.util.Modules$OverrideModule ->
> org.apache.druid.guice.StorageNodeModule)
>   while locating org.apache.druid.segment.loading.SegmentLoaderConfig
>     for the 2nd parameter of
>
> org.apache.druid.segment.loading.SegmentLoaderLocalCacheManager.<init>(SegmentLoaderLocalCacheManager.java:89)
>   while locating
> org.apache.druid.segment.loading.SegmentLoaderLocalCacheManager
>   at
>
> org.apache.druid.guice.LocalDataStorageDruidModule.configure(LocalDataStorageDruidModule.java:51)
> (via modules: com.google.inject.util.Modules$OverrideModule ->
> com.google.inject.util.Modules$OverrideModule ->
> org.apache.druid.guice.LocalDataStorageDruidModule)
>   while locating org.apache.druid.segment.loading.SegmentLoader
>     for the 1st parameter of
> org.apache.druid.server.SegmentManager.<init>(SegmentManager.java:100)
>   at
>
> org.apache.druid.cli.CliHistorical.lambda$getModules$0(CliHistorical.java:88)
> (via modules: com.google.inject.util.Modules$OverrideModule ->
> com.google.inject.util.Modules$OverrideModule ->
> org.apache.druid.cli.CliHistorical$$Lambda$8/1213871206)
>   while locating org.apache.druid.server.SegmentManager
>     for the 8th parameter of
>
> org.apache.druid.server.coordination.ServerManager.<init>(ServerManager.java:101)
>   at
>
> org.apache.druid.cli.CliHistorical.lambda$getModules$0(CliHistorical.java:87)
> (via modules: com.google.inject.util.Modules$OverrideModule ->
> com.google.inject.util.Modules$OverrideModule ->
> org.apache.druid.cli.CliHistorical$$Lambda$8/1213871206)
>   while locating org.apache.druid.server.coordination.ServerManager
>   at
>
> org.apache.druid.cli.CliHistorical.lambda$getModules$0(CliHistorical.java:90)
> (via modules: com.google.inject.util.Modules$OverrideModule ->
> com.google.inject.util.Modules$OverrideModule ->
> org.apache.druid.cli.CliHistorical$$Lambda$8/1213871206)
>   while locating org.apache.druid.query.QuerySegmentWalker
>     for the 2nd parameter of
>
> org.apache.druid.server.QueryLifecycleFactory.<init>(QueryLifecycleFactory.java:52)
>   at
>
> org.apache.druid.server.QueryLifecycleFactory.class(QueryLifecycleFactory.java:52)
>   while locating org.apache.druid.server.QueryLifecycleFactory
>     for the 1st parameter of
> org.apache.druid.server.QueryResource.<init>(QueryResource.java:113)
>   at org.apache.druid.server.QueryResource.class(QueryResource.java:78)
>   while locating org.apache.druid.server.QueryResource
>
> 1 error"
>