You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by Árki Gábor <ar...@gmail.com> on 2022/01/05 20:57:17 UTC
Kylin 3.1.3: Error when get coordinator leader
Hi All,
I wanted to try out Kylin 3.1.3 with a clean installation but ran into an
issue. The stream receiver is unable to start due to the following error:
2021-12-30 18:20:07,474 ERROR [main] server.StreamingReceiver:53 :
streaming receiver start fail
org.apache.kylin.stream.coordinator.exception.StoreException:
com.fasterxml.jackson.core.JsonParseException: Unexpected character ('.'
(code 46)): Expected space separating root-level values
at [Source: (byte[])"24.0.1.128"; line: 1, column: 6]
at
org.apache.kylin.stream.coordinator.ZookeeperStreamMetadataStore.getCoordinatorNode(ZookeeperStreamMetadataStore.java:276)
at
org.apache.kylin.stream.coordinator.client.HttpCoordinatorClient.<init>(HttpCoordinatorClient.java:53)
at
org.apache.kylin.stream.server.StreamingServer.<init>(StreamingServer.java:126)
at
org.apache.kylin.stream.server.StreamingServer.getInstance(StreamingServer.java:141)
at
org.apache.kylin.stream.server.StreamingReceiver.startStreamingServer(StreamingReceiver.java:67)
at
org.apache.kylin.stream.server.StreamingReceiver.start(StreamingReceiver.java:61)
at
org.apache.kylin.stream.server.StreamingReceiver.main(StreamingReceiver.java:51)
Caused by: com.fasterxml.jackson.core.JsonParseException: Unexpected
character ('.' (code 46)): Expected space separating root-level values
at [Source: (byte[])"24.0.1.128"; line: 1, column: 6]
at
com.fasterxml.jackson.core.JsonParser._constructError(JsonParser.java:1840)
at
com.fasterxml.jackson.core.base.ParserMinimalBase._reportError(ParserMinimalBase.java:712)
at
com.fasterxml.jackson.core.base.ParserMinimalBase._reportUnexpectedChar(ParserMinimalBase.java:637)
at
com.fasterxml.jackson.core.base.ParserMinimalBase._reportMissingRootWS(ParserMinimalBase.java:684)
at
com.fasterxml.jackson.core.json.UTF8StreamJsonParser._verifyRootSpace(UTF8StreamJsonParser.java:1659)
at
com.fasterxml.jackson.core.json.UTF8StreamJsonParser._parseFloat(UTF8StreamJsonParser.java:1626)
at
com.fasterxml.jackson.core.json.UTF8StreamJsonParser._parsePosNumber(UTF8StreamJsonParser.java:1393)
at
com.fasterxml.jackson.core.json.UTF8StreamJsonParser._nextTokenNotInObject(UTF8StreamJsonParser.java:854)
at
com.fasterxml.jackson.core.json.UTF8StreamJsonParser.nextToken(UTF8StreamJsonParser.java:753)
at
com.fasterxml.jackson.databind.ObjectMapper._initForReading(ObjectMapper.java:4340)
at
com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:4189)
at
com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3266)
at org.apache.kylin.common.util.JsonUtil.readValue(JsonUtil.java:76)
at
org.apache.kylin.stream.coordinator.ZookeeperStreamMetadataStore.getCoordinatorNode(ZookeeperStreamMetadataStore.java:272)
... 6 more
I did check in ZooKeeper and indeed the path is containing the plain string
of the IP address instead of a valid JSON Node object that is present in ZK
in our 3.1.0 installation:
[hadoop@ip-24-0-1-128 kylin_stream]$ hbase zkcli
Connecting to ip-24-0-1-124.us-west-2.compute.internal:2181
Welcome to ZooKeeper!
JLine support is disabled
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
get /kylin/kylin_metadata/stream/coordinator
24.0.1.128
cZxid = 0x77
ctime = Thu Dec 30 18:18:27 UTC 2021
mZxid = 0x77
mtime = Thu Dec 30 18:18:27 UTC 2021
pZxid = 0x77
cversion = 0
dataVersion = 0
aclVersion = 0
ephemeralOwner = 0x0
dataLength = 10
numChildren = 0
Do you have any idea what could be the issue?
Regards,
Gabor
Re: Kylin 3.1.3: Error when get coordinator leader
Posted by Árki Gábor <ar...@gmail.com>.
It seems to be working now, thank you for your help.
On Thu., Jan. 6, 2022, 03:37 Yaqian Zhang, <Ya...@126.com> wrote:
> Hi Gabor:
>
> In order to fix security issues, some modifications have been made to the
> real-time function of Kylin 3.1.3n.
>
> You need to set “kylin.server.mode=stream_coordinator" in
> kylin.properties of the coordinator node, which can no longer be set to “
> kylin.server.mode=all” for coordinator node.
>
> Thank you for your test and report, we will update the document later to
> remind kylin users of the changes here.
>
> 在 2022年1月6日，上午4:57，Árki Gábor <ar...@gmail.com> 写道：
>
> Hi All,
>
> I wanted to try out Kylin 3.1.3 with a clean installation but ran into an
> issue. The stream receiver is unable to start due to the following error:
>
> 2021-12-30 18:20:07,474 ERROR [main] server.StreamingReceiver:53 :
> streaming receiver start fail
> org.apache.kylin.stream.coordinator.exception.StoreException:
> com.fasterxml.jackson.core.JsonParseException: Unexpected character ('.'
> (code 46)): Expected space separating root-level values
> at [Source: (byte[])"24.0.1.128"; line: 1, column: 6]
> at
> org.apache.kylin.stream.coordinator.ZookeeperStreamMetadataStore.getCoordinatorNode(ZookeeperStreamMetadataStore.java:276)
> at
> org.apache.kylin.stream.coordinator.client.HttpCoordinatorClient.<init>(HttpCoordinatorClient.java:53)
> at
> org.apache.kylin.stream.server.StreamingServer.<init>(StreamingServer.java:126)
> at
> org.apache.kylin.stream.server.StreamingServer.getInstance(StreamingServer.java:141)
> at
> org.apache.kylin.stream.server.StreamingReceiver.startStreamingServer(StreamingReceiver.java:67)
> at
> org.apache.kylin.stream.server.StreamingReceiver.start(StreamingReceiver.java:61)
> at
> org.apache.kylin.stream.server.StreamingReceiver.main(StreamingReceiver.java:51)
> Caused by: com.fasterxml.jackson.core.JsonParseException: Unexpected
> character ('.' (code 46)): Expected space separating root-level values
> at [Source: (byte[])"24.0.1.128"; line: 1, column: 6]
> at
> com.fasterxml.jackson.core.JsonParser._constructError(JsonParser.java:1840)
> at
> com.fasterxml.jackson.core.base.ParserMinimalBase._reportError(ParserMinimalBase.java:712)
> at
> com.fasterxml.jackson.core.base.ParserMinimalBase._reportUnexpectedChar(ParserMinimalBase.java:637)
> at
> com.fasterxml.jackson.core.base.ParserMinimalBase._reportMissingRootWS(ParserMinimalBase.java:684)
> at
> com.fasterxml.jackson.core.json.UTF8StreamJsonParser._verifyRootSpace(UTF8StreamJsonParser.java:1659)
> at
> com.fasterxml.jackson.core.json.UTF8StreamJsonParser._parseFloat(UTF8StreamJsonParser.java:1626)
> at
> com.fasterxml.jackson.core.json.UTF8StreamJsonParser._parsePosNumber(UTF8StreamJsonParser.java:1393)
> at
> com.fasterxml.jackson.core.json.UTF8StreamJsonParser._nextTokenNotInObject(UTF8StreamJsonParser.java:854)
> at
> com.fasterxml.jackson.core.json.UTF8StreamJsonParser.nextToken(UTF8StreamJsonParser.java:753)
> at
> com.fasterxml.jackson.databind.ObjectMapper._initForReading(ObjectMapper.java:4340)
> at
> com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:4189)
> at
> com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3266)
> at
> org.apache.kylin.common.util.JsonUtil.readValue(JsonUtil.java:76)
> at
> org.apache.kylin.stream.coordinator.ZookeeperStreamMetadataStore.getCoordinatorNode(ZookeeperStreamMetadataStore.java:272)
> ... 6 more
>
> I did check in ZooKeeper and indeed the path is containing the plain
> string of the IP address instead of a valid JSON Node object that is
> present in ZK in our 3.1.0 installation:
>
> [hadoop@ip-24-0-1-128 kylin_stream]$ hbase zkcli
> Connecting to ip-24-0-1-124.us-west-2.compute.internal:2181
> Welcome to ZooKeeper!
> JLine support is disabled
>
> WATCHER::
>
> WatchedEvent state:SyncConnected type:None path:null
> get /kylin/kylin_metadata/stream/coordinator
> 24.0.1.128
> cZxid = 0x77
> ctime = Thu Dec 30 18:18:27 UTC 2021
> mZxid = 0x77
> mtime = Thu Dec 30 18:18:27 UTC 2021
> pZxid = 0x77
> cversion = 0
> dataVersion = 0
> aclVersion = 0
> ephemeralOwner = 0x0
> dataLength = 10
> numChildren = 0
>
> Do you have any idea what could be the issue?
>
> Regards,
> Gabor
>
>
>
Re: Kylin 3.1.3: Error when get coordinator leader
Posted by Yaqian Zhang <Ya...@126.com>.
Hi Gabor:
In order to fix security issues, some modifications have been made to the real-time function of Kylin 3.1.3n.
You need to set “kylin.server.mode=stream_coordinator" in kylin.properties of the coordinator node, which can no longer be set to “kylin.server.mode=all” for coordinator node.
Thank you for your test and report, we will update the document later to remind kylin users of the changes here.
> 在 2022年1月6日，上午4:57，Árki Gábor <ar...@gmail.com> 写道：
>
> Hi All,
>
> I wanted to try out Kylin 3.1.3 with a clean installation but ran into an issue. The stream receiver is unable to start due to the following error:
>
> 2021-12-30 18:20:07,474 ERROR [main] server.StreamingReceiver:53 : streaming receiver start fail
> org.apache.kylin.stream.coordinator.exception.StoreException: com.fasterxml.jackson.core.JsonParseException: Unexpected character ('.' (code 46)): Expected space separating root-level values
> at [Source: (byte[])"24.0.1.128"; line: 1, column: 6]
> at org.apache.kylin.stream.coordinator.ZookeeperStreamMetadataStore.getCoordinatorNode(ZookeeperStreamMetadataStore.java:276)
> at org.apache.kylin.stream.coordinator.client.HttpCoordinatorClient.<init>(HttpCoordinatorClient.java:53)
> at org.apache.kylin.stream.server.StreamingServer.<init>(StreamingServer.java:126)
> at org.apache.kylin.stream.server.StreamingServer.getInstance(StreamingServer.java:141)
> at org.apache.kylin.stream.server.StreamingReceiver.startStreamingServer(StreamingReceiver.java:67)
> at org.apache.kylin.stream.server.StreamingReceiver.start(StreamingReceiver.java:61)
> at org.apache.kylin.stream.server.StreamingReceiver.main(StreamingReceiver.java:51)
> Caused by: com.fasterxml.jackson.core.JsonParseException: Unexpected character ('.' (code 46)): Expected space separating root-level values
> at [Source: (byte[])"24.0.1.128"; line: 1, column: 6]
> at com.fasterxml.jackson.core.JsonParser._constructError(JsonParser.java:1840)
> at com.fasterxml.jackson.core.base.ParserMinimalBase._reportError(ParserMinimalBase.java:712)
> at com.fasterxml.jackson.core.base.ParserMinimalBase._reportUnexpectedChar(ParserMinimalBase.java:637)
> at com.fasterxml.jackson.core.base.ParserMinimalBase._reportMissingRootWS(ParserMinimalBase.java:684)
> at com.fasterxml.jackson.core.json.UTF8StreamJsonParser._verifyRootSpace(UTF8StreamJsonParser.java:1659)
> at com.fasterxml.jackson.core.json.UTF8StreamJsonParser._parseFloat(UTF8StreamJsonParser.java:1626)
> at com.fasterxml.jackson.core.json.UTF8StreamJsonParser._parsePosNumber(UTF8StreamJsonParser.java:1393)
> at com.fasterxml.jackson.core.json.UTF8StreamJsonParser._nextTokenNotInObject(UTF8StreamJsonParser.java:854)
> at com.fasterxml.jackson.core.json.UTF8StreamJsonParser.nextToken(UTF8StreamJsonParser.java:753)
> at com.fasterxml.jackson.databind.ObjectMapper._initForReading(ObjectMapper.java:4340)
> at com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:4189)
> at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3266)
> at org.apache.kylin.common.util.JsonUtil.readValue(JsonUtil.java:76)
> at org.apache.kylin.stream.coordinator.ZookeeperStreamMetadataStore.getCoordinatorNode(ZookeeperStreamMetadataStore.java:272)
> ... 6 more
>
> I did check in ZooKeeper and indeed the path is containing the plain string of the IP address instead of a valid JSON Node object that is present in ZK in our 3.1.0 installation:
>
> [hadoop@ip-24-0-1-128 kylin_stream]$ hbase zkcli
> Connecting to ip-24-0-1-124.us-west-2.compute.internal:2181
> Welcome to ZooKeeper!
> JLine support is disabled
>
> WATCHER::
>
> WatchedEvent state:SyncConnected type:None path:null
> get /kylin/kylin_metadata/stream/coordinator
> 24.0.1.128
> cZxid = 0x77
> ctime = Thu Dec 30 18:18:27 UTC 2021
> mZxid = 0x77
> mtime = Thu Dec 30 18:18:27 UTC 2021
> pZxid = 0x77
> cversion = 0
> dataVersion = 0
> aclVersion = 0
> ephemeralOwner = 0x0
> dataLength = 10
> numChildren = 0
>
> Do you have any idea what could be the issue?
>
> Regards,
> Gabor