You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Ted Yu (JIRA)" <ji...@apache.org> on 2018/09/10 17:19:00 UTC
[jira] [Updated] (KYLIN-3394) Prepare for Kafka 2.0
[ https://issues.apache.org/jira/browse/KYLIN-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ted Yu updated KYLIN-3394:
--------------------------
Description:
Kafka 2.0 is around the corner.
I got the following when compiling against Kafka 2.0.0:
{code}
[ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:266: error: type mismatch;
[ERROR] found : Option[org.apache.kafka.common.Node]
[ERROR] required: org.apache.kafka.common.Node
[ERROR] getBrokerInfoFromCache(zkUtils, cachedBrokerInfo, List(l)).head.getNode(listenerName)
[ERROR] ^
[ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:273: error: type mismatch;
[ERROR] found : Seq[Option[org.apache.kafka.common.Node]]
[ERROR] required: Seq[org.apache.kafka.common.Node]
[ERROR] replicaInfo = getBrokerInfoFromCache(zkUtils, cachedBrokerInfo, replicas).map(_.getNode(listenerName))
[ERROR] ^
[ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:274: error: type mismatch;
[ERROR] found : Seq[Option[org.apache.kafka.common.Node]]
[ERROR] required: Seq[org.apache.kafka.common.Node]
[ERROR] isrInfo = getBrokerInfoFromCache(zkUtils, cachedBrokerInfo, inSyncReplicas).map(_.getNode(listenerName))
[ERROR] ^
[ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:476: error: value getConsumersInGroup is not a member of kafka.utils.ZkUtils
[ERROR] zkUtils.getConsumersInGroup(group).nonEmpty
[ERROR] ^
[ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:489: error: not found: type ZKGroupDirs
[ERROR] val dir = new ZKGroupDirs(group)
[ERROR] ^
[ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:507: error: value getTopicsByConsumerGroup is not a member of kafka.utils.ZkUtils
[ERROR] val topics = zkUtils.getTopicsByConsumerGroup(group)
[ERROR] ^
[ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:512: error: not found: type ZKGroupTopicDirs
[ERROR] val dir = new ZKGroupTopicDirs(group, topic)
[ERROR] ^
[ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:528: error: value getAllConsumerGroupsForTopic is not a member of kafka.utils.ZkUtils
[ERROR] val groups = zkUtils.getAllConsumerGroupsForTopic(topic)
[ERROR] ^
[ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:720: error: value encode is not a member of object kafka.utils.Json
[ERROR] val content = Json.encode(getConfigChangeZnodeData(sanitizedEntityPath))
[ERROR] ^
[ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:733: error: value encode is not a member of object kafka.utils.Json
[ERROR] zkUtils.updatePersistentPath(entityPath, Json.encode(map))
{code}
was:
Kafka 2.0 is around the corner.
I got the following when compiling against Kafka 2.0.0-SNAPSHOT :
{code}
[ERROR] /a/kylin/kylin-it/src/test/java/org/apache/kylin/provision/MockKafka.java:[79,74] error: cannot find symbol
[ERROR] symbol: method serverConfig()
[ERROR] location: variable kafkaServer of type KafkaServerStartable
[ERROR] /a/kylin/kylin-it/src/test/java/org/apache/kylin/provision/MockKafka.java:[79,113] error: cannot find symbol
[ERROR] symbol: method serverConfig()
[ERROR] location: variable kafkaServer of type KafkaServerStartable
[ERROR] /a/kylin/kylin-it/src/test/java/org/apache/kylin/provision/MockKafka.java:[79,148] error: cannot find symbol
[ERROR] symbol: method serverConfig()
[ERROR] location: variable kafkaServer of type KafkaServerStartable
[ERROR] /a/kylin/kylin-it/src/test/java/org/apache/kylin/provision/MockKafka.java:[98,65] error: cannot find symbol
{code}
> Prepare for Kafka 2.0
> ---------------------
>
> Key: KYLIN-3394
> URL: https://issues.apache.org/jira/browse/KYLIN-3394
> Project: Kylin
> Issue Type: Task
> Reporter: Ted Yu
> Priority: Major
>
> Kafka 2.0 is around the corner.
> I got the following when compiling against Kafka 2.0.0:
> {code}
> [ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:266: error: type mismatch;
> [ERROR] found : Option[org.apache.kafka.common.Node]
> [ERROR] required: org.apache.kafka.common.Node
> [ERROR] getBrokerInfoFromCache(zkUtils, cachedBrokerInfo, List(l)).head.getNode(listenerName)
> [ERROR] ^
> [ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:273: error: type mismatch;
> [ERROR] found : Seq[Option[org.apache.kafka.common.Node]]
> [ERROR] required: Seq[org.apache.kafka.common.Node]
> [ERROR] replicaInfo = getBrokerInfoFromCache(zkUtils, cachedBrokerInfo, replicas).map(_.getNode(listenerName))
> [ERROR] ^
> [ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:274: error: type mismatch;
> [ERROR] found : Seq[Option[org.apache.kafka.common.Node]]
> [ERROR] required: Seq[org.apache.kafka.common.Node]
> [ERROR] isrInfo = getBrokerInfoFromCache(zkUtils, cachedBrokerInfo, inSyncReplicas).map(_.getNode(listenerName))
> [ERROR] ^
> [ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:476: error: value getConsumersInGroup is not a member of kafka.utils.ZkUtils
> [ERROR] zkUtils.getConsumersInGroup(group).nonEmpty
> [ERROR] ^
> [ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:489: error: not found: type ZKGroupDirs
> [ERROR] val dir = new ZKGroupDirs(group)
> [ERROR] ^
> [ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:507: error: value getTopicsByConsumerGroup is not a member of kafka.utils.ZkUtils
> [ERROR] val topics = zkUtils.getTopicsByConsumerGroup(group)
> [ERROR] ^
> [ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:512: error: not found: type ZKGroupTopicDirs
> [ERROR] val dir = new ZKGroupTopicDirs(group, topic)
> [ERROR] ^
> [ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:528: error: value getAllConsumerGroupsForTopic is not a member of kafka.utils.ZkUtils
> [ERROR] val groups = zkUtils.getAllConsumerGroupsForTopic(topic)
> [ERROR] ^
> [ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:720: error: value encode is not a member of object kafka.utils.Json
> [ERROR] val content = Json.encode(getConfigChangeZnodeData(sanitizedEntityPath))
> [ERROR] ^
> [ERROR] /a/kylin/kylin-it/src/test/scala/kafka/admin/AdminUtils.scala:733: error: value encode is not a member of object kafka.utils.Json
> [ERROR] zkUtils.updatePersistentPath(entityPath, Json.encode(map))
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)