You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Stamatis Zampetakis (Jira)" <ji...@apache.org> on 2022/05/16 15:24:00 UTC
[jira] [Resolved] (HIVE-26205) Remove the incorrect org.slf4j dependency in kafka-handler
[ https://issues.apache.org/jira/browse/HIVE-26205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Stamatis Zampetakis resolved HIVE-26205.
----------------------------------------
Resolution: Fixed
Fixed in [https://github.com/apache/hive/commit/74e3f29b4328b5df5a1cd90de12ec3e35301afae.] Thanks for the PR [~wechar] !
> Remove the incorrect org.slf4j dependency in kafka-handler
> ----------------------------------------------------------
>
> Key: HIVE-26205
> URL: https://issues.apache.org/jira/browse/HIVE-26205
> Project: Hive
> Issue Type: Bug
> Components: Hive
> Affects Versions: 4.0.0-alpha-2
> Reporter: Wechar
> Assignee: Wechar
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0-alpha-2
>
> Time Spent: 40m
> Remaining Estimate: 0h
>
> Get a compile error while executing:
> {code:bash}
> mvn clean install -DskipTests
> {code}
> The error message is:
> {code:bash}
> [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.1:compile (default-compile) on project kafka-handler: Compilation failure: Compilation failure:
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaStorageHandler.java:[53,17] package org.slf4j does not exist
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaStorageHandler.java:[54,17] package org.slf4j does not exist
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaStorageHandler.java:[73,24] cannot find symbol
> [ERROR] symbol: class Logger
> [ERROR] location: class org.apache.hadoop.hive.kafka.KafkaStorageHandler
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/VectorizedKafkaRecordReader.java:[37,17] package org.slf4j does not exist
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/VectorizedKafkaRecordReader.java:[47,24] cannot find symbol
> [ERROR] symbol: class Logger
> [ERROR] location: class org.apache.hadoop.hive.kafka.VectorizedKafkaRecordReader
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaJsonSerDe.java:[63,17] package org.slf4j does not exist
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/SimpleKafkaWriter.java:[35,17] package org.slf4j does not exist
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/SimpleKafkaWriter.java:[50,24] cannot find symbol
> [ERROR] symbol: class Logger
> [ERROR] location: class org.apache.hadoop.hive.kafka.SimpleKafkaWriter
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaOutputFormat.java:[34,17] package org.slf4j does not exist
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaOutputFormat.java:[43,24] cannot find symbol
> [ERROR] symbol: class Logger
> [ERROR] location: class org.apache.hadoop.hive.kafka.KafkaOutputFormat
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/RetryUtils.java:[24,17] package org.slf4j does not exist
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/RetryUtils.java:[34,24] cannot find symbol
> [ERROR] symbol: class Logger
> [ERROR] location: class org.apache.hadoop.hive.kafka.RetryUtils
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaScanTrimmer.java:[51,17] package org.slf4j does not exist
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaScanTrimmer.java:[65,24] cannot find symbol
> [ERROR] symbol: class Logger
> [ERROR] location: class org.apache.hadoop.hive.kafka.KafkaScanTrimmer
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/TransactionalKafkaWriter.java:[45,17] package org.slf4j does not exist
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/TransactionalKafkaWriter.java:[65,24] cannot find symbol
> [ERROR] symbol: class Logger
> [ERROR] location: class org.apache.hadoop.hive.kafka.TransactionalKafkaWriter
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/HiveKafkaProducer.java:[37,17] package org.slf4j does not exist
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/HiveKafkaProducer.java:[59,24] cannot find symbol
> [ERROR] symbol: class Logger
> [ERROR] location: class org.apache.hadoop.hive.kafka.HiveKafkaProducer<K,V>
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaRecordIterator.java:[30,17] package org.slf4j does not exist
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaRecordIterator.java:[56,24] cannot find symbol
> [ERROR] symbol: class Logger
> [ERROR] location: class org.apache.hadoop.hive.kafka.KafkaRecordIterator
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaUtils.java:[52,17] package org.slf4j does not exist
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaUtils.java:[72,24] cannot find symbol
> [ERROR] symbol: class Logger
> [ERROR] location: class org.apache.hadoop.hive.kafka.KafkaUtils
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaRecordReader.java:[31,17] package org.slf4j does not exist
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaRecordReader.java:[42,24] cannot find symbol
> [ERROR] symbol: class Logger
> [ERROR] location: class org.apache.hadoop.hive.kafka.KafkaRecordReader
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaInputFormat.java:[42,17] package org.slf4j does not exist
> [ERROR] /ldap_home/weiqiang.yu/forked-hive/kafka-handler/src/java/org/apache/hadoop/hive/kafka/KafkaInputFormat.java:[64,24] cannot find symbol
> [ERROR] symbol: class Logger
> [ERROR] location: class org.apache.hadoop.hive.kafka.KafkaInputFormat
> [ERROR] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please read the following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the command
> [ERROR] mvn <args> -rf :kafka-handler
> {code}
> *Root cause:*
> The `pom.xml` of `kafka-handler` module defines such dependency:
> {code:xml}
> <!-- kafka-handler/pom.xml -->
> <dependency>
> <groupId>org.slf4j</groupId>
> <artifactId>slf4j-api</artifactId>
> <scope>test</scope>
> </dependency>
> {code}
> which causes that log4j lib can be available only in test. It is a redundant config that we can remove.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)