You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "mengge zhang (JIRA)" <ji...@apache.org> on 2017/05/06 13:29:04 UTC
[jira] [Updated] (FLUME-3089) flume hive sink
[ https://issues.apache.org/jira/browse/FLUME-3089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
mengge zhang updated FLUME-3089:
--------------------------------
Description:
When flume is running up,the background is being given:
2017-05-06 21:17:19,544 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:158)] Unable to deliver event. Exception follows.
org.apache.flume.EventDeliveryException: java.lang.IllegalArgumentException
at org.apache.flume.sink.hive.HiveSink.process(HiveSink.java:267)
at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67)
at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalArgumentException
at java.sql.Date.valueOf(Date.java:143)
at org.apache.hive.hcatalog.data.JsonSerDe.extractCurrentField(JsonSerDe.java:310)
at org.apache.hive.hcatalog.data.JsonSerDe.populateRecord(JsonSerDe.java:218)
at org.apache.hive.hcatalog.data.JsonSerDe.deserialize(JsonSerDe.java:174)
at org.apache.hive.hcatalog.streaming.StrictJsonWriter.encode(StrictJsonWriter.java:156)
at org.apache.hive.hcatalog.streaming.StrictJsonWriter.write(StrictJsonWriter.java:123)
at org.apache.hive.hcatalog.streaming.HiveEndPoint$TransactionBatchImpl.writeImpl(HiveEndPoint.java:815)
at org.apache.hive.hcatalog.streaming.HiveEndPoint$TransactionBatchImpl.write(HiveEndPoint.java:782)
at org.apache.hive.hcatalog.streaming.HiveEndPoint$TransactionBatchImpl.write(HiveEndPoint.java:735)
at org.apache.flume.sink.hive.HiveJsonSerializer.write(HiveJsonSerializer.java:42)
at org.apache.flume.sink.hive.HiveWriter$1.call(HiveWriter.java:158)
at org.apache.flume.sink.hive.HiveWriter$1.call(HiveWriter.java:152)
at org.apache.flume.sink.hive.HiveWriter$11.call(HiveWriter.java:428)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
... 1 more
I do not know why,please help me,thanks.
was:
When flume is running up,the background is being given:
2017-05-06 21:17:19,544 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:158)] Unable to deliver event. Exception follows.
org.apache.flume.EventDeliveryException: java.lang.IllegalArgumentException
at org.apache.flume.sink.hive.HiveSink.process(HiveSink.java:267)
at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67)
at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalArgumentException
at java.sql.Date.valueOf(Date.java:143)
at org.apache.hive.hcatalog.data.JsonSerDe.extractCurrentField(JsonSerDe.java:310)
at org.apache.hive.hcatalog.data.JsonSerDe.populateRecord(JsonSerDe.java:218)
at org.apache.hive.hcatalog.data.JsonSerDe.deserialize(JsonSerDe.java:174)
at org.apache.hive.hcatalog.streaming.StrictJsonWriter.encode(StrictJsonWriter.java:156)
at org.apache.hive.hcatalog.streaming.StrictJsonWriter.write(StrictJsonWriter.java:123)
at org.apache.hive.hcatalog.streaming.HiveEndPoint$TransactionBatchImpl.writeImpl(HiveEndPoint.java:815)
at org.apache.hive.hcatalog.streaming.HiveEndPoint$TransactionBatchImpl.write(HiveEndPoint.java:782)
at org.apache.hive.hcatalog.streaming.HiveEndPoint$TransactionBatchImpl.write(HiveEndPoint.java:735)
at org.apache.flume.sink.hive.HiveJsonSerializer.write(HiveJsonSerializer.java:42)
at org.apache.flume.sink.hive.HiveWriter$1.call(HiveWriter.java:158)
at org.apache.flume.sink.hive.HiveWriter$1.call(HiveWriter.java:152)
at org.apache.flume.sink.hive.HiveWriter$11.call(HiveWriter.java:428)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
... 1 more
> flume hive sink
> ----------------
>
> Key: FLUME-3089
> URL: https://issues.apache.org/jira/browse/FLUME-3089
> Project: Flume
> Issue Type: Bug
> Environment: system:Ubuntu 16.04.1 LTS \n \l
> flume:apache-flume-1.7.0-bin.tar.gz
> hive:apache-hive-2.1.1-bin
> Reporter: mengge zhang
>
> When flume is running up,the background is being given:
> 2017-05-06 21:17:19,544 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:158)] Unable to deliver event. Exception follows.
> org.apache.flume.EventDeliveryException: java.lang.IllegalArgumentException
> at org.apache.flume.sink.hive.HiveSink.process(HiveSink.java:267)
> at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67)
> at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.IllegalArgumentException
> at java.sql.Date.valueOf(Date.java:143)
> at org.apache.hive.hcatalog.data.JsonSerDe.extractCurrentField(JsonSerDe.java:310)
> at org.apache.hive.hcatalog.data.JsonSerDe.populateRecord(JsonSerDe.java:218)
> at org.apache.hive.hcatalog.data.JsonSerDe.deserialize(JsonSerDe.java:174)
> at org.apache.hive.hcatalog.streaming.StrictJsonWriter.encode(StrictJsonWriter.java:156)
> at org.apache.hive.hcatalog.streaming.StrictJsonWriter.write(StrictJsonWriter.java:123)
> at org.apache.hive.hcatalog.streaming.HiveEndPoint$TransactionBatchImpl.writeImpl(HiveEndPoint.java:815)
> at org.apache.hive.hcatalog.streaming.HiveEndPoint$TransactionBatchImpl.write(HiveEndPoint.java:782)
> at org.apache.hive.hcatalog.streaming.HiveEndPoint$TransactionBatchImpl.write(HiveEndPoint.java:735)
> at org.apache.flume.sink.hive.HiveJsonSerializer.write(HiveJsonSerializer.java:42)
> at org.apache.flume.sink.hive.HiveWriter$1.call(HiveWriter.java:158)
> at org.apache.flume.sink.hive.HiveWriter$1.call(HiveWriter.java:152)
> at org.apache.flume.sink.hive.HiveWriter$11.call(HiveWriter.java:428)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> ... 1 more
> I do not know why,please help me,thanks.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)