You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "mengge zhang (JIRA)" <ji...@apache.org> on 2017/05/06 13:28:04 UTC

[jira] [Created] (FLUME-3089) flume hive sink

mengge zhang created FLUME-3089:
-----------------------------------

             Summary: flume  hive sink
                 Key: FLUME-3089
                 URL: https://issues.apache.org/jira/browse/FLUME-3089
             Project: Flume
          Issue Type: Bug
         Environment: system:Ubuntu 16.04.1 LTS \n \l
flume:apache-flume-1.7.0-bin.tar.gz
hive:apache-hive-2.1.1-bin
            Reporter: mengge zhang


When flume is running up,the background is being given:
2017-05-06 21:17:19,544 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:158)] Unable to deliver event. Exception follows.
org.apache.flume.EventDeliveryException: java.lang.IllegalArgumentException
	at org.apache.flume.sink.hive.HiveSink.process(HiveSink.java:267)
	at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67)
	at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalArgumentException
	at java.sql.Date.valueOf(Date.java:143)
	at org.apache.hive.hcatalog.data.JsonSerDe.extractCurrentField(JsonSerDe.java:310)
	at org.apache.hive.hcatalog.data.JsonSerDe.populateRecord(JsonSerDe.java:218)
	at org.apache.hive.hcatalog.data.JsonSerDe.deserialize(JsonSerDe.java:174)
	at org.apache.hive.hcatalog.streaming.StrictJsonWriter.encode(StrictJsonWriter.java:156)
	at org.apache.hive.hcatalog.streaming.StrictJsonWriter.write(StrictJsonWriter.java:123)
	at org.apache.hive.hcatalog.streaming.HiveEndPoint$TransactionBatchImpl.writeImpl(HiveEndPoint.java:815)
	at org.apache.hive.hcatalog.streaming.HiveEndPoint$TransactionBatchImpl.write(HiveEndPoint.java:782)
	at org.apache.hive.hcatalog.streaming.HiveEndPoint$TransactionBatchImpl.write(HiveEndPoint.java:735)
	at org.apache.flume.sink.hive.HiveJsonSerializer.write(HiveJsonSerializer.java:42)
	at org.apache.flume.sink.hive.HiveWriter$1.call(HiveWriter.java:158)
	at org.apache.flume.sink.hive.HiveWriter$1.call(HiveWriter.java:152)
	at org.apache.flume.sink.hive.HiveWriter$11.call(HiveWriter.java:428)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	... 1 more





--
This message was sent by Atlassian JIRA
(v6.3.15#6346)