You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "ZHOUBEIHUA (JIRA)" <ji...@apache.org> on 2017/11/21 06:45:01 UTC

[jira] [Resolved] (FLUME-3196) Flume1.6.0 hive-sink error

     [ https://issues.apache.org/jira/browse/FLUME-3196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ZHOUBEIHUA resolved FLUME-3196.
-------------------------------
       Resolution: Fixed
    Fix Version/s: 1.6.0


open debbug log, that show is  kerberos  tgt problem.

add 
a1.sinks.k1.client-principal=<sink_principal>
a1.sinks.k1.client-keytab=<path/to/sink/keytab>
a1.sinks.k1.server-principal=<path/to/source/keytab>

solved it . 



> Flume1.6.0 hive-sink error
> --------------------------
>
>                 Key: FLUME-3196
>                 URL: https://issues.apache.org/jira/browse/FLUME-3196
>             Project: Flume
>          Issue Type: Bug
>          Components: Sinks+Sources
>    Affects Versions: 1.6.0
>         Environment: Flume NG	1.6.0+cdh5.5.2+31	 
> Hadoop	2.6.0+cdh5.5.2+992	 
> MapReduce 1	2.6.0+cdh5.5.2+992	 
> HDFS	2.6.0+cdh5.5.2+992	 
> Hive	1.1.0+cdh5.5.2+377	
> HCatalog	1.1.0+cdh5.5.2+377
>            Reporter: ZHOUBEIHUA
>            Priority: Blocker
>             Fix For: 1.6.0
>
>
> Hi,
> When  use flume  , source is kafka , sink is  hive .
>  error message like this:
> 2017-11-20 17:00:49,269 ERROR org.apache.flume.SinkRunner: Unable to deliver event. Exception follows.
> org.apache.flume.EventDeliveryException: org.apache.flume.sink.hive.HiveWriter$ConnectException: Failed connecting to EndPoint {metaStoreUri='thrift://fonova-ahz-cdh09:9083,thrift://xxx-xxx-xxx:9083', database='aa', table='aa', partitionVals=[2017, 11, 20] }
> I have tried ,  also can't solve  it 
> 1.set hive_home hcalog_home
> 2.hdfs://tmp/hive and file:///tmp/hive writable (eg. chmod 777) ,
> 3.set 
> hive.txn.manager = org.apache.hadoop.hive.ql.lockmgr.DbTxnManager
> hive.compactor.initiator.on = true (See more important details here)
> hive.compactor.worker.threads > 0  
> to hive-site.xml
> Can you give me some advice how to fix it .  THKS.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)