You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by Luke Han <lu...@gmail.com> on 2016/01/13 16:26:01 UTC
Re: Issue about Kerberos
Hi Sudeep,
Have you tried with none-Kerberos cluster?
Thanks.
Luke
Best Regards!
---------------------
Luke Han
On Sat, Jan 9, 2016 at 3:35 AM, Sudeep Dey <sd...@zaloni.com> wrote:
> Hi All,
>
> I tried running Kylin in Kerberos enabled Cloudera cluster but it did
> failed in getting job status from Resource Manager. Based on the jira
> opened https://issues.apache.org/jira/browse/KYLIN-1014 I tried building
> the branch https://github.com/apache/kylin/branches/2.0-rc which is
> supposed to have the fix. But after building the code and runnning Kylin.sh
> after kinit command and setting kylin.job.status.with.kerberos=true did not
> resolve the issue. Following is the stack trace of the failure log:
>
> 10.105.166.177] failed: Connection refused
>
> at
> org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
>
> at
> org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:353)
>
> at
> org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:380)
>
> at
> org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236)
>
> at
> org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
>
> at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
>
> at
> org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
>
> at
> org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
>
> at
> org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
>
> at
> org.apache.kylin.engine.mr.common.HadoopStatusGetter.getHttpResponseWithKerberosAuth(HadoopStatusGetter.java:118)
>
> at
> org.apache.kylin.engine.mr.common.HadoopStatusGetter.get(HadoopStatusGetter.java:71)
>
> at
> org.apache.kylin.engine.mr.common.HadoopStatusChecker.checkStatus(HadoopStatusChecker.java:58)
>
> at
> org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:148)
>
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:105)
>
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
>
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:105)
>
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>
> at java.lang.Thread.run(Thread.java:745)
>
> Caused by: java.net.ConnectException: Connection refused
>
> at java.net.PlainSocketImpl.socketConnect(Native Method)
>
> at
> java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
>
> at
> java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
>
> at
> java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
>
> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
>
> at java.net.Socket.connect(Socket.java:579)
>
> at
> org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:74)
>
> at
> org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:134)
>
> ... 19 more
>
> --
> Thanks and Regards
>
> Sudeep Dey
> Zaloni,Inc. | www.zaloni.com
> 633 Davis Drive, Suite 450
> Durham, NC 27713
> e: s <jb...@zaloni.com>dey@zaloni.com
>
>
> "This e-mail, including attachments, may include confidential and/or
> proprietary information, and may be used only by the person or entity
> to which it is addressed. If the reader of this e-mail is not the intended
> recipient or his or her authorized agent, the reader is hereby notified
> that any dissemination, distribution or copying of this e-mail is
> prohibited. If you have received this e-mail in error, please notify the
> sender by replying to this message and delete this e-mail immediately."
>
>
>
>
>
>
>
>
> *Visit us at Strata + Hadoop World San Jose - Booth #1335. Not registered
> yet? Be sure **to use code ZALONI20 to receive 20% off registration! *
>
> <http://conferences.oreilly.com/strata/hadoop-big-data-ca?cmp=ba-data-confreg-home-stca16_were_sponsoring>
Re: Issue about Kerberos
Posted by yu feng <ol...@gmail.com>.
the log stack tells "Connection refused", maybe you should check rm address
config in hadoop configuration(yarn-sitre.xml), a simple MR job will be a
good test.
2016-01-13 23:26 GMT+08:00 Luke Han <lu...@gmail.com>:
> Hi Sudeep,
> Have you tried with none-Kerberos cluster?
> Thanks.
>
> Luke
>
>
> Best Regards!
> ---------------------
>
> Luke Han
>
> On Sat, Jan 9, 2016 at 3:35 AM, Sudeep Dey <sd...@zaloni.com> wrote:
>
>> Hi All,
>>
>> I tried running Kylin in Kerberos enabled Cloudera cluster but it did
>> failed in getting job status from Resource Manager. Based on the jira
>> opened https://issues.apache.org/jira/browse/KYLIN-1014 I tried building
>> the branch https://github.com/apache/kylin/branches/2.0-rc which is
>> supposed to have the fix. But after building the code and runnning Kylin.sh
>> after kinit command and setting kylin.job.status.with.kerberos=true did not
>> resolve the issue. Following is the stack trace of the failure log:
>>
>> 10.105.166.177] failed: Connection refused
>>
>> at
>> org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
>>
>> at
>> org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:353)
>>
>> at
>> org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:380)
>>
>> at
>> org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236)
>>
>> at
>> org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
>>
>> at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
>>
>> at
>> org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
>>
>> at
>> org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
>>
>> at
>> org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
>>
>> at
>> org.apache.kylin.engine.mr.common.HadoopStatusGetter.getHttpResponseWithKerberosAuth(HadoopStatusGetter.java:118)
>>
>> at
>> org.apache.kylin.engine.mr.common.HadoopStatusGetter.get(HadoopStatusGetter.java:71)
>>
>> at
>> org.apache.kylin.engine.mr.common.HadoopStatusChecker.checkStatus(HadoopStatusChecker.java:58)
>>
>> at
>> org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:148)
>>
>> at
>> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:105)
>>
>> at
>> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
>>
>> at
>> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:105)
>>
>> at
>> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124)
>>
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>
>> at java.lang.Thread.run(Thread.java:745)
>>
>> Caused by: java.net.ConnectException: Connection refused
>>
>> at java.net.PlainSocketImpl.socketConnect(Native Method)
>>
>> at
>> java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
>>
>> at
>> java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
>>
>> at
>> java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
>>
>> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
>>
>> at java.net.Socket.connect(Socket.java:579)
>>
>> at
>> org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:74)
>>
>> at
>> org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:134)
>>
>> ... 19 more
>>
>> --
>> Thanks and Regards
>>
>> Sudeep Dey
>> Zaloni,Inc. | www.zaloni.com
>> 633 Davis Drive, Suite 450
>> Durham, NC 27713
>> e: s <jb...@zaloni.com>dey@zaloni.com
>>
>>
>> "This e-mail, including attachments, may include confidential and/or
>> proprietary information, and may be used only by the person or entity
>> to which it is addressed. If the reader of this e-mail is not the intended
>> recipient or his or her authorized agent, the reader is hereby notified
>> that any dissemination, distribution or copying of this e-mail is
>> prohibited. If you have received this e-mail in error, please notify the
>> sender by replying to this message and delete this e-mail immediately."
>>
>>
>>
>>
>>
>>
>>
>>
>> *Visit us at Strata + Hadoop World San Jose - Booth #1335. Not registered
>> yet? Be sure **to use code ZALONI20 to receive 20% off registration! *
>>
>> <http://conferences.oreilly.com/strata/hadoop-big-data-ca?cmp=ba-data-confreg-home-stca16_were_sponsoring>
>
>
>