You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Anchit Jatana <de...@gmail.com> on 2016/09/29 07:12:27 UTC
Flink-HBase connectivity through Kerberos keytab | Simple get/put
sample implementation
Hi All,
I'm trying to link my flink application with HBase for simple read/write
operations. I need to implement Flink to HBase the connectivity through
Kerberos using the keytab.
Can somebody share(or link me to some resource) a sample
code/implementation on how to achieve Flink to HBase connectivity through
Kerberos using keytab for simple read/write (get/put) operation.
Thank you!
Regards,
Anchit
Re: Flink-HBase connectivity through Kerberos keytab | Simple get/put
sample implementation
Posted by Stephan Ewen <se...@apache.org>.
Hi!
In Flink prior to 1.2, you can use Kerberos with HBase via Hadoop's
mechanism: https://ci.apache.org/projects/flink/flink-docs-
master/setup/config.html#kerberos
In Flink 1.2-SNAPSHOT, keytabs are installed in the Java security context,
from which HBase can probably pick it up. This is quite new (docs are not
yet updated), I'll let others chime in to add some more details.
@Max / @Vijay do you have any details?
Stephan
On Thu, Sep 29, 2016 at 7:47 PM, Stephan Ewen <se...@apache.org> wrote:
> Hi!
>
> In Flink prior to 1.2, you can use Kerberos with HBase via Hadoop's
> mechanism: https://ci.apache.org/projects/flink/flink-docs-
> master/setup/config.html#kerberos
>
> In Flink 1.2-SNAPSHOT, keytabs are installed in the Java security context,
> from which HBase can probably pick it up. This is quite new, I'll let
> others chime in to add some more details.
>
> @Max / @
>
> On Thu, Sep 29, 2016 at 7:20 PM, Anchit Jatana <
> development.anchit@gmail.com> wrote:
>
>> Hi Fabian,
>>
>> Right, I hope the committers take into account the kerberised access as
>> well. Thanks for the update!
>>
>> Regards,
>> Anchit
>>
>> On Thu, Sep 29, 2016 at 6:15 AM, Fabian Hueske <fh...@gmail.com> wrote:
>>
>>> Hi Anchit,
>>>
>>> Flink does not yet have a streaming sink connector for HBase. Some
>>> members of the community are working on this though [1].
>>> I think we resolved a similar issue for the Kafka connector recently
>>> [2].
>>> Maybe the related commits contain some relevant code for your problem.
>>>
>>> Best, Fabian
>>>
>>> [1] https://github.com/apache/flink/pull/2332
>>> [2] https://issues.apache.org/jira/browse/FLINK-3239
>>>
>>> 2016-09-29 9:12 GMT+02:00 Anchit Jatana <de...@gmail.com>:
>>>
>>>> Hi All,
>>>>
>>>> I'm trying to link my flink application with HBase for simple
>>>> read/write operations. I need to implement Flink to HBase the connectivity
>>>> through Kerberos using the keytab.
>>>>
>>>> Can somebody share(or link me to some resource) a sample
>>>> code/implementation on how to achieve Flink to HBase connectivity through
>>>> Kerberos using keytab for simple read/write (get/put) operation.
>>>>
>>>> Thank you!
>>>>
>>>> Regards,
>>>> Anchit
>>>>
>>>
>>>
>>
>
Re: Flink-HBase connectivity through Kerberos keytab | Simple get/put
sample implementation
Posted by Stephan Ewen <se...@apache.org>.
Hi!
In Flink prior to 1.2, you can use Kerberos with HBase via Hadoop's
mechanism:
https://ci.apache.org/projects/flink/flink-docs-master/setup/config.html#kerberos
In Flink 1.2-SNAPSHOT, keytabs are installed in the Java security context,
from which HBase can probably pick it up. This is quite new, I'll let
others chime in to add some more details.
@Max / @
On Thu, Sep 29, 2016 at 7:20 PM, Anchit Jatana <development.anchit@gmail.com
> wrote:
> Hi Fabian,
>
> Right, I hope the committers take into account the kerberised access as
> well. Thanks for the update!
>
> Regards,
> Anchit
>
> On Thu, Sep 29, 2016 at 6:15 AM, Fabian Hueske <fh...@gmail.com> wrote:
>
>> Hi Anchit,
>>
>> Flink does not yet have a streaming sink connector for HBase. Some
>> members of the community are working on this though [1].
>> I think we resolved a similar issue for the Kafka connector recently [2].
>> Maybe the related commits contain some relevant code for your problem.
>>
>> Best, Fabian
>>
>> [1] https://github.com/apache/flink/pull/2332
>> [2] https://issues.apache.org/jira/browse/FLINK-3239
>>
>> 2016-09-29 9:12 GMT+02:00 Anchit Jatana <de...@gmail.com>:
>>
>>> Hi All,
>>>
>>> I'm trying to link my flink application with HBase for simple read/write
>>> operations. I need to implement Flink to HBase the connectivity through
>>> Kerberos using the keytab.
>>>
>>> Can somebody share(or link me to some resource) a sample
>>> code/implementation on how to achieve Flink to HBase connectivity through
>>> Kerberos using keytab for simple read/write (get/put) operation.
>>>
>>> Thank you!
>>>
>>> Regards,
>>> Anchit
>>>
>>
>>
>
Re: Flink-HBase connectivity through Kerberos keytab | Simple get/put
sample implementation
Posted by Anchit Jatana <de...@gmail.com>.
Hi Fabian,
Right, I hope the committers take into account the kerberised access as
well. Thanks for the update!
Regards,
Anchit
On Thu, Sep 29, 2016 at 6:15 AM, Fabian Hueske <fh...@gmail.com> wrote:
> Hi Anchit,
>
> Flink does not yet have a streaming sink connector for HBase. Some members
> of the community are working on this though [1].
> I think we resolved a similar issue for the Kafka connector recently [2].
> Maybe the related commits contain some relevant code for your problem.
>
> Best, Fabian
>
> [1] https://github.com/apache/flink/pull/2332
> [2] https://issues.apache.org/jira/browse/FLINK-3239
>
> 2016-09-29 9:12 GMT+02:00 Anchit Jatana <de...@gmail.com>:
>
>> Hi All,
>>
>> I'm trying to link my flink application with HBase for simple read/write
>> operations. I need to implement Flink to HBase the connectivity through
>> Kerberos using the keytab.
>>
>> Can somebody share(or link me to some resource) a sample
>> code/implementation on how to achieve Flink to HBase connectivity through
>> Kerberos using keytab for simple read/write (get/put) operation.
>>
>> Thank you!
>>
>> Regards,
>> Anchit
>>
>
>
Re: Flink-HBase connectivity through Kerberos keytab | Simple get/put
sample implementation
Posted by Fabian Hueske <fh...@gmail.com>.
Hi Anchit,
Flink does not yet have a streaming sink connector for HBase. Some members
of the community are working on this though [1].
I think we resolved a similar issue for the Kafka connector recently [2].
Maybe the related commits contain some relevant code for your problem.
Best, Fabian
[1] https://github.com/apache/flink/pull/2332
[2] https://issues.apache.org/jira/browse/FLINK-3239
2016-09-29 9:12 GMT+02:00 Anchit Jatana <de...@gmail.com>:
> Hi All,
>
> I'm trying to link my flink application with HBase for simple read/write
> operations. I need to implement Flink to HBase the connectivity through
> Kerberos using the keytab.
>
> Can somebody share(or link me to some resource) a sample
> code/implementation on how to achieve Flink to HBase connectivity through
> Kerberos using keytab for simple read/write (get/put) operation.
>
> Thank you!
>
> Regards,
> Anchit
>