You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Liu, David" <li...@gmail.com> on 2014/06/26 16:12:03 UTC
Anyone know how to mock a secured hdfs for unit test?
Hi all,
I need to test my code which read data from secured hdfs, is there any library to mock secured hdfs, can minihdfscluster do the work?
Any suggestion is appreciated.
Thanks
RE: Anyone know how to mock a secured hdfs for unit test?
Posted by "Zheng, Kai" <ka...@intel.com>.
Hi Chris,
Thanks for your great info. I would paste it in the JIRA for future reference if I or somebody else get the chance to work on it.
Regards,
Kai
-----Original Message-----
From: Chris Nauroth [mailto:cnauroth@hortonworks.com]
Sent: Saturday, June 28, 2014 4:27 AM
To: security@hadoop.apache.org
Cc: yarn-dev@hadoop.apache.org; hdfs-dev@hadoop.apache.org; hdfs-issues@hadoop.apache.org; yarn-issues@hadoop.apache.org; mapreduce-dev@hadoop.apache.org
Subject: Re: Anyone know how to mock a secured hdfs for unit test?
Hi David and Kai,
There are a couple of challenges with this, but I just figured out a pretty decent setup while working on HDFS-2856. That code isn't committed yet, but if you open patch version 5 attached to that issue and look for the TestSaslDataTransfer class, then you'll see how it works. Most of the logic for bootstrapping a MiniKDC and setting up the right HDFS configuration properties is in an abstract base class named SaslDataTransferTestCase.
I hope this helps.
There are a few other open issues out there related to tests in secure mode. I know of HDFS-4312 and HDFS-5410. It would be great to get more regular test coverage with something that more closely approximates a secured deployment.
Chris Nauroth
Hortonworks
http://hortonworks.com/
On Thu, Jun 26, 2014 at 7:27 AM, Zheng, Kai <ka...@intel.com> wrote:
> Hi David,
>
> Quite some time ago I opened HADOOP-9952 and planned to create secured
> MiniClusters by making use of MiniKDC. Unfortunately since then I
> didn't get the chance to work on it yet. If you need something like
> that and would contribute, please let me know and see if anything I can help with. Thanks.
>
> Regards,
> Kai
>
> -----Original Message-----
> From: Liu, David [mailto:liujiong25@gmail.com]
> Sent: Thursday, June 26, 2014 10:12 PM
> To: hdfs-dev@hadoop.apache.org; hdfs-issues@hadoop.apache.org;
> yarn-dev@hadoop.apache.org; yarn-issues@hadoop.apache.org;
> mapreduce-dev@hadoop.apache.org; security@hadoop.apache.org
> Subject: Anyone know how to mock a secured hdfs for unit test?
>
> Hi all,
>
> I need to test my code which read data from secured hdfs, is there any
> library to mock secured hdfs, can minihdfscluster do the work?
> Any suggestion is appreciated.
>
>
> Thanks
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
RE: Anyone know how to mock a secured hdfs for unit test?
Posted by "Zheng, Kai" <ka...@intel.com>.
Hi Chris,
Thanks for your great info. I would paste it in the JIRA for future reference if I or somebody else get the chance to work on it.
Regards,
Kai
-----Original Message-----
From: Chris Nauroth [mailto:cnauroth@hortonworks.com]
Sent: Saturday, June 28, 2014 4:27 AM
To: security@hadoop.apache.org
Cc: yarn-dev@hadoop.apache.org; hdfs-dev@hadoop.apache.org; hdfs-issues@hadoop.apache.org; yarn-issues@hadoop.apache.org; mapreduce-dev@hadoop.apache.org
Subject: Re: Anyone know how to mock a secured hdfs for unit test?
Hi David and Kai,
There are a couple of challenges with this, but I just figured out a pretty decent setup while working on HDFS-2856. That code isn't committed yet, but if you open patch version 5 attached to that issue and look for the TestSaslDataTransfer class, then you'll see how it works. Most of the logic for bootstrapping a MiniKDC and setting up the right HDFS configuration properties is in an abstract base class named SaslDataTransferTestCase.
I hope this helps.
There are a few other open issues out there related to tests in secure mode. I know of HDFS-4312 and HDFS-5410. It would be great to get more regular test coverage with something that more closely approximates a secured deployment.
Chris Nauroth
Hortonworks
http://hortonworks.com/
On Thu, Jun 26, 2014 at 7:27 AM, Zheng, Kai <ka...@intel.com> wrote:
> Hi David,
>
> Quite some time ago I opened HADOOP-9952 and planned to create secured
> MiniClusters by making use of MiniKDC. Unfortunately since then I
> didn't get the chance to work on it yet. If you need something like
> that and would contribute, please let me know and see if anything I can help with. Thanks.
>
> Regards,
> Kai
>
> -----Original Message-----
> From: Liu, David [mailto:liujiong25@gmail.com]
> Sent: Thursday, June 26, 2014 10:12 PM
> To: hdfs-dev@hadoop.apache.org; hdfs-issues@hadoop.apache.org;
> yarn-dev@hadoop.apache.org; yarn-issues@hadoop.apache.org;
> mapreduce-dev@hadoop.apache.org; security@hadoop.apache.org
> Subject: Anyone know how to mock a secured hdfs for unit test?
>
> Hi all,
>
> I need to test my code which read data from secured hdfs, is there any
> library to mock secured hdfs, can minihdfscluster do the work?
> Any suggestion is appreciated.
>
>
> Thanks
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
RE: Anyone know how to mock a secured hdfs for unit test?
Posted by "Zheng, Kai" <ka...@intel.com>.
Hi Chris,
Thanks for your great info. I would paste it in the JIRA for future reference if I or somebody else get the chance to work on it.
Regards,
Kai
-----Original Message-----
From: Chris Nauroth [mailto:cnauroth@hortonworks.com]
Sent: Saturday, June 28, 2014 4:27 AM
To: security@hadoop.apache.org
Cc: yarn-dev@hadoop.apache.org; hdfs-dev@hadoop.apache.org; hdfs-issues@hadoop.apache.org; yarn-issues@hadoop.apache.org; mapreduce-dev@hadoop.apache.org
Subject: Re: Anyone know how to mock a secured hdfs for unit test?
Hi David and Kai,
There are a couple of challenges with this, but I just figured out a pretty decent setup while working on HDFS-2856. That code isn't committed yet, but if you open patch version 5 attached to that issue and look for the TestSaslDataTransfer class, then you'll see how it works. Most of the logic for bootstrapping a MiniKDC and setting up the right HDFS configuration properties is in an abstract base class named SaslDataTransferTestCase.
I hope this helps.
There are a few other open issues out there related to tests in secure mode. I know of HDFS-4312 and HDFS-5410. It would be great to get more regular test coverage with something that more closely approximates a secured deployment.
Chris Nauroth
Hortonworks
http://hortonworks.com/
On Thu, Jun 26, 2014 at 7:27 AM, Zheng, Kai <ka...@intel.com> wrote:
> Hi David,
>
> Quite some time ago I opened HADOOP-9952 and planned to create secured
> MiniClusters by making use of MiniKDC. Unfortunately since then I
> didn't get the chance to work on it yet. If you need something like
> that and would contribute, please let me know and see if anything I can help with. Thanks.
>
> Regards,
> Kai
>
> -----Original Message-----
> From: Liu, David [mailto:liujiong25@gmail.com]
> Sent: Thursday, June 26, 2014 10:12 PM
> To: hdfs-dev@hadoop.apache.org; hdfs-issues@hadoop.apache.org;
> yarn-dev@hadoop.apache.org; yarn-issues@hadoop.apache.org;
> mapreduce-dev@hadoop.apache.org; security@hadoop.apache.org
> Subject: Anyone know how to mock a secured hdfs for unit test?
>
> Hi all,
>
> I need to test my code which read data from secured hdfs, is there any
> library to mock secured hdfs, can minihdfscluster do the work?
> Any suggestion is appreciated.
>
>
> Thanks
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: Anyone know how to mock a secured hdfs for unit test?
Posted by Chris Nauroth <cn...@hortonworks.com>.
Hi David and Kai,
There are a couple of challenges with this, but I just figured out a pretty
decent setup while working on HDFS-2856. That code isn't committed yet,
but if you open patch version 5 attached to that issue and look for the
TestSaslDataTransfer class, then you'll see how it works. Most of the
logic for bootstrapping a MiniKDC and setting up the right HDFS
configuration properties is in an abstract base class named
SaslDataTransferTestCase.
I hope this helps.
There are a few other open issues out there related to tests in secure
mode. I know of HDFS-4312 and HDFS-5410. It would be great to get more
regular test coverage with something that more closely approximates a
secured deployment.
Chris Nauroth
Hortonworks
http://hortonworks.com/
On Thu, Jun 26, 2014 at 7:27 AM, Zheng, Kai <ka...@intel.com> wrote:
> Hi David,
>
> Quite some time ago I opened HADOOP-9952 and planned to create secured
> MiniClusters by making use of MiniKDC. Unfortunately since then I didn't
> get the chance to work on it yet. If you need something like that and would
> contribute, please let me know and see if anything I can help with. Thanks.
>
> Regards,
> Kai
>
> -----Original Message-----
> From: Liu, David [mailto:liujiong25@gmail.com]
> Sent: Thursday, June 26, 2014 10:12 PM
> To: hdfs-dev@hadoop.apache.org; hdfs-issues@hadoop.apache.org;
> yarn-dev@hadoop.apache.org; yarn-issues@hadoop.apache.org;
> mapreduce-dev@hadoop.apache.org; security@hadoop.apache.org
> Subject: Anyone know how to mock a secured hdfs for unit test?
>
> Hi all,
>
> I need to test my code which read data from secured hdfs, is there any
> library to mock secured hdfs, can minihdfscluster do the work?
> Any suggestion is appreciated.
>
>
> Thanks
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Anyone know how to mock a secured hdfs for unit test?
Posted by Chris Nauroth <cn...@hortonworks.com>.
Hi David and Kai,
There are a couple of challenges with this, but I just figured out a pretty
decent setup while working on HDFS-2856. That code isn't committed yet,
but if you open patch version 5 attached to that issue and look for the
TestSaslDataTransfer class, then you'll see how it works. Most of the
logic for bootstrapping a MiniKDC and setting up the right HDFS
configuration properties is in an abstract base class named
SaslDataTransferTestCase.
I hope this helps.
There are a few other open issues out there related to tests in secure
mode. I know of HDFS-4312 and HDFS-5410. It would be great to get more
regular test coverage with something that more closely approximates a
secured deployment.
Chris Nauroth
Hortonworks
http://hortonworks.com/
On Thu, Jun 26, 2014 at 7:27 AM, Zheng, Kai <ka...@intel.com> wrote:
> Hi David,
>
> Quite some time ago I opened HADOOP-9952 and planned to create secured
> MiniClusters by making use of MiniKDC. Unfortunately since then I didn't
> get the chance to work on it yet. If you need something like that and would
> contribute, please let me know and see if anything I can help with. Thanks.
>
> Regards,
> Kai
>
> -----Original Message-----
> From: Liu, David [mailto:liujiong25@gmail.com]
> Sent: Thursday, June 26, 2014 10:12 PM
> To: hdfs-dev@hadoop.apache.org; hdfs-issues@hadoop.apache.org;
> yarn-dev@hadoop.apache.org; yarn-issues@hadoop.apache.org;
> mapreduce-dev@hadoop.apache.org; security@hadoop.apache.org
> Subject: Anyone know how to mock a secured hdfs for unit test?
>
> Hi all,
>
> I need to test my code which read data from secured hdfs, is there any
> library to mock secured hdfs, can minihdfscluster do the work?
> Any suggestion is appreciated.
>
>
> Thanks
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Anyone know how to mock a secured hdfs for unit test?
Posted by Chris Nauroth <cn...@hortonworks.com>.
Hi David and Kai,
There are a couple of challenges with this, but I just figured out a pretty
decent setup while working on HDFS-2856. That code isn't committed yet,
but if you open patch version 5 attached to that issue and look for the
TestSaslDataTransfer class, then you'll see how it works. Most of the
logic for bootstrapping a MiniKDC and setting up the right HDFS
configuration properties is in an abstract base class named
SaslDataTransferTestCase.
I hope this helps.
There are a few other open issues out there related to tests in secure
mode. I know of HDFS-4312 and HDFS-5410. It would be great to get more
regular test coverage with something that more closely approximates a
secured deployment.
Chris Nauroth
Hortonworks
http://hortonworks.com/
On Thu, Jun 26, 2014 at 7:27 AM, Zheng, Kai <ka...@intel.com> wrote:
> Hi David,
>
> Quite some time ago I opened HADOOP-9952 and planned to create secured
> MiniClusters by making use of MiniKDC. Unfortunately since then I didn't
> get the chance to work on it yet. If you need something like that and would
> contribute, please let me know and see if anything I can help with. Thanks.
>
> Regards,
> Kai
>
> -----Original Message-----
> From: Liu, David [mailto:liujiong25@gmail.com]
> Sent: Thursday, June 26, 2014 10:12 PM
> To: hdfs-dev@hadoop.apache.org; hdfs-issues@hadoop.apache.org;
> yarn-dev@hadoop.apache.org; yarn-issues@hadoop.apache.org;
> mapreduce-dev@hadoop.apache.org; security@hadoop.apache.org
> Subject: Anyone know how to mock a secured hdfs for unit test?
>
> Hi all,
>
> I need to test my code which read data from secured hdfs, is there any
> library to mock secured hdfs, can minihdfscluster do the work?
> Any suggestion is appreciated.
>
>
> Thanks
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Anyone know how to mock a secured hdfs for unit test?
Posted by Chris Nauroth <cn...@hortonworks.com>.
Hi David and Kai,
There are a couple of challenges with this, but I just figured out a pretty
decent setup while working on HDFS-2856. That code isn't committed yet,
but if you open patch version 5 attached to that issue and look for the
TestSaslDataTransfer class, then you'll see how it works. Most of the
logic for bootstrapping a MiniKDC and setting up the right HDFS
configuration properties is in an abstract base class named
SaslDataTransferTestCase.
I hope this helps.
There are a few other open issues out there related to tests in secure
mode. I know of HDFS-4312 and HDFS-5410. It would be great to get more
regular test coverage with something that more closely approximates a
secured deployment.
Chris Nauroth
Hortonworks
http://hortonworks.com/
On Thu, Jun 26, 2014 at 7:27 AM, Zheng, Kai <ka...@intel.com> wrote:
> Hi David,
>
> Quite some time ago I opened HADOOP-9952 and planned to create secured
> MiniClusters by making use of MiniKDC. Unfortunately since then I didn't
> get the chance to work on it yet. If you need something like that and would
> contribute, please let me know and see if anything I can help with. Thanks.
>
> Regards,
> Kai
>
> -----Original Message-----
> From: Liu, David [mailto:liujiong25@gmail.com]
> Sent: Thursday, June 26, 2014 10:12 PM
> To: hdfs-dev@hadoop.apache.org; hdfs-issues@hadoop.apache.org;
> yarn-dev@hadoop.apache.org; yarn-issues@hadoop.apache.org;
> mapreduce-dev@hadoop.apache.org; security@hadoop.apache.org
> Subject: Anyone know how to mock a secured hdfs for unit test?
>
> Hi all,
>
> I need to test my code which read data from secured hdfs, is there any
> library to mock secured hdfs, can minihdfscluster do the work?
> Any suggestion is appreciated.
>
>
> Thanks
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Anyone know how to mock a secured hdfs for unit test?
Posted by Chris Nauroth <cn...@hortonworks.com>.
Hi David and Kai,
There are a couple of challenges with this, but I just figured out a pretty
decent setup while working on HDFS-2856. That code isn't committed yet,
but if you open patch version 5 attached to that issue and look for the
TestSaslDataTransfer class, then you'll see how it works. Most of the
logic for bootstrapping a MiniKDC and setting up the right HDFS
configuration properties is in an abstract base class named
SaslDataTransferTestCase.
I hope this helps.
There are a few other open issues out there related to tests in secure
mode. I know of HDFS-4312 and HDFS-5410. It would be great to get more
regular test coverage with something that more closely approximates a
secured deployment.
Chris Nauroth
Hortonworks
http://hortonworks.com/
On Thu, Jun 26, 2014 at 7:27 AM, Zheng, Kai <ka...@intel.com> wrote:
> Hi David,
>
> Quite some time ago I opened HADOOP-9952 and planned to create secured
> MiniClusters by making use of MiniKDC. Unfortunately since then I didn't
> get the chance to work on it yet. If you need something like that and would
> contribute, please let me know and see if anything I can help with. Thanks.
>
> Regards,
> Kai
>
> -----Original Message-----
> From: Liu, David [mailto:liujiong25@gmail.com]
> Sent: Thursday, June 26, 2014 10:12 PM
> To: hdfs-dev@hadoop.apache.org; hdfs-issues@hadoop.apache.org;
> yarn-dev@hadoop.apache.org; yarn-issues@hadoop.apache.org;
> mapreduce-dev@hadoop.apache.org; security@hadoop.apache.org
> Subject: Anyone know how to mock a secured hdfs for unit test?
>
> Hi all,
>
> I need to test my code which read data from secured hdfs, is there any
> library to mock secured hdfs, can minihdfscluster do the work?
> Any suggestion is appreciated.
>
>
> Thanks
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
RE: Anyone know how to mock a secured hdfs for unit test?
Posted by "Zheng, Kai" <ka...@intel.com>.
Hi David,
Quite some time ago I opened HADOOP-9952 and planned to create secured MiniClusters by making use of MiniKDC. Unfortunately since then I didn't get the chance to work on it yet. If you need something like that and would contribute, please let me know and see if anything I can help with. Thanks.
Regards,
Kai
-----Original Message-----
From: Liu, David [mailto:liujiong25@gmail.com]
Sent: Thursday, June 26, 2014 10:12 PM
To: hdfs-dev@hadoop.apache.org; hdfs-issues@hadoop.apache.org; yarn-dev@hadoop.apache.org; yarn-issues@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; security@hadoop.apache.org
Subject: Anyone know how to mock a secured hdfs for unit test?
Hi all,
I need to test my code which read data from secured hdfs, is there any library to mock secured hdfs, can minihdfscluster do the work?
Any suggestion is appreciated.
Thanks
RE: Anyone know how to mock a secured hdfs for unit test?
Posted by "Zheng, Kai" <ka...@intel.com>.
Hi David,
Quite some time ago I opened HADOOP-9952 and planned to create secured MiniClusters by making use of MiniKDC. Unfortunately since then I didn't get the chance to work on it yet. If you need something like that and would contribute, please let me know and see if anything I can help with. Thanks.
Regards,
Kai
-----Original Message-----
From: Liu, David [mailto:liujiong25@gmail.com]
Sent: Thursday, June 26, 2014 10:12 PM
To: hdfs-dev@hadoop.apache.org; hdfs-issues@hadoop.apache.org; yarn-dev@hadoop.apache.org; yarn-issues@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; security@hadoop.apache.org
Subject: Anyone know how to mock a secured hdfs for unit test?
Hi all,
I need to test my code which read data from secured hdfs, is there any library to mock secured hdfs, can minihdfscluster do the work?
Any suggestion is appreciated.
Thanks
RE: Anyone know how to mock a secured hdfs for unit test?
Posted by "Zheng, Kai" <ka...@intel.com>.
Hi David,
Quite some time ago I opened HADOOP-9952 and planned to create secured MiniClusters by making use of MiniKDC. Unfortunately since then I didn't get the chance to work on it yet. If you need something like that and would contribute, please let me know and see if anything I can help with. Thanks.
Regards,
Kai
-----Original Message-----
From: Liu, David [mailto:liujiong25@gmail.com]
Sent: Thursday, June 26, 2014 10:12 PM
To: hdfs-dev@hadoop.apache.org; hdfs-issues@hadoop.apache.org; yarn-dev@hadoop.apache.org; yarn-issues@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; security@hadoop.apache.org
Subject: Anyone know how to mock a secured hdfs for unit test?
Hi all,
I need to test my code which read data from secured hdfs, is there any library to mock secured hdfs, can minihdfscluster do the work?
Any suggestion is appreciated.
Thanks
Re: Anyone know how to mock a secured hdfs for unit test?
Posted by Steve Loughran <st...@hortonworks.com>.
I'd recommending creating a Linux VM with kerberos installed; make that the
domain controller and work with it from your desktop.
This is the way to be strict -and to learn how Kerberos-managed clusters
can be used. Once you have lots of tests, a long-running VM is actually
faster than starting or stopping miniclusters per test suite, and also lets
you discover the joys of SPNEGO-authed web browsing and the like
see also
https://speakerdeck.com/stevel/secrets-of-yarn-application-development
On 26 June 2014 15:12, Liu, David <li...@gmail.com> wrote:
> Hi all,
>
> I need to test my code which read data from secured hdfs, is there any
> library to mock secured hdfs, can minihdfscluster do the work?
> Any suggestion is appreciated.
>
>
> Thanks
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
RE: Anyone know how to mock a secured hdfs for unit test?
Posted by "Zheng, Kai" <ka...@intel.com>.
Hi David,
Quite some time ago I opened HADOOP-9952 and planned to create secured MiniClusters by making use of MiniKDC. Unfortunately since then I didn't get the chance to work on it yet. If you need something like that and would contribute, please let me know and see if anything I can help with. Thanks.
Regards,
Kai
-----Original Message-----
From: Liu, David [mailto:liujiong25@gmail.com]
Sent: Thursday, June 26, 2014 10:12 PM
To: hdfs-dev@hadoop.apache.org; hdfs-issues@hadoop.apache.org; yarn-dev@hadoop.apache.org; yarn-issues@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; security@hadoop.apache.org
Subject: Anyone know how to mock a secured hdfs for unit test?
Hi all,
I need to test my code which read data from secured hdfs, is there any library to mock secured hdfs, can minihdfscluster do the work?
Any suggestion is appreciated.
Thanks
RE: Anyone know how to mock a secured hdfs for unit test?
Posted by "Zheng, Kai" <ka...@intel.com>.
Hi David,
Quite some time ago I opened HADOOP-9952 and planned to create secured MiniClusters by making use of MiniKDC. Unfortunately since then I didn't get the chance to work on it yet. If you need something like that and would contribute, please let me know and see if anything I can help with. Thanks.
Regards,
Kai
-----Original Message-----
From: Liu, David [mailto:liujiong25@gmail.com]
Sent: Thursday, June 26, 2014 10:12 PM
To: hdfs-dev@hadoop.apache.org; hdfs-issues@hadoop.apache.org; yarn-dev@hadoop.apache.org; yarn-issues@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; security@hadoop.apache.org
Subject: Anyone know how to mock a secured hdfs for unit test?
Hi all,
I need to test my code which read data from secured hdfs, is there any library to mock secured hdfs, can minihdfscluster do the work?
Any suggestion is appreciated.
Thanks