You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@ambari.apache.org by Attila Magyar <am...@hortonworks.com> on 2017/03/01 11:18:34 UTC
Re: Review Request 56980: Adding spark2 to a kerberized cluster with
spark1 fails with keytab file does not exist error
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/56980/
-----------------------------------------------------------
(Updated March 1, 2017, 11:18 a.m.)
Review request for Ambari, Attila Doroszlai, Bal�zs Bence S�ri, Robert Levas, and Sebastian Toader.
Changes
-------
dropping the previous approach, let's use the same keytab file in both cases
Bugs: AMBARI-20140
https://issues.apache.org/jira/browse/AMBARI-20140
Repository: ambari
Description (updated)
-------
Spark2 and Spark1 shares the same principal name. This casuses a problem when adding Spark2 to a kerberized cluster with Spark1. Ambari doesn't publish the keytab to Spark2 because it thinks it already exists.
Diffs (updated)
-----
ambari-server/src/main/resources/common-services/SPARK2/2.0.0/kerberos.json cf7eeba
ambari-server/src/main/resources/stacks/HDP/2.6/services/SPARK2/kerberos.json 01ee87e
Diff: https://reviews.apache.org/r/56980/diff/4/
Changes: https://reviews.apache.org/r/56980/diff/3-4/
Testing (updated)
-------
- Created a cluster with Spark
- Enabled Kerberos
- Added Spark2
- Checked if Spark2 started successfully
- removed spark
- restarted spark2 successfully, checked the exitance of the spark keytab
Existing tests ran without failure.
Thanks,
Attila Magyar
Re: Review Request 56980: Adding spark2 to a kerberized cluster with
spark1 fails with keytab file does not exist error
Posted by Robert Levas <rl...@hortonworks.com>.
> On March 1, 2017, 2:04 p.m., Alejandro Fernandez wrote:
> > ambari-server/src/main/resources/common-services/SPARK2/2.0.0/kerberos.json
> > Line 18 (original), 18 (patched)
> > <https://reviews.apache.org/r/56980/diff/4/?file=1652641#file1652641line18>
> >
> > I thought Spark2 was supposed to have its own keytab.
Apparently Spark and Spark2 work better if they share the same Kerberos identity. Since Ambari does not handle the same principal name in multiple keytab files, both services need to use the same keytab file - which is preferred since Ambari has to do less work.
- Robert
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/56980/#review167546
-----------------------------------------------------------
On March 1, 2017, 6:18 a.m., Attila Magyar wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/56980/
> -----------------------------------------------------------
>
> (Updated March 1, 2017, 6:18 a.m.)
>
>
> Review request for Ambari, Attila Doroszlai, Bal�zs Bence S�ri, Robert Levas, and Sebastian Toader.
>
>
> Bugs: AMBARI-20140
> https://issues.apache.org/jira/browse/AMBARI-20140
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Spark2 and Spark1 shares the same principal name. This casuses a problem when adding Spark2 to a kerberized cluster with Spark1. Ambari doesn't publish the keytab to Spark2 because it thinks it already exists.
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/common-services/SPARK2/2.0.0/kerberos.json cf7eeba
> ambari-server/src/main/resources/stacks/HDP/2.6/services/SPARK2/kerberos.json 01ee87e
>
>
> Diff: https://reviews.apache.org/r/56980/diff/4/
>
>
> Testing
> -------
>
> - Created a cluster with Spark
> - Enabled Kerberos
> - Added Spark2
> - Checked if Spark2 started successfully
> - removed spark
> - restarted spark2 successfully, checked the exitance of the spark keytab
>
> Existing tests ran without failure.
>
>
> Thanks,
>
> Attila Magyar
>
>
Re: Review Request 56980: Adding spark2 to a kerberized cluster with
spark1 fails with keytab file does not exist error
Posted by Alejandro Fernandez <af...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/56980/#review167546
-----------------------------------------------------------
ambari-server/src/main/resources/common-services/SPARK2/2.0.0/kerberos.json
Line 18 (original), 18 (patched)
<https://reviews.apache.org/r/56980/#comment239424>
I thought Spark2 was supposed to have its own keytab.
- Alejandro Fernandez
On March 1, 2017, 11:18 a.m., Attila Magyar wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/56980/
> -----------------------------------------------------------
>
> (Updated March 1, 2017, 11:18 a.m.)
>
>
> Review request for Ambari, Attila Doroszlai, Bal�zs Bence S�ri, Robert Levas, and Sebastian Toader.
>
>
> Bugs: AMBARI-20140
> https://issues.apache.org/jira/browse/AMBARI-20140
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Spark2 and Spark1 shares the same principal name. This casuses a problem when adding Spark2 to a kerberized cluster with Spark1. Ambari doesn't publish the keytab to Spark2 because it thinks it already exists.
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/common-services/SPARK2/2.0.0/kerberos.json cf7eeba
> ambari-server/src/main/resources/stacks/HDP/2.6/services/SPARK2/kerberos.json 01ee87e
>
>
> Diff: https://reviews.apache.org/r/56980/diff/4/
>
>
> Testing
> -------
>
> - Created a cluster with Spark
> - Enabled Kerberos
> - Added Spark2
> - Checked if Spark2 started successfully
> - removed spark
> - restarted spark2 successfully, checked the exitance of the spark keytab
>
> Existing tests ran without failure.
>
>
> Thanks,
>
> Attila Magyar
>
>
Re: Review Request 56980: Adding spark2 to a kerberized cluster with
spark1 fails with keytab file does not exist error
Posted by Sebastian Toader <st...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/56980/#review167261
-----------------------------------------------------------
Ship it!
Ship It!
- Sebastian Toader
On March 1, 2017, 12:18 p.m., Attila Magyar wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/56980/
> -----------------------------------------------------------
>
> (Updated March 1, 2017, 12:18 p.m.)
>
>
> Review request for Ambari, Attila Doroszlai, Bal�zs Bence S�ri, Robert Levas, and Sebastian Toader.
>
>
> Bugs: AMBARI-20140
> https://issues.apache.org/jira/browse/AMBARI-20140
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Spark2 and Spark1 shares the same principal name. This casuses a problem when adding Spark2 to a kerberized cluster with Spark1. Ambari doesn't publish the keytab to Spark2 because it thinks it already exists.
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/common-services/SPARK2/2.0.0/kerberos.json cf7eeba
> ambari-server/src/main/resources/stacks/HDP/2.6/services/SPARK2/kerberos.json 01ee87e
>
>
> Diff: https://reviews.apache.org/r/56980/diff/4/
>
>
> Testing
> -------
>
> - Created a cluster with Spark
> - Enabled Kerberos
> - Added Spark2
> - Checked if Spark2 started successfully
> - removed spark
> - restarted spark2 successfully, checked the exitance of the spark keytab
>
> Existing tests ran without failure.
>
>
> Thanks,
>
> Attila Magyar
>
>
Re: Review Request 56980: Adding spark2 to a kerberized cluster with
spark1 fails with keytab file does not exist error
Posted by Robert Levas <rl...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/56980/#review167270
-----------------------------------------------------------
Ship it!
Ship It!
- Robert Levas
On March 1, 2017, 6:18 a.m., Attila Magyar wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/56980/
> -----------------------------------------------------------
>
> (Updated March 1, 2017, 6:18 a.m.)
>
>
> Review request for Ambari, Attila Doroszlai, Bal�zs Bence S�ri, Robert Levas, and Sebastian Toader.
>
>
> Bugs: AMBARI-20140
> https://issues.apache.org/jira/browse/AMBARI-20140
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Spark2 and Spark1 shares the same principal name. This casuses a problem when adding Spark2 to a kerberized cluster with Spark1. Ambari doesn't publish the keytab to Spark2 because it thinks it already exists.
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/common-services/SPARK2/2.0.0/kerberos.json cf7eeba
> ambari-server/src/main/resources/stacks/HDP/2.6/services/SPARK2/kerberos.json 01ee87e
>
>
> Diff: https://reviews.apache.org/r/56980/diff/4/
>
>
> Testing
> -------
>
> - Created a cluster with Spark
> - Enabled Kerberos
> - Added Spark2
> - Checked if Spark2 started successfully
> - removed spark
> - restarted spark2 successfully, checked the exitance of the spark keytab
>
> Existing tests ran without failure.
>
>
> Thanks,
>
> Attila Magyar
>
>