You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Alejandro Fernandez <af...@hortonworks.com> on 2015/03/03 02:21:31 UTC
Review Request 31654: Pig Service check fails in a Kerberized cluster
due to missing tarball in HDFS
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31654/
-----------------------------------------------------------
Review request for Ambari, Jonathan Hurley, Nate Cole, Sid Wagle, and Tom Beerbower.
Bugs: AMBARI-9882
https://issues.apache.org/jira/browse/AMBARI-9882
Repository: ambari
Description
-------
Deployed a cluster with HDFS, Mapreduce2, Yarn, Tez, Pig, Zookeeper, Ambari Metrics, Kafka.
Enable security.
After enable security Pig service check fails because tez.tar.gz is missing in HDFS.
Diffs
-----
ambari-common/src/main/python/resource_management/libraries/functions/dynamic_variable_interpretation.py 7cb8e06
ambari-common/src/main/python/resource_management/libraries/providers/copy_from_local.py 26d56f6
ambari-common/src/main/python/resource_management/libraries/resources/copy_from_local.py 54d003e
ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/params.py 3e70d57
ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/service_check.py 7137e60
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py 0afefaf
ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/params.py 79af022
ambari-server/src/test/python/stacks/2.2/PIG/test_pig_service_check.py PRE-CREATION
ambari-server/src/test/python/stacks/2.2/configs/pig-service-check-secure.json PRE-CREATION
Diff: https://reviews.apache.org/r/31654/diff/
Testing
-------
Ran unit tests, and added one.
----------------------------------------------------------------------
Total run:609
Total errors:0
Total failures:0
OK
Deployed a 3-node cluster with the minimal services, enabled Kerberos, then added Pig, copied changed scripts, and the Pig service check passed.
Then performed an RU, which passed.
Thanks,
Alejandro Fernandez
Re: Review Request 31654: Pig Service check fails in a Kerberized
cluster due to missing tarball in HDFS
Posted by Tom Beerbower <tb...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31654/#review74932
-----------------------------------------------------------
Ship it!
Ship It!
- Tom Beerbower
On March 3, 2015, 1:21 a.m., Alejandro Fernandez wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/31654/
> -----------------------------------------------------------
>
> (Updated March 3, 2015, 1:21 a.m.)
>
>
> Review request for Ambari, Jonathan Hurley, Nate Cole, Sid Wagle, and Tom Beerbower.
>
>
> Bugs: AMBARI-9882
> https://issues.apache.org/jira/browse/AMBARI-9882
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Deployed a cluster with HDFS, Mapreduce2, Yarn, Tez, Pig, Zookeeper, Ambari Metrics, Kafka.
> Enable security.
> After enable security Pig service check fails because tez.tar.gz is missing in HDFS.
>
>
> Diffs
> -----
>
> ambari-common/src/main/python/resource_management/libraries/functions/dynamic_variable_interpretation.py 7cb8e06
> ambari-common/src/main/python/resource_management/libraries/providers/copy_from_local.py 26d56f6
> ambari-common/src/main/python/resource_management/libraries/resources/copy_from_local.py 54d003e
> ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/params.py 3e70d57
> ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/service_check.py 7137e60
> ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py 0afefaf
> ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/params.py 79af022
> ambari-server/src/test/python/stacks/2.2/PIG/test_pig_service_check.py PRE-CREATION
> ambari-server/src/test/python/stacks/2.2/configs/pig-service-check-secure.json PRE-CREATION
>
> Diff: https://reviews.apache.org/r/31654/diff/
>
>
> Testing
> -------
>
> Ran unit tests, and added one.
> ----------------------------------------------------------------------
> Total run:609
> Total errors:0
> Total failures:0
> OK
>
> Deployed a 3-node cluster with the minimal services, enabled Kerberos, then added Pig, copied changed scripts, and the Pig service check passed.
> Then performed an RU, which passed.
>
>
> Thanks,
>
> Alejandro Fernandez
>
>
Re: Review Request 31654: Pig Service check fails in a Kerberized
cluster due to missing tarball in HDFS
Posted by Sid Wagle <sw...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31654/#review75122
-----------------------------------------------------------
Ship it!
Ship It!
- Sid Wagle
On March 4, 2015, 12:39 a.m., Alejandro Fernandez wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/31654/
> -----------------------------------------------------------
>
> (Updated March 4, 2015, 12:39 a.m.)
>
>
> Review request for Ambari, Jonathan Hurley, Nate Cole, Sid Wagle, and Tom Beerbower.
>
>
> Bugs: AMBARI-9882
> https://issues.apache.org/jira/browse/AMBARI-9882
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Deployed a cluster with HDFS, Mapreduce2, Yarn, Tez, Pig, Zookeeper, Ambari Metrics, Kafka.
> Enable security.
> After enable security Pig service check fails because tez.tar.gz is missing in HDFS.
>
>
> Diffs
> -----
>
> ambari-common/src/main/python/resource_management/libraries/functions/dynamic_variable_interpretation.py 7cb8e06
> ambari-common/src/main/python/resource_management/libraries/providers/copy_from_local.py 26d56f6
> ambari-common/src/main/python/resource_management/libraries/resources/copy_from_local.py 54d003e
> ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/params.py 3e70d57
> ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/service_check.py 7137e60
> ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py 0afefaf
> ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/params.py 79af022
> ambari-server/src/test/python/stacks/2.2/PIG/test_pig_service_check.py PRE-CREATION
> ambari-server/src/test/python/stacks/2.2/configs/pig-service-check-secure.json PRE-CREATION
>
> Diff: https://reviews.apache.org/r/31654/diff/
>
>
> Testing
> -------
>
> Ran unit tests, and added one.
> ----------------------------------------------------------------------
> Total run:609
> Total errors:0
> Total failures:0
> OK
>
> Deployed a 3-node cluster with the minimal services, enabled Kerberos, then added Pig, copied changed scripts, and the Pig service check passed.
> Then performed an RU, which passed.
>
>
> Thanks,
>
> Alejandro Fernandez
>
>
Re: Review Request 31654: Pig Service check fails in a Kerberized
cluster due to missing tarball in HDFS
Posted by Alejandro Fernandez <af...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31654/
-----------------------------------------------------------
(Updated March 4, 2015, 12:39 a.m.)
Review request for Ambari, Jonathan Hurley, Nate Cole, Sid Wagle, and Tom Beerbower.
Changes
-------
Fixed bug when re-tested with a brand new cluster install.
Bugs: AMBARI-9882
https://issues.apache.org/jira/browse/AMBARI-9882
Repository: ambari
Description
-------
Deployed a cluster with HDFS, Mapreduce2, Yarn, Tez, Pig, Zookeeper, Ambari Metrics, Kafka.
Enable security.
After enable security Pig service check fails because tez.tar.gz is missing in HDFS.
Diffs (updated)
-----
ambari-common/src/main/python/resource_management/libraries/functions/dynamic_variable_interpretation.py 7cb8e06
ambari-common/src/main/python/resource_management/libraries/providers/copy_from_local.py 26d56f6
ambari-common/src/main/python/resource_management/libraries/resources/copy_from_local.py 54d003e
ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/params.py 3e70d57
ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/service_check.py 7137e60
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py 0afefaf
ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/params.py 79af022
ambari-server/src/test/python/stacks/2.2/PIG/test_pig_service_check.py PRE-CREATION
ambari-server/src/test/python/stacks/2.2/configs/pig-service-check-secure.json PRE-CREATION
Diff: https://reviews.apache.org/r/31654/diff/
Testing
-------
Ran unit tests, and added one.
----------------------------------------------------------------------
Total run:609
Total errors:0
Total failures:0
OK
Deployed a 3-node cluster with the minimal services, enabled Kerberos, then added Pig, copied changed scripts, and the Pig service check passed.
Then performed an RU, which passed.
Thanks,
Alejandro Fernandez
Re: Review Request 31654: Pig Service check fails in a Kerberized
cluster due to missing tarball in HDFS
Posted by Sid Wagle <sw...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31654/#review74877
-----------------------------------------------------------
Ship it!
Ship It!
- Sid Wagle
On March 3, 2015, 1:21 a.m., Alejandro Fernandez wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/31654/
> -----------------------------------------------------------
>
> (Updated March 3, 2015, 1:21 a.m.)
>
>
> Review request for Ambari, Jonathan Hurley, Nate Cole, Sid Wagle, and Tom Beerbower.
>
>
> Bugs: AMBARI-9882
> https://issues.apache.org/jira/browse/AMBARI-9882
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Deployed a cluster with HDFS, Mapreduce2, Yarn, Tez, Pig, Zookeeper, Ambari Metrics, Kafka.
> Enable security.
> After enable security Pig service check fails because tez.tar.gz is missing in HDFS.
>
>
> Diffs
> -----
>
> ambari-common/src/main/python/resource_management/libraries/functions/dynamic_variable_interpretation.py 7cb8e06
> ambari-common/src/main/python/resource_management/libraries/providers/copy_from_local.py 26d56f6
> ambari-common/src/main/python/resource_management/libraries/resources/copy_from_local.py 54d003e
> ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/params.py 3e70d57
> ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/service_check.py 7137e60
> ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py 0afefaf
> ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/params.py 79af022
> ambari-server/src/test/python/stacks/2.2/PIG/test_pig_service_check.py PRE-CREATION
> ambari-server/src/test/python/stacks/2.2/configs/pig-service-check-secure.json PRE-CREATION
>
> Diff: https://reviews.apache.org/r/31654/diff/
>
>
> Testing
> -------
>
> Ran unit tests, and added one.
> ----------------------------------------------------------------------
> Total run:609
> Total errors:0
> Total failures:0
> OK
>
> Deployed a 3-node cluster with the minimal services, enabled Kerberos, then added Pig, copied changed scripts, and the Pig service check passed.
> Then performed an RU, which passed.
>
>
> Thanks,
>
> Alejandro Fernandez
>
>
Re: Review Request 31654: Pig Service check fails in a Kerberized
cluster due to missing tarball in HDFS
Posted by Alejandro Fernandez <af...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31654/#review74869
-----------------------------------------------------------
ambari-common/src/main/python/resource_management/libraries/providers/copy_from_local.py
<https://reviews.apache.org/r/31654/#comment121682>
Originally, owner was "hdfs@EXAMPLE.COM", which is not a system user. So we need to perform kinit commands as ambari-qa instead.
ambari-server/src/test/python/stacks/2.2/PIG/test_pig_service_check.py
<https://reviews.apache.org/r/31654/#comment121683>
Make sure that copy_tarball_to_hdfs is called.
- Alejandro Fernandez
On March 3, 2015, 1:21 a.m., Alejandro Fernandez wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/31654/
> -----------------------------------------------------------
>
> (Updated March 3, 2015, 1:21 a.m.)
>
>
> Review request for Ambari, Jonathan Hurley, Nate Cole, Sid Wagle, and Tom Beerbower.
>
>
> Bugs: AMBARI-9882
> https://issues.apache.org/jira/browse/AMBARI-9882
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Deployed a cluster with HDFS, Mapreduce2, Yarn, Tez, Pig, Zookeeper, Ambari Metrics, Kafka.
> Enable security.
> After enable security Pig service check fails because tez.tar.gz is missing in HDFS.
>
>
> Diffs
> -----
>
> ambari-common/src/main/python/resource_management/libraries/functions/dynamic_variable_interpretation.py 7cb8e06
> ambari-common/src/main/python/resource_management/libraries/providers/copy_from_local.py 26d56f6
> ambari-common/src/main/python/resource_management/libraries/resources/copy_from_local.py 54d003e
> ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/params.py 3e70d57
> ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/service_check.py 7137e60
> ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py 0afefaf
> ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/params.py 79af022
> ambari-server/src/test/python/stacks/2.2/PIG/test_pig_service_check.py PRE-CREATION
> ambari-server/src/test/python/stacks/2.2/configs/pig-service-check-secure.json PRE-CREATION
>
> Diff: https://reviews.apache.org/r/31654/diff/
>
>
> Testing
> -------
>
> Ran unit tests, and added one.
> ----------------------------------------------------------------------
> Total run:609
> Total errors:0
> Total failures:0
> OK
>
> Deployed a 3-node cluster with the minimal services, enabled Kerberos, then added Pig, copied changed scripts, and the Pig service check passed.
> Then performed an RU, which passed.
>
>
> Thanks,
>
> Alejandro Fernandez
>
>
Re: Review Request 31654: Pig Service check fails in a Kerberized
cluster due to missing tarball in HDFS
Posted by Jonathan Hurley <jh...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31654/#review74948
-----------------------------------------------------------
Ship it!
Ship It!
- Jonathan Hurley
On March 2, 2015, 8:21 p.m., Alejandro Fernandez wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/31654/
> -----------------------------------------------------------
>
> (Updated March 2, 2015, 8:21 p.m.)
>
>
> Review request for Ambari, Jonathan Hurley, Nate Cole, Sid Wagle, and Tom Beerbower.
>
>
> Bugs: AMBARI-9882
> https://issues.apache.org/jira/browse/AMBARI-9882
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Deployed a cluster with HDFS, Mapreduce2, Yarn, Tez, Pig, Zookeeper, Ambari Metrics, Kafka.
> Enable security.
> After enable security Pig service check fails because tez.tar.gz is missing in HDFS.
>
>
> Diffs
> -----
>
> ambari-common/src/main/python/resource_management/libraries/functions/dynamic_variable_interpretation.py 7cb8e06
> ambari-common/src/main/python/resource_management/libraries/providers/copy_from_local.py 26d56f6
> ambari-common/src/main/python/resource_management/libraries/resources/copy_from_local.py 54d003e
> ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/params.py 3e70d57
> ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/service_check.py 7137e60
> ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py 0afefaf
> ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/params.py 79af022
> ambari-server/src/test/python/stacks/2.2/PIG/test_pig_service_check.py PRE-CREATION
> ambari-server/src/test/python/stacks/2.2/configs/pig-service-check-secure.json PRE-CREATION
>
> Diff: https://reviews.apache.org/r/31654/diff/
>
>
> Testing
> -------
>
> Ran unit tests, and added one.
> ----------------------------------------------------------------------
> Total run:609
> Total errors:0
> Total failures:0
> OK
>
> Deployed a 3-node cluster with the minimal services, enabled Kerberos, then added Pig, copied changed scripts, and the Pig service check passed.
> Then performed an RU, which passed.
>
>
> Thanks,
>
> Alejandro Fernandez
>
>