You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@ambari.apache.org by Nate Cole <nc...@hortonworks.com> on 2017/09/20 20:51:53 UTC
Review Request 62454: Could not copy tez tarball to HDFS during
prepare upgrade (EU)
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/62454/
-----------------------------------------------------------
Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.
Bugs: AMBARI-22011
https://issues.apache.org/jira/browse/AMBARI-22011
Repository: ambari
Description
-------
The lookup of versions was failing because a property is no longer being passed. Use the UpgradeSummary structure to check for versions. New behavior is consistent with older versions of Ambari.
2017-09-19 11:42:05,742 - Before starting Stack Upgrade, check if tez tarball has been copied to HDFS.
2017-09-19 11:42:05,742 - Stack version 2.6.0.0 is sufficient to check if need to copy tez.tar.gz to HDFS.
2017-09-19 11:42:05,742 - Called copy_to_hdfs tarball: tez
2017-09-19 11:42:05,743 - Stack Feature Version Info: Cluster Stack=2.6, Command Stack=None, Command Version=2.5.3.0-37, Upgrade Direction=upgrade -> 2.5.3.0-37
2017-09-19 11:42:05,743 - Skipping stack-select on RU_EXECUTE_TASKS because it does not exist in the stack-select package structure.
2017-09-19 11:42:05,743 - Unable to determine the current version of the component for this command; unable to copy the tarball
2017-09-19 11:42:05,743 - Cannot copy tez tarball to HDFS because stack version could be be determined.
2017-09-19 11:42:05,743 - Cannot copy tez tarball to HDFS because stack version could be be determined.
2017-09-19 11:42:05,744 - Could not copy tarball tez due to a missing or incorrect parameter.
2017-09-19 11:42:05,744 - Could not copy tarball tez due to a missing or incorrect parameter.
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/TEZ/0.4.0.2.1/package/scripts/pre_upgrade.py", line 58, in <module>
TezPreUpgrade().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 327, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/TEZ/0.4.0.2.1/package/scripts/pre_upgrade.py", line 55, in prepare
raise Fail("Could not copy tez tarball to HDFS.")
resource_management.core.exceptions.Fail: Could not copy tez tarball to HDFS.
Diffs
-----
ambari-common/src/main/python/resource_management/libraries/functions/copy_tarball.py e0dd96de1e
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py 64e1cc1c94
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/OOZIE/package/scripts/oozie.py 8bdfe46230
Diff: https://reviews.apache.org/r/62454/diff/1/
Testing
-------
Manual EU including Tez succeeded. We have no direct tests of copy_tarballs so only manual verification.
Thanks,
Nate Cole
Re: Review Request 62454: Could not copy tez tarball to HDFS during
prepare upgrade (EU)
Posted by Dmitro Lisnichenko <dl...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/62454/#review185866
-----------------------------------------------------------
Ship it!
Ship It!
- Dmitro Lisnichenko
On Sept. 20, 2017, 11:51 p.m., Nate Cole wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/62454/
> -----------------------------------------------------------
>
> (Updated Sept. 20, 2017, 11:51 p.m.)
>
>
> Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.
>
>
> Bugs: AMBARI-22011
> https://issues.apache.org/jira/browse/AMBARI-22011
>
>
> Repository: ambari
>
>
> Description
> -------
>
> The lookup of versions was failing because a property is no longer being passed. Use the UpgradeSummary structure to check for versions. New behavior is consistent with older versions of Ambari.
>
> 2017-09-19 11:42:05,742 - Before starting Stack Upgrade, check if tez tarball has been copied to HDFS.
> 2017-09-19 11:42:05,742 - Stack version 2.6.0.0 is sufficient to check if need to copy tez.tar.gz to HDFS.
> 2017-09-19 11:42:05,742 - Called copy_to_hdfs tarball: tez
> 2017-09-19 11:42:05,743 - Stack Feature Version Info: Cluster Stack=2.6, Command Stack=None, Command Version=2.5.3.0-37, Upgrade Direction=upgrade -> 2.5.3.0-37
> 2017-09-19 11:42:05,743 - Skipping stack-select on RU_EXECUTE_TASKS because it does not exist in the stack-select package structure.
> 2017-09-19 11:42:05,743 - Unable to determine the current version of the component for this command; unable to copy the tarball
> 2017-09-19 11:42:05,743 - Cannot copy tez tarball to HDFS because stack version could be be determined.
> 2017-09-19 11:42:05,743 - Cannot copy tez tarball to HDFS because stack version could be be determined.
> 2017-09-19 11:42:05,744 - Could not copy tarball tez due to a missing or incorrect parameter.
> 2017-09-19 11:42:05,744 - Could not copy tarball tez due to a missing or incorrect parameter.
> Traceback (most recent call last):
> File "/var/lib/ambari-agent/cache/common-services/TEZ/0.4.0.2.1/package/scripts/pre_upgrade.py", line 58, in <module>
> TezPreUpgrade().execute()
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 327, in execute
> method(env)
> File "/var/lib/ambari-agent/cache/common-services/TEZ/0.4.0.2.1/package/scripts/pre_upgrade.py", line 55, in prepare
> raise Fail("Could not copy tez tarball to HDFS.")
> resource_management.core.exceptions.Fail: Could not copy tez tarball to HDFS.
>
>
> Diffs
> -----
>
> ambari-common/src/main/python/resource_management/libraries/functions/copy_tarball.py e0dd96de1e
> ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py 64e1cc1c94
> ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/OOZIE/package/scripts/oozie.py 8bdfe46230
>
>
> Diff: https://reviews.apache.org/r/62454/diff/2/
>
>
> Testing
> -------
>
> Manual EU including Tez succeeded. We have no direct tests of copy_tarballs so only manual verification.
>
>
> Thanks,
>
> Nate Cole
>
>
Re: Review Request 62454: Could not copy tez tarball to HDFS during
prepare upgrade (EU)
Posted by Jonathan Hurley <jh...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/62454/#review185827
-----------------------------------------------------------
Ship it!
Ship It!
- Jonathan Hurley
On Sept. 20, 2017, 4:51 p.m., Nate Cole wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/62454/
> -----------------------------------------------------------
>
> (Updated Sept. 20, 2017, 4:51 p.m.)
>
>
> Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.
>
>
> Bugs: AMBARI-22011
> https://issues.apache.org/jira/browse/AMBARI-22011
>
>
> Repository: ambari
>
>
> Description
> -------
>
> The lookup of versions was failing because a property is no longer being passed. Use the UpgradeSummary structure to check for versions. New behavior is consistent with older versions of Ambari.
>
> 2017-09-19 11:42:05,742 - Before starting Stack Upgrade, check if tez tarball has been copied to HDFS.
> 2017-09-19 11:42:05,742 - Stack version 2.6.0.0 is sufficient to check if need to copy tez.tar.gz to HDFS.
> 2017-09-19 11:42:05,742 - Called copy_to_hdfs tarball: tez
> 2017-09-19 11:42:05,743 - Stack Feature Version Info: Cluster Stack=2.6, Command Stack=None, Command Version=2.5.3.0-37, Upgrade Direction=upgrade -> 2.5.3.0-37
> 2017-09-19 11:42:05,743 - Skipping stack-select on RU_EXECUTE_TASKS because it does not exist in the stack-select package structure.
> 2017-09-19 11:42:05,743 - Unable to determine the current version of the component for this command; unable to copy the tarball
> 2017-09-19 11:42:05,743 - Cannot copy tez tarball to HDFS because stack version could be be determined.
> 2017-09-19 11:42:05,743 - Cannot copy tez tarball to HDFS because stack version could be be determined.
> 2017-09-19 11:42:05,744 - Could not copy tarball tez due to a missing or incorrect parameter.
> 2017-09-19 11:42:05,744 - Could not copy tarball tez due to a missing or incorrect parameter.
> Traceback (most recent call last):
> File "/var/lib/ambari-agent/cache/common-services/TEZ/0.4.0.2.1/package/scripts/pre_upgrade.py", line 58, in <module>
> TezPreUpgrade().execute()
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 327, in execute
> method(env)
> File "/var/lib/ambari-agent/cache/common-services/TEZ/0.4.0.2.1/package/scripts/pre_upgrade.py", line 55, in prepare
> raise Fail("Could not copy tez tarball to HDFS.")
> resource_management.core.exceptions.Fail: Could not copy tez tarball to HDFS.
>
>
> Diffs
> -----
>
> ambari-common/src/main/python/resource_management/libraries/functions/copy_tarball.py e0dd96de1e
> ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py 64e1cc1c94
> ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/OOZIE/package/scripts/oozie.py 8bdfe46230
>
>
> Diff: https://reviews.apache.org/r/62454/diff/2/
>
>
> Testing
> -------
>
> Manual EU including Tez succeeded. We have no direct tests of copy_tarballs so only manual verification.
>
>
> Thanks,
>
> Nate Cole
>
>