You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@ambari.apache.org by Nate Cole <nc...@hortonworks.com> on 2017/09/20 20:51:53 UTC

Review Request 62454: Could not copy tez tarball to HDFS during prepare upgrade (EU)

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/62454/
-----------------------------------------------------------

Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.


Bugs: AMBARI-22011
    https://issues.apache.org/jira/browse/AMBARI-22011


Repository: ambari


Description
-------

The lookup of versions was failing because a property is no longer being passed.  Use the UpgradeSummary structure to check for versions.  New behavior is consistent with older versions of Ambari.

2017-09-19 11:42:05,742 - Before starting Stack Upgrade, check if tez tarball has been copied to HDFS.
2017-09-19 11:42:05,742 - Stack version 2.6.0.0 is sufficient to check if need to copy tez.tar.gz to HDFS.
2017-09-19 11:42:05,742 - Called copy_to_hdfs tarball: tez
2017-09-19 11:42:05,743 - Stack Feature Version Info: Cluster Stack=2.6, Command Stack=None, Command Version=2.5.3.0-37, Upgrade Direction=upgrade -> 2.5.3.0-37
2017-09-19 11:42:05,743 - Skipping stack-select on RU_EXECUTE_TASKS because it does not exist in the stack-select package structure.
2017-09-19 11:42:05,743 - Unable to determine the current version of the component for this command; unable to copy the tarball
2017-09-19 11:42:05,743 - Cannot copy tez tarball to HDFS because stack version could be be determined.
2017-09-19 11:42:05,743 - Cannot copy tez tarball to HDFS because stack version could be be determined.
2017-09-19 11:42:05,744 - Could not copy tarball tez due to a missing or incorrect parameter.
2017-09-19 11:42:05,744 - Could not copy tarball tez due to a missing or incorrect parameter.
Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/TEZ/0.4.0.2.1/package/scripts/pre_upgrade.py", line 58, in <module>
    TezPreUpgrade().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 327, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/TEZ/0.4.0.2.1/package/scripts/pre_upgrade.py", line 55, in prepare
    raise Fail("Could not copy tez tarball to HDFS.")
resource_management.core.exceptions.Fail: Could not copy tez tarball to HDFS.


Diffs
-----

  ambari-common/src/main/python/resource_management/libraries/functions/copy_tarball.py e0dd96de1e 
  ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py 64e1cc1c94 
  ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/OOZIE/package/scripts/oozie.py 8bdfe46230 


Diff: https://reviews.apache.org/r/62454/diff/1/


Testing
-------

Manual EU including Tez succeeded.  We have no direct tests of copy_tarballs so only manual verification.


Thanks,

Nate Cole


Re: Review Request 62454: Could not copy tez tarball to HDFS during prepare upgrade (EU)

Posted by Dmitro Lisnichenko <dl...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/62454/#review185866
-----------------------------------------------------------


Ship it!




Ship It!

- Dmitro Lisnichenko


On Sept. 20, 2017, 11:51 p.m., Nate Cole wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/62454/
> -----------------------------------------------------------
> 
> (Updated Sept. 20, 2017, 11:51 p.m.)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.
> 
> 
> Bugs: AMBARI-22011
>     https://issues.apache.org/jira/browse/AMBARI-22011
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> The lookup of versions was failing because a property is no longer being passed.  Use the UpgradeSummary structure to check for versions.  New behavior is consistent with older versions of Ambari.
> 
> 2017-09-19 11:42:05,742 - Before starting Stack Upgrade, check if tez tarball has been copied to HDFS.
> 2017-09-19 11:42:05,742 - Stack version 2.6.0.0 is sufficient to check if need to copy tez.tar.gz to HDFS.
> 2017-09-19 11:42:05,742 - Called copy_to_hdfs tarball: tez
> 2017-09-19 11:42:05,743 - Stack Feature Version Info: Cluster Stack=2.6, Command Stack=None, Command Version=2.5.3.0-37, Upgrade Direction=upgrade -> 2.5.3.0-37
> 2017-09-19 11:42:05,743 - Skipping stack-select on RU_EXECUTE_TASKS because it does not exist in the stack-select package structure.
> 2017-09-19 11:42:05,743 - Unable to determine the current version of the component for this command; unable to copy the tarball
> 2017-09-19 11:42:05,743 - Cannot copy tez tarball to HDFS because stack version could be be determined.
> 2017-09-19 11:42:05,743 - Cannot copy tez tarball to HDFS because stack version could be be determined.
> 2017-09-19 11:42:05,744 - Could not copy tarball tez due to a missing or incorrect parameter.
> 2017-09-19 11:42:05,744 - Could not copy tarball tez due to a missing or incorrect parameter.
> Traceback (most recent call last):
>   File "/var/lib/ambari-agent/cache/common-services/TEZ/0.4.0.2.1/package/scripts/pre_upgrade.py", line 58, in <module>
>     TezPreUpgrade().execute()
>   File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 327, in execute
>     method(env)
>   File "/var/lib/ambari-agent/cache/common-services/TEZ/0.4.0.2.1/package/scripts/pre_upgrade.py", line 55, in prepare
>     raise Fail("Could not copy tez tarball to HDFS.")
> resource_management.core.exceptions.Fail: Could not copy tez tarball to HDFS.
> 
> 
> Diffs
> -----
> 
>   ambari-common/src/main/python/resource_management/libraries/functions/copy_tarball.py e0dd96de1e 
>   ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py 64e1cc1c94 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/OOZIE/package/scripts/oozie.py 8bdfe46230 
> 
> 
> Diff: https://reviews.apache.org/r/62454/diff/2/
> 
> 
> Testing
> -------
> 
> Manual EU including Tez succeeded.  We have no direct tests of copy_tarballs so only manual verification.
> 
> 
> Thanks,
> 
> Nate Cole
> 
>


Re: Review Request 62454: Could not copy tez tarball to HDFS during prepare upgrade (EU)

Posted by Jonathan Hurley <jh...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/62454/#review185827
-----------------------------------------------------------


Ship it!




Ship It!

- Jonathan Hurley


On Sept. 20, 2017, 4:51 p.m., Nate Cole wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/62454/
> -----------------------------------------------------------
> 
> (Updated Sept. 20, 2017, 4:51 p.m.)
> 
> 
> Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.
> 
> 
> Bugs: AMBARI-22011
>     https://issues.apache.org/jira/browse/AMBARI-22011
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> The lookup of versions was failing because a property is no longer being passed.  Use the UpgradeSummary structure to check for versions.  New behavior is consistent with older versions of Ambari.
> 
> 2017-09-19 11:42:05,742 - Before starting Stack Upgrade, check if tez tarball has been copied to HDFS.
> 2017-09-19 11:42:05,742 - Stack version 2.6.0.0 is sufficient to check if need to copy tez.tar.gz to HDFS.
> 2017-09-19 11:42:05,742 - Called copy_to_hdfs tarball: tez
> 2017-09-19 11:42:05,743 - Stack Feature Version Info: Cluster Stack=2.6, Command Stack=None, Command Version=2.5.3.0-37, Upgrade Direction=upgrade -> 2.5.3.0-37
> 2017-09-19 11:42:05,743 - Skipping stack-select on RU_EXECUTE_TASKS because it does not exist in the stack-select package structure.
> 2017-09-19 11:42:05,743 - Unable to determine the current version of the component for this command; unable to copy the tarball
> 2017-09-19 11:42:05,743 - Cannot copy tez tarball to HDFS because stack version could be be determined.
> 2017-09-19 11:42:05,743 - Cannot copy tez tarball to HDFS because stack version could be be determined.
> 2017-09-19 11:42:05,744 - Could not copy tarball tez due to a missing or incorrect parameter.
> 2017-09-19 11:42:05,744 - Could not copy tarball tez due to a missing or incorrect parameter.
> Traceback (most recent call last):
>   File "/var/lib/ambari-agent/cache/common-services/TEZ/0.4.0.2.1/package/scripts/pre_upgrade.py", line 58, in <module>
>     TezPreUpgrade().execute()
>   File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 327, in execute
>     method(env)
>   File "/var/lib/ambari-agent/cache/common-services/TEZ/0.4.0.2.1/package/scripts/pre_upgrade.py", line 55, in prepare
>     raise Fail("Could not copy tez tarball to HDFS.")
> resource_management.core.exceptions.Fail: Could not copy tez tarball to HDFS.
> 
> 
> Diffs
> -----
> 
>   ambari-common/src/main/python/resource_management/libraries/functions/copy_tarball.py e0dd96de1e 
>   ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie.py 64e1cc1c94 
>   ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/OOZIE/package/scripts/oozie.py 8bdfe46230 
> 
> 
> Diff: https://reviews.apache.org/r/62454/diff/2/
> 
> 
> Testing
> -------
> 
> Manual EU including Tez succeeded.  We have no direct tests of copy_tarballs so only manual verification.
> 
> 
> Thanks,
> 
> Nate Cole
> 
>