You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Dmytro Sen <ds...@hortonworks.com> on 2014/04/06 22:32:37 UTC
Review Request 20068: HDP 2.1 install leaves deprecated params in
mapred-site.xml, causes Hive failure
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20068/
-----------------------------------------------------------
Review request for Ambari and Mahadev Konar.
Bugs: AMBARI-5368
https://issues.apache.org/jira/browse/AMBARI-5368
Repository: ambari
Description
-------
If Ambari 1.5.0 to install HDP 2.1, Hive fails. Tracing leads to a pair of deprecated params in mapred-site.xml. Removing the two params caused the Hive problem to go away.
Mapred-site.xml having both new and deprecated properties. After deleting deprecated property hive works as expected.
(ref: http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/DeprecatedProperties.html)
| mapred.map.child.java.opts | mapreduce.map.java.opts |
| mapred.reduce.child.java.opts | mapreduce.reduce.java.opts |
The problem is eliminated if I execute the following after installation:
sh /var/lib/ambari-server/resources/scripts/configs.sh -u admin -p admin -port 8081 delete localhost c1 mapred-site mapred.map.child.java.optssh /var/lib/ambari-server/resources/scripts/configs.sh -u admin -p admin -port 8081 delete localhost c1 mapred-site mapred.reduce.child.java.opts
Diffs
-----
ambari-server/src/main/resources/stacks/HDP/2.1/services/FALCON/metainfo.xml 5d1a1c4
ambari-server/src/main/resources/stacks/HDP/2.1/services/HDFS/metainfo.xml 8152113
ambari-server/src/main/resources/stacks/HDP/2.1/services/HIVE/configuration/mapred-site.xml a8fc002
ambari-server/src/main/resources/stacks/HDP/2.1/services/OOZIE/metainfo.xml e8c31f9
ambari-server/src/main/resources/stacks/HDP/2.1/services/SQOOP/metainfo.xml 5381eab
ambari-server/src/main/resources/stacks/HDP/2.1/services/YARN/metainfo.xml f805d3d
Diff: https://reviews.apache.org/r/20068/diff/
Testing
-------
[INFO] Reactor Summary:
[INFO]
[INFO] Ambari Main ....................................... SUCCESS [1.438s]
[INFO] Apache Ambari Project POM ......................... SUCCESS [0.227s]
[INFO] Ambari Web ........................................ SUCCESS [14.664s]
[INFO] Ambari Views ...................................... SUCCESS [2.645s]
[INFO] Ambari Server ..................................... SUCCESS [15:13.997s]
[INFO] Ambari Agent ...................................... SUCCESS [27.405s]
[INFO] Ambari Client ..................................... SUCCESS [1.481s]
Thanks,
Dmytro Sen
Re: Review Request 20068: HDP 2.1 install leaves deprecated params in
mapred-site.xml, causes Hive failure
Posted by Mahadev Konar <ma...@apache.org>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20068/#review39650
-----------------------------------------------------------
Ship it!
Ship It!
- Mahadev Konar
On April 6, 2014, 8:32 p.m., Dmytro Sen wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/20068/
> -----------------------------------------------------------
>
> (Updated April 6, 2014, 8:32 p.m.)
>
>
> Review request for Ambari and Mahadev Konar.
>
>
> Bugs: AMBARI-5368
> https://issues.apache.org/jira/browse/AMBARI-5368
>
>
> Repository: ambari
>
>
> Description
> -------
>
> If Ambari 1.5.0 to install HDP 2.1, Hive fails. Tracing leads to a pair of deprecated params in mapred-site.xml. Removing the two params caused the Hive problem to go away.
>
> Mapred-site.xml having both new and deprecated properties. After deleting deprecated property hive works as expected.
>
> (ref: http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/DeprecatedProperties.html)
>
> | mapred.map.child.java.opts | mapreduce.map.java.opts |
> | mapred.reduce.child.java.opts | mapreduce.reduce.java.opts |
>
>
> The problem is eliminated if I execute the following after installation:
>
> sh /var/lib/ambari-server/resources/scripts/configs.sh -u admin -p admin -port 8081 delete localhost c1 mapred-site mapred.map.child.java.optssh /var/lib/ambari-server/resources/scripts/configs.sh -u admin -p admin -port 8081 delete localhost c1 mapred-site mapred.reduce.child.java.opts
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/stacks/HDP/2.1/services/FALCON/metainfo.xml 5d1a1c4
> ambari-server/src/main/resources/stacks/HDP/2.1/services/HDFS/metainfo.xml 8152113
> ambari-server/src/main/resources/stacks/HDP/2.1/services/HIVE/configuration/mapred-site.xml a8fc002
> ambari-server/src/main/resources/stacks/HDP/2.1/services/OOZIE/metainfo.xml e8c31f9
> ambari-server/src/main/resources/stacks/HDP/2.1/services/SQOOP/metainfo.xml 5381eab
> ambari-server/src/main/resources/stacks/HDP/2.1/services/YARN/metainfo.xml f805d3d
>
> Diff: https://reviews.apache.org/r/20068/diff/
>
>
> Testing
> -------
>
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Ambari Main ....................................... SUCCESS [1.438s]
> [INFO] Apache Ambari Project POM ......................... SUCCESS [0.227s]
> [INFO] Ambari Web ........................................ SUCCESS [14.664s]
> [INFO] Ambari Views ...................................... SUCCESS [2.645s]
> [INFO] Ambari Server ..................................... SUCCESS [15:13.997s]
> [INFO] Ambari Agent ...................................... SUCCESS [27.405s]
> [INFO] Ambari Client ..................................... SUCCESS [1.481s]
>
>
> Thanks,
>
> Dmytro Sen
>
>