You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Dmytro Sen <ds...@hortonworks.com> on 2014/10/29 14:52:27 UTC
Review Request 27328: Cannot run hive tez query using HDP 2.1 stack
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27328/
-----------------------------------------------------------
Review request for Ambari, Alejandro Fernandez, Andrew Onischuk, and Mahadev Konar.
Bugs: AMBARI-8016
https://issues.apache.org/jira/browse/AMBARI-8016
Repository: ambari
Description
-------
[root@c6401 views]# ambari-server --hash
5e1796a9d8d32eeaa24f13d29b81c437fef5acd8
1) Install HDP 2.1 (hdfs, yarn, mr, tez, zk, hive)
2) set Hive engine to tez
3) attempt to run hive query, get the error below;
[root@c6401 yum.repos.d]# su - hive
[hive@c6401 ~]$ cd /tmp
[hive@c6401 tmp]$ wget http://seanlahman.com/files/database/lahman591-csv.zip
--2014-10-29 01:28:52-- http://seanlahman.com/files/database/lahman591-csv.zip
Resolving seanlahman.com... 208.113.136.74
Connecting to seanlahman.com|208.113.136.74|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 8337421 (8.0M) [application/zip]
Saving to: “lahman591-csv.zip”
100%[======================================>] 8,337,421 3.45M/s in 2.3s
2014-10-29 01:28:54 (3.45 MB/s) - “lahman591-csv.zip” saved [8337421/8337421]
[hive@c6401 tmp]$ unzip lahman591-csv.zip
Archive: lahman591-csv.zip
inflating: Managers.csv
inflating: ManagersHalf.csv
inflating: Pitching.csv
inflating: Salaries.csv
inflating: Schools.csv
inflating: SchoolsPlayers.csv
inflating: Teams.csv
inflating: TeamsFranchises.csv
inflating: TeamsHalf.csv
inflating: AllstarFull.csv
inflating: AwardsManagers.csv
inflating: AwardsPlayers.csv
inflating: AwardsShareManagers.csv
inflating: AwardsSharePlayers.csv
inflating: Batting.csv
inflating: Fielding.csv
inflating: FieldingOF.csv
inflating: readme59.txt
inflating: Master.csv
inflating: FieldingPost.csv
inflating: HallOfFame.csv
inflating: Appearances.csv
inflating: PitchingPost.csv
inflating: BattingPost.csv
inflating: SeriesPost.csv
[hive@c6401 tmp]$ hadoop fs -copyFromLocal Schools.csv /tmp
[hive@c6401 tmp]$ hive
Logging initialized using configuration in file:/etc/hive/conf.dist/hive-log4j.properties
Exception in thread "main" java.lang.RuntimeException: java.io.FileNotFoundException: File does not exist: hdfs://c6401.ambari.apache.org:8020/apps/tez
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:358)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
Caused by: java.io.FileNotFoundException: File does not exist: hdfs://c6401.ambari.apache.org:8020/apps/tez
at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1128
Diffs
-----
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive_server.py 4e55cfb
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/install_jars.py PRE-CREATION
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py 2bfbdc1
ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py 0abc438
Diff: https://reviews.apache.org/r/27328/diff/
Testing
-------
manual deployment
+
Ran 242 tests in 3.754s
OK
----------------------------------------------------------------------
Total run:679
Total errors:0
Total failures:0
OK
Thanks,
Dmytro Sen
Re: Review Request 27328: Cannot run hive tez query using HDP 2.1
stack
Posted by Andrew Onischuk <ao...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27328/#review58984
-----------------------------------------------------------
Ship it!
Ship It!
- Andrew Onischuk
On Oct. 29, 2014, 1:52 p.m., Dmytro Sen wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/27328/
> -----------------------------------------------------------
>
> (Updated Oct. 29, 2014, 1:52 p.m.)
>
>
> Review request for Ambari, Alejandro Fernandez, Andrew Onischuk, and Mahadev Konar.
>
>
> Bugs: AMBARI-8016
> https://issues.apache.org/jira/browse/AMBARI-8016
>
>
> Repository: ambari
>
>
> Description
> -------
>
> [root@c6401 views]# ambari-server --hash
> 5e1796a9d8d32eeaa24f13d29b81c437fef5acd8
> 1) Install HDP 2.1 (hdfs, yarn, mr, tez, zk, hive)
> 2) set Hive engine to tez
> 3) attempt to run hive query, get the error below;
> [root@c6401 yum.repos.d]# su - hive
> [hive@c6401 ~]$ cd /tmp
> [hive@c6401 tmp]$ wget http://seanlahman.com/files/database/lahman591-csv.zip
> --2014-10-29 01:28:52-- http://seanlahman.com/files/database/lahman591-csv.zip
> Resolving seanlahman.com... 208.113.136.74
> Connecting to seanlahman.com|208.113.136.74|:80... connected.
> HTTP request sent, awaiting response... 200 OK
> Length: 8337421 (8.0M) [application/zip]
> Saving to: “lahman591-csv.zip”
>
> 100%[======================================>] 8,337,421 3.45M/s in 2.3s
>
> 2014-10-29 01:28:54 (3.45 MB/s) - “lahman591-csv.zip” saved [8337421/8337421]
>
> [hive@c6401 tmp]$ unzip lahman591-csv.zip
> Archive: lahman591-csv.zip
> inflating: Managers.csv
> inflating: ManagersHalf.csv
> inflating: Pitching.csv
> inflating: Salaries.csv
> inflating: Schools.csv
> inflating: SchoolsPlayers.csv
> inflating: Teams.csv
> inflating: TeamsFranchises.csv
> inflating: TeamsHalf.csv
> inflating: AllstarFull.csv
> inflating: AwardsManagers.csv
> inflating: AwardsPlayers.csv
> inflating: AwardsShareManagers.csv
> inflating: AwardsSharePlayers.csv
> inflating: Batting.csv
> inflating: Fielding.csv
> inflating: FieldingOF.csv
> inflating: readme59.txt
> inflating: Master.csv
> inflating: FieldingPost.csv
> inflating: HallOfFame.csv
> inflating: Appearances.csv
> inflating: PitchingPost.csv
> inflating: BattingPost.csv
> inflating: SeriesPost.csv
> [hive@c6401 tmp]$ hadoop fs -copyFromLocal Schools.csv /tmp
> [hive@c6401 tmp]$ hive
>
> Logging initialized using configuration in file:/etc/hive/conf.dist/hive-log4j.properties
> Exception in thread "main" java.lang.RuntimeException: java.io.FileNotFoundException: File does not exist: hdfs://c6401.ambari.apache.org:8020/apps/tez
> at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:358)
> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
> Caused by: java.io.FileNotFoundException: File does not exist: hdfs://c6401.ambari.apache.org:8020/apps/tez
> at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1128
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive_server.py 4e55cfb
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/install_jars.py PRE-CREATION
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py 2bfbdc1
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py 0abc438
>
> Diff: https://reviews.apache.org/r/27328/diff/
>
>
> Testing
> -------
>
> manual deployment
>
> +
>
> Ran 242 tests in 3.754s
>
> OK
> ----------------------------------------------------------------------
> Total run:679
> Total errors:0
> Total failures:0
> OK
>
>
> Thanks,
>
> Dmytro Sen
>
>
Re: Review Request 27328: Cannot run hive tez query using HDP 2.1
stack
Posted by Alejandro Fernandez <af...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27328/#review59002
-----------------------------------------------------------
Ship it!
Ship It!
- Alejandro Fernandez
On Oct. 29, 2014, 1:52 p.m., Dmytro Sen wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/27328/
> -----------------------------------------------------------
>
> (Updated Oct. 29, 2014, 1:52 p.m.)
>
>
> Review request for Ambari, Alejandro Fernandez, Andrew Onischuk, and Mahadev Konar.
>
>
> Bugs: AMBARI-8016
> https://issues.apache.org/jira/browse/AMBARI-8016
>
>
> Repository: ambari
>
>
> Description
> -------
>
> [root@c6401 views]# ambari-server --hash
> 5e1796a9d8d32eeaa24f13d29b81c437fef5acd8
> 1) Install HDP 2.1 (hdfs, yarn, mr, tez, zk, hive)
> 2) set Hive engine to tez
> 3) attempt to run hive query, get the error below;
> [root@c6401 yum.repos.d]# su - hive
> [hive@c6401 ~]$ cd /tmp
> [hive@c6401 tmp]$ wget http://seanlahman.com/files/database/lahman591-csv.zip
> --2014-10-29 01:28:52-- http://seanlahman.com/files/database/lahman591-csv.zip
> Resolving seanlahman.com... 208.113.136.74
> Connecting to seanlahman.com|208.113.136.74|:80... connected.
> HTTP request sent, awaiting response... 200 OK
> Length: 8337421 (8.0M) [application/zip]
> Saving to: “lahman591-csv.zip”
>
> 100%[======================================>] 8,337,421 3.45M/s in 2.3s
>
> 2014-10-29 01:28:54 (3.45 MB/s) - “lahman591-csv.zip” saved [8337421/8337421]
>
> [hive@c6401 tmp]$ unzip lahman591-csv.zip
> Archive: lahman591-csv.zip
> inflating: Managers.csv
> inflating: ManagersHalf.csv
> inflating: Pitching.csv
> inflating: Salaries.csv
> inflating: Schools.csv
> inflating: SchoolsPlayers.csv
> inflating: Teams.csv
> inflating: TeamsFranchises.csv
> inflating: TeamsHalf.csv
> inflating: AllstarFull.csv
> inflating: AwardsManagers.csv
> inflating: AwardsPlayers.csv
> inflating: AwardsShareManagers.csv
> inflating: AwardsSharePlayers.csv
> inflating: Batting.csv
> inflating: Fielding.csv
> inflating: FieldingOF.csv
> inflating: readme59.txt
> inflating: Master.csv
> inflating: FieldingPost.csv
> inflating: HallOfFame.csv
> inflating: Appearances.csv
> inflating: PitchingPost.csv
> inflating: BattingPost.csv
> inflating: SeriesPost.csv
> [hive@c6401 tmp]$ hadoop fs -copyFromLocal Schools.csv /tmp
> [hive@c6401 tmp]$ hive
>
> Logging initialized using configuration in file:/etc/hive/conf.dist/hive-log4j.properties
> Exception in thread "main" java.lang.RuntimeException: java.io.FileNotFoundException: File does not exist: hdfs://c6401.ambari.apache.org:8020/apps/tez
> at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:358)
> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
> Caused by: java.io.FileNotFoundException: File does not exist: hdfs://c6401.ambari.apache.org:8020/apps/tez
> at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1128
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive_server.py 4e55cfb
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/install_jars.py PRE-CREATION
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py 2bfbdc1
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py 0abc438
>
> Diff: https://reviews.apache.org/r/27328/diff/
>
>
> Testing
> -------
>
> manual deployment
>
> +
>
> Ran 242 tests in 3.754s
>
> OK
> ----------------------------------------------------------------------
> Total run:679
> Total errors:0
> Total failures:0
> OK
>
>
> Thanks,
>
> Dmytro Sen
>
>