You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/07/12 12:16:20 UTC
[jira] [Commented] (FALCON-2071) Falcon Spark SQL failing with Yarn
Client Mode
[ https://issues.apache.org/jira/browse/FALCON-2071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372788#comment-15372788 ]
ASF GitHub Bot commented on FALCON-2071:
----------------------------------------
GitHub user peeyushb opened a pull request:
https://github.com/apache/falcon/pull/220
FALCON-2071 : Falcon Spark SQL failing with Yarn Client Mode
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/peeyushb/falcon FALCON-2071
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/falcon/pull/220.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #220
----
commit 246622c6f4ed09a861252ef0e51f52f2599fbff3
Author: peeyush b <pb...@hortonworks.com>
Date: 2016-07-12T12:13:51Z
FALCON-2071 : Falcon Spark SQL failing with Yarn Client Mode
----
> Falcon Spark SQL failing with Yarn Client Mode
> -----------------------------------------------
>
> Key: FALCON-2071
> URL: https://issues.apache.org/jira/browse/FALCON-2071
> Project: Falcon
> Issue Type: Bug
> Components: process
> Affects Versions: trunk
> Reporter: Murali Ramasami
> Assignee: Peeyush Bishnoi
> Priority: Critical
> Fix For: trunk
>
>
> Falcon Spark SQL failing with Yarn Client Mode with error message "Only local python files are supported". Please see the error message below from application log:
> {noformat}
> Error: Only local python files are supported: Parsed arguments:
> master yarn-client
> deployMode client
> executorMemory null
> executorCores null
> totalExecutorCores null
> propertiesFile null
> driverMemory null
> driverCores null
> driverExtraClassPath $PWD/*
> driverExtraLibraryPath /usr/hdp/current/hadoop-client/lib/native
> driverExtraJavaOptions -Dlog4j.configuration=spark-log4j.properties
> supervise false
> queue null
> numExecutors null
> {noformat}
> Process
> {noformat}
> <?xml version="1.0" encoding="UTF-8"?>
> <process name="spark-hivesql-client" xmlns="uri:falcon:process:0.1">
> <clusters>
> <cluster name="primaryCluster">
> <validity start="2015-01-02T01:00Z" end="2015-01-02T01:04Z"/>
> </cluster>
> </clusters>
> <parallel>1</parallel>
> <order>FIFO</order>
> <frequency>minutes(5)</frequency>
> <timezone>UTC</timezone>
> <workflow engine="spark" path="/user/hrt_qa/falcon-regression/spark_hivesql"/>
> <spark-attributes>
> <master>yarn-client</master>
> <name>Spark-Hive</name>
> <class>Spark Hive</class>
> <jar>/user/hrt_qa/falcon-regression/spark_hivesql/spark-hivesql.py</jar>
> </spark-attributes>
> <retry policy="periodic" delay="minutes(3)" attempts="3"/>
> <ACL owner="hrt_qa" group="users" permission="0x755"/>
> </process>
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)