[jira] [Created] (FALCON-2071) Falcon Spark SQL failing with Yarn Client Mode

["Murali Ramasami (JIRA)" <ji...@apache.org>]

Murali Ramasami created FALCON-2071:
---------------------------------------

             Summary: Falcon Spark SQL failing with Yarn Client Mode 
                 Key: FALCON-2071
                 URL: https://issues.apache.org/jira/browse/FALCON-2071
             Project: Falcon
          Issue Type: Bug
          Components: process
    Affects Versions: trunk
            Reporter: Murali Ramasami
            Priority: Critical
             Fix For: trunk


Falcon Spark SQL failing with Yarn Client Mode Only local python files are supported. Please see the error message below from application log:

{noformat}
Error: Only local python files are supported: Parsed arguments:
  master                  yarn-client
  deployMode              client
  executorMemory          null
  executorCores           null
  totalExecutorCores      null
  propertiesFile          null
  driverMemory            null
  driverCores             null
  driverExtraClassPath    $PWD/*
  driverExtraLibraryPath  /usr/hdp/current/hadoop-client/lib/native
  driverExtraJavaOptions  -Dlog4j.configuration=spark-log4j.properties
  supervise               false
  queue                   null
  numExecutors            null
{noformat}

Process
{noformat}
<?xml version="1.0" encoding="UTF-8"?>
<process name="spark-hivesql-client" xmlns="uri:falcon:process:0.1">
    <clusters>
        <cluster name="primaryCluster">
            <validity start="2015-01-02T01:00Z" end="2015-01-02T01:04Z"/>
        </cluster>
    </clusters>
    <parallel>1</parallel>
    <order>FIFO</order>
    <frequency>minutes(5)</frequency>
    <timezone>UTC</timezone>
    <workflow engine="spark" path="/user/hrt_qa/falcon-regression/spark_hivesql"/>
    <spark-attributes>
        <master>yarn-client</master>
        <name>Spark-Hive</name>
        <class>Spark Hive</class>
        <jar>/user/hrt_qa/falcon-regression/spark_hivesql/spark-hivesql.py</jar>
    </spark-attributes>
    <retry policy="periodic" delay="minutes(3)" attempts="3"/>
    <ACL owner="hrt_qa" group="users" permission="0x755"/>
</process>

{noformat}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)