You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by "Shwetha G S (JIRA)" <ji...@apache.org> on 2014/01/21 07:45:25 UTC

[jira] [Comment Edited] (FALCON-260) When a process is scheduled, the user workflow is failing with OozieClientException

    [ https://issues.apache.org/jira/browse/FALCON-260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877277#comment-13877277 ] 

Shwetha G S edited comment on FALCON-260 at 1/21/14 6:45 AM:
-------------------------------------------------------------

If debug is enabled for falcon server using FALCON_OPTS(="-Xdebug -Xrunjdwp:transport=dt_socket,server=y,suspend=n,address=8003 -Djava.security.krb5.realm= -Djava.security.krb5.kdc="), falcon command throws up with this:
{noformat}
ERROR: transport error 202: bind failed: Address already in use
ERROR: JDWP Transport dt_socket failed to initialize, TRANSPORT_INIT(510)
JDWP exit error AGENT_ERROR_TRANSPORT_INIT(197): No transports initialized [../../../src/share/back/debugInit.c:690]
FATAL ERROR in native method: JDWP No transports initialized, jvmtiError=AGENT_ERROR_TRANSPORT_INIT(197)
./bin/falcon: line 53: 17247 Abort trap: 6           ${JAVA_BIN} ${JAVA_PROPERTIES} -cp ${FALCONCPPATH} org.apache.falcon.cli.FalconCLI "${@}"
{noformat}
I didn't see any java properties required for falcon client. Hence removed it. If required, we should expose separate properties for client and server


was (Author: shwethags):
If debug is enabled for falcon server using FALCON_OPTS(="-Xdebug -Xrunjdwp:transport=dt_socket,server=y,suspend=n,address=8003 -Djava.security.krb5.realm= -Djava.security.krb5.kdc="), falcon command throws up with this:
ERROR: transport error 202: bind failed: Address already in use
ERROR: JDWP Transport dt_socket failed to initialize, TRANSPORT_INIT(510)
JDWP exit error AGENT_ERROR_TRANSPORT_INIT(197): No transports initialized [../../../src/share/back/debugInit.c:690]
FATAL ERROR in native method: JDWP No transports initialized, jvmtiError=AGENT_ERROR_TRANSPORT_INIT(197)
./bin/falcon: line 53: 17247 Abort trap: 6           ${JAVA_BIN} ${JAVA_PROPERTIES} -cp ${FALCONCPPATH} org.apache.falcon.cli.FalconCLI "${@}"

I didn't see any java properties required for falcon client. Hence removed it. If required, we should expose separate properties for client and server

> When a process is scheduled, the user workflow is failing with OozieClientException
> -----------------------------------------------------------------------------------
>
>                 Key: FALCON-260
>                 URL: https://issues.apache.org/jira/browse/FALCON-260
>             Project: Falcon
>          Issue Type: Bug
>            Reporter: Suhas Vasu
>            Assignee: Shwetha G S
>            Priority: Critical
>             Fix For: 0.5
>
>         Attachments: FALCON-260.patch
>
>
> When a process is submitted and scheduled, the user workflow is failing with:
> OozieClientException: org.apache.oozie.DagEngineException: E0710: Could not read the workflow definition, Path is not a file: /projects/falcon/staging/falcon/workflows/process/WordCount3/1389606059312/user/workflow.xml	at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:42)	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsUpdateTimes(FSNamesystem.java:1439)	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInt(FSNamesystem.java:1391)	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1367)	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1340)	at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:413)	at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:172)	at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java:44938)	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:453)	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1002)	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1752)	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1748)	at java.security.AccessController.doPrivileged(Native Method)	at javax.security.auth.Subject.doAs(Subject.java:415)	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1746)
> It is creating a workflow.xml directory and placing the workflow.xml inside it.
> suhas@R9FC7XY:~/Downloads/examples/entity$ hdfs dfs -ls /projects/falcon/staging/falcon/workflows/process/WordCount3/1389606059312/user/
> Found 2 items
> drwxr-xr-x   - suhas supergroup          0 2014-01-13 14:23 /projects/falcon/staging/falcon/workflows/process/WordCount3/1389606059312/user/lib
> drwxr-xr-x   - suhas supergroup          0 2014-01-13 14:23 /projects/falcon/staging/falcon/workflows/process/WordCount3/1389606059312/user/workflow.xml
> suhas@R9FC7XY:~/Downloads/examples/entity$ hdfs dfs -ls /projects/falcon/staging/falcon/workflows/process/WordCount3/1389606059312/user/workflow.xml
> Found 1 item
> -rw-r-xr-x   - suhas supergroup          0 2014-01-13 14:23 /projects/falcon/staging/falcon/workflows/process/WordCount3/1389606059312/user/workflow.xml/workflow.xml



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)