You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@oozie.apache.org by "Parameswaran Raman (Created) (JIRA)" <ji...@apache.org> on 2011/10/03 18:33:34 UTC
[jira] [Created] (OOZIE-567) Is sub-workflow lib directory not
used?
Is sub-workflow lib directory not used?
---------------------------------------
Key: OOZIE-567
URL: https://issues.apache.org/jira/browse/OOZIE-567
Project: Oozie
Issue Type: Bug
Reporter: Parameswaran Raman
Priority: Minor
Consider the subworkflow scenario as below:
* Parent workflow is a subworkflow "subwf" with a required library oozie-examples.jar.
* Child workflow is a java workflow "java-wf" with a required library main.jar
On submitting the job, it is found that the libraries (.jars in this case) from the child workflow do not appear in the java class path or the mapred.cache. As a result, the job fails with "java.lang.RuntimeException: java.lang.ClassNotFoundException".
The CLASSPATH of the job (taken from job log on JT) shows libraries that are in the main workflow, not the sub-workflow. However, when the .jars from child workflow were copied to the parent workflow, everything seems to work. This raises the question that whether the child workflows's lib directory is not used?
Different Scenarios Tested:
------
Parent Lib Directory contains oozie-examples.jar, Child Lib Directory contains main.jar => Application Fails
Parent Lib Directory contains main.jar, Child Lib Directory is empty => Application Succeeds
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OOZIE-567) Is sub-workflow lib directory not
used?
Posted by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125542#comment-13125542 ]
jiraposter@reviews.apache.org commented on OOZIE-567:
-----------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2156/#review2523
-----------------------------------------------------------
=1 pushing.
- Mohammad
On 2011-10-12 02:02:44, params wrote:
bq.
bq. -----------------------------------------------------------
bq. This is an automatically generated e-mail. To reply, visit:
bq. https://reviews.apache.org/r/2156/
bq. -----------------------------------------------------------
bq.
bq. (Updated 2011-10-12 02:02:44)
bq.
bq.
bq. Review request for oozie, Mohammad Islam and Angelo K. Huang.
bq.
bq.
bq. Summary
bq. -------
bq.
bq. OOZIE-567: Is sub-workflow lib directory not used?
bq.
bq. Summary:
bq. https://issues.apache.org/jira/browse/OOZIE-567
bq.
bq.
bq. This addresses bug OOZIE-567.
bq. https://issues.apache.org/jira/browse/OOZIE-567
bq.
bq.
bq. Diffs
bq. -----
bq.
bq. trunk/core/src/test/java/org/apache/oozie/service/TestLiteWorkflowAppService.java 1182157
bq.
bq. Diff: https://reviews.apache.org/r/2156/diff
bq.
bq.
bq. Testing
bq. -------
bq.
bq. Tested against current test cases. Added two new test cases.
bq.
bq.
bq. Thanks,
bq.
bq. params
bq.
bq.
> Is sub-workflow lib directory not used?
> ---------------------------------------
>
> Key: OOZIE-567
> URL: https://issues.apache.org/jira/browse/OOZIE-567
> Project: Oozie
> Issue Type: Bug
> Reporter: Parameswaran Raman
>
> Consider the subworkflow scenario as below:
> * Parent workflow is a subworkflow "subwf" with a required library oozie-examples.jar.
> * Child workflow is a java workflow "java-wf" with a required library main.jar
> On submitting the job, it is found that the libraries (.jars in this case) from the child workflow do not appear in the java class path or the mapred.cache. As a result, the job fails with "java.lang.RuntimeException: java.lang.ClassNotFoundException".
> The CLASSPATH of the job (taken from job log on JT) shows libraries that are in the main workflow, not the sub-workflow. However, when the .jars from child workflow were copied to the parent workflow, everything seems to work. This raises the question that whether the child workflows's lib directory is not used?
> Different Scenarios Tested:
> ------
> Parent Lib Directory contains oozie-examples.jar, Child Lib Directory contains main.jar => Application Fails
> Parent Lib Directory contains main.jar, Child Lib Directory is empty => Application Succeeds
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (OOZIE-567) Is sub-workflow lib directory not
used?
Posted by "Parameswaran Raman (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Parameswaran Raman updated OOZIE-567:
-------------------------------------
Priority: Major (was: Minor)
> Is sub-workflow lib directory not used?
> ---------------------------------------
>
> Key: OOZIE-567
> URL: https://issues.apache.org/jira/browse/OOZIE-567
> Project: Oozie
> Issue Type: Bug
> Reporter: Parameswaran Raman
>
> Consider the subworkflow scenario as below:
> * Parent workflow is a subworkflow "subwf" with a required library oozie-examples.jar.
> * Child workflow is a java workflow "java-wf" with a required library main.jar
> On submitting the job, it is found that the libraries (.jars in this case) from the child workflow do not appear in the java class path or the mapred.cache. As a result, the job fails with "java.lang.RuntimeException: java.lang.ClassNotFoundException".
> The CLASSPATH of the job (taken from job log on JT) shows libraries that are in the main workflow, not the sub-workflow. However, when the .jars from child workflow were copied to the parent workflow, everything seems to work. This raises the question that whether the child workflows's lib directory is not used?
> Different Scenarios Tested:
> ------
> Parent Lib Directory contains oozie-examples.jar, Child Lib Directory contains main.jar => Application Fails
> Parent Lib Directory contains main.jar, Child Lib Directory is empty => Application Succeeds
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OOZIE-567) Is sub-workflow lib directory not
used?
Posted by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13120634#comment-13120634 ]
jiraposter@reviews.apache.org commented on OOZIE-567:
-----------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2156/#review2334
-----------------------------------------------------------
Ship it!
Pushing
- Mohammad
On 2011-10-04 03:40:26, params wrote:
bq.
bq. -----------------------------------------------------------
bq. This is an automatically generated e-mail. To reply, visit:
bq. https://reviews.apache.org/r/2156/
bq. -----------------------------------------------------------
bq.
bq. (Updated 2011-10-04 03:40:26)
bq.
bq.
bq. Review request for oozie, Mohammad Islam and Angelo K. Huang.
bq.
bq.
bq. Summary
bq. -------
bq.
bq. OOZIE-567: Is sub-workflow lib directory not used?
bq.
bq. Summary:
bq. https://issues.apache.org/jira/browse/OOZIE-567
bq.
bq.
bq. This addresses bug OOZIE-567.
bq. https://issues.apache.org/jira/browse/OOZIE-567
bq.
bq.
bq. Diffs
bq. -----
bq.
bq. trunk/core/src/main/java/org/apache/oozie/service/WorkflowAppService.java 1178596
bq. trunk/core/src/test/java/org/apache/oozie/service/TestLiteWorkflowAppService.java 1178596
bq. trunk/release-log.txt 1178596
bq.
bq. Diff: https://reviews.apache.org/r/2156/diff
bq.
bq.
bq. Testing
bq. -------
bq.
bq. Tested against current test cases. Added two new test cases.
bq.
bq.
bq. Thanks,
bq.
bq. params
bq.
bq.
> Is sub-workflow lib directory not used?
> ---------------------------------------
>
> Key: OOZIE-567
> URL: https://issues.apache.org/jira/browse/OOZIE-567
> Project: Oozie
> Issue Type: Bug
> Reporter: Parameswaran Raman
>
> Consider the subworkflow scenario as below:
> * Parent workflow is a subworkflow "subwf" with a required library oozie-examples.jar.
> * Child workflow is a java workflow "java-wf" with a required library main.jar
> On submitting the job, it is found that the libraries (.jars in this case) from the child workflow do not appear in the java class path or the mapred.cache. As a result, the job fails with "java.lang.RuntimeException: java.lang.ClassNotFoundException".
> The CLASSPATH of the job (taken from job log on JT) shows libraries that are in the main workflow, not the sub-workflow. However, when the .jars from child workflow were copied to the parent workflow, everything seems to work. This raises the question that whether the child workflows's lib directory is not used?
> Different Scenarios Tested:
> ------
> Parent Lib Directory contains oozie-examples.jar, Child Lib Directory contains main.jar => Application Fails
> Parent Lib Directory contains main.jar, Child Lib Directory is empty => Application Succeeds
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OOZIE-567) Is sub-workflow lib directory not
used?
Posted by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13121600#comment-13121600 ]
jiraposter@reviews.apache.org commented on OOZIE-567:
-----------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2156/#review2377
-----------------------------------------------------------
Ship it!
+1
- Angelo K.
On 2011-10-04 03:40:26, params wrote:
bq.
bq. -----------------------------------------------------------
bq. This is an automatically generated e-mail. To reply, visit:
bq. https://reviews.apache.org/r/2156/
bq. -----------------------------------------------------------
bq.
bq. (Updated 2011-10-04 03:40:26)
bq.
bq.
bq. Review request for oozie, Mohammad Islam and Angelo K. Huang.
bq.
bq.
bq. Summary
bq. -------
bq.
bq. OOZIE-567: Is sub-workflow lib directory not used?
bq.
bq. Summary:
bq. https://issues.apache.org/jira/browse/OOZIE-567
bq.
bq.
bq. This addresses bug OOZIE-567.
bq. https://issues.apache.org/jira/browse/OOZIE-567
bq.
bq.
bq. Diffs
bq. -----
bq.
bq. trunk/core/src/main/java/org/apache/oozie/service/WorkflowAppService.java 1178596
bq. trunk/core/src/test/java/org/apache/oozie/service/TestLiteWorkflowAppService.java 1178596
bq. trunk/release-log.txt 1178596
bq.
bq. Diff: https://reviews.apache.org/r/2156/diff
bq.
bq.
bq. Testing
bq. -------
bq.
bq. Tested against current test cases. Added two new test cases.
bq.
bq.
bq. Thanks,
bq.
bq. params
bq.
bq.
> Is sub-workflow lib directory not used?
> ---------------------------------------
>
> Key: OOZIE-567
> URL: https://issues.apache.org/jira/browse/OOZIE-567
> Project: Oozie
> Issue Type: Bug
> Reporter: Parameswaran Raman
>
> Consider the subworkflow scenario as below:
> * Parent workflow is a subworkflow "subwf" with a required library oozie-examples.jar.
> * Child workflow is a java workflow "java-wf" with a required library main.jar
> On submitting the job, it is found that the libraries (.jars in this case) from the child workflow do not appear in the java class path or the mapred.cache. As a result, the job fails with "java.lang.RuntimeException: java.lang.ClassNotFoundException".
> The CLASSPATH of the job (taken from job log on JT) shows libraries that are in the main workflow, not the sub-workflow. However, when the .jars from child workflow were copied to the parent workflow, everything seems to work. This raises the question that whether the child workflows's lib directory is not used?
> Different Scenarios Tested:
> ------
> Parent Lib Directory contains oozie-examples.jar, Child Lib Directory contains main.jar => Application Fails
> Parent Lib Directory contains main.jar, Child Lib Directory is empty => Application Succeeds
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OOZIE-567) Is sub-workflow lib directory not
used?
Posted by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125545#comment-13125545 ]
jiraposter@reviews.apache.org commented on OOZIE-567:
-----------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2156/#review2527
-----------------------------------------------------------
committed. please close.
- Mohammad
On 2011-10-12 02:02:44, params wrote:
bq.
bq. -----------------------------------------------------------
bq. This is an automatically generated e-mail. To reply, visit:
bq. https://reviews.apache.org/r/2156/
bq. -----------------------------------------------------------
bq.
bq. (Updated 2011-10-12 02:02:44)
bq.
bq.
bq. Review request for oozie, Mohammad Islam and Angelo K. Huang.
bq.
bq.
bq. Summary
bq. -------
bq.
bq. OOZIE-567: Is sub-workflow lib directory not used?
bq.
bq. Summary:
bq. https://issues.apache.org/jira/browse/OOZIE-567
bq.
bq.
bq. This addresses bug OOZIE-567.
bq. https://issues.apache.org/jira/browse/OOZIE-567
bq.
bq.
bq. Diffs
bq. -----
bq.
bq. trunk/core/src/test/java/org/apache/oozie/service/TestLiteWorkflowAppService.java 1182157
bq.
bq. Diff: https://reviews.apache.org/r/2156/diff
bq.
bq.
bq. Testing
bq. -------
bq.
bq. Tested against current test cases. Added two new test cases.
bq.
bq.
bq. Thanks,
bq.
bq. params
bq.
bq.
> Is sub-workflow lib directory not used?
> ---------------------------------------
>
> Key: OOZIE-567
> URL: https://issues.apache.org/jira/browse/OOZIE-567
> Project: Oozie
> Issue Type: Bug
> Reporter: Parameswaran Raman
>
> Consider the subworkflow scenario as below:
> * Parent workflow is a subworkflow "subwf" with a required library oozie-examples.jar.
> * Child workflow is a java workflow "java-wf" with a required library main.jar
> On submitting the job, it is found that the libraries (.jars in this case) from the child workflow do not appear in the java class path or the mapred.cache. As a result, the job fails with "java.lang.RuntimeException: java.lang.ClassNotFoundException".
> The CLASSPATH of the job (taken from job log on JT) shows libraries that are in the main workflow, not the sub-workflow. However, when the .jars from child workflow were copied to the parent workflow, everything seems to work. This raises the question that whether the child workflows's lib directory is not used?
> Different Scenarios Tested:
> ------
> Parent Lib Directory contains oozie-examples.jar, Child Lib Directory contains main.jar => Application Fails
> Parent Lib Directory contains main.jar, Child Lib Directory is empty => Application Succeeds
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OOZIE-567) Is sub-workflow lib directory not
used?
Posted by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13119772#comment-13119772 ]
jiraposter@reviews.apache.org commented on OOZIE-567:
-----------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2156/
-----------------------------------------------------------
Review request for oozie, Mohammad Islam and Angelo K. Huang.
Summary
-------
OOZIE-567: Is sub-workflow lib directory not used?
Summary:
https://issues.apache.org/jira/browse/OOZIE-567
This addresses bug OOZIE-567.
https://issues.apache.org/jira/browse/OOZIE-567
Diffs
-----
trunk/core/src/main/java/org/apache/oozie/service/WorkflowAppService.java 1178596
trunk/core/src/test/java/org/apache/oozie/service/TestLiteWorkflowAppService.java 1178596
trunk/release-log.txt 1178596
Diff: https://reviews.apache.org/r/2156/diff
Testing
-------
Tested against current test cases. Added two new test cases.
Thanks,
params
> Is sub-workflow lib directory not used?
> ---------------------------------------
>
> Key: OOZIE-567
> URL: https://issues.apache.org/jira/browse/OOZIE-567
> Project: Oozie
> Issue Type: Bug
> Reporter: Parameswaran Raman
>
> Consider the subworkflow scenario as below:
> * Parent workflow is a subworkflow "subwf" with a required library oozie-examples.jar.
> * Child workflow is a java workflow "java-wf" with a required library main.jar
> On submitting the job, it is found that the libraries (.jars in this case) from the child workflow do not appear in the java class path or the mapred.cache. As a result, the job fails with "java.lang.RuntimeException: java.lang.ClassNotFoundException".
> The CLASSPATH of the job (taken from job log on JT) shows libraries that are in the main workflow, not the sub-workflow. However, when the .jars from child workflow were copied to the parent workflow, everything seems to work. This raises the question that whether the child workflows's lib directory is not used?
> Different Scenarios Tested:
> ------
> Parent Lib Directory contains oozie-examples.jar, Child Lib Directory contains main.jar => Application Fails
> Parent Lib Directory contains main.jar, Child Lib Directory is empty => Application Succeeds
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OOZIE-567) Is sub-workflow lib directory not
used?
Posted by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13119863#comment-13119863 ]
jiraposter@reviews.apache.org commented on OOZIE-567:
-----------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2156/#review2301
-----------------------------------------------------------
trunk/core/src/main/java/org/apache/oozie/service/WorkflowAppService.java
<https://reviews.apache.org/r/2156/#comment5301>
use the syntax like
if () {
}
- Mohammad
On 2011-10-03 23:57:08, params wrote:
bq.
bq. -----------------------------------------------------------
bq. This is an automatically generated e-mail. To reply, visit:
bq. https://reviews.apache.org/r/2156/
bq. -----------------------------------------------------------
bq.
bq. (Updated 2011-10-03 23:57:08)
bq.
bq.
bq. Review request for oozie, Mohammad Islam and Angelo K. Huang.
bq.
bq.
bq. Summary
bq. -------
bq.
bq. OOZIE-567: Is sub-workflow lib directory not used?
bq.
bq. Summary:
bq. https://issues.apache.org/jira/browse/OOZIE-567
bq.
bq.
bq. This addresses bug OOZIE-567.
bq. https://issues.apache.org/jira/browse/OOZIE-567
bq.
bq.
bq. Diffs
bq. -----
bq.
bq. trunk/core/src/main/java/org/apache/oozie/service/WorkflowAppService.java 1178596
bq. trunk/core/src/test/java/org/apache/oozie/service/TestLiteWorkflowAppService.java 1178596
bq. trunk/release-log.txt 1178596
bq.
bq. Diff: https://reviews.apache.org/r/2156/diff
bq.
bq.
bq. Testing
bq. -------
bq.
bq. Tested against current test cases. Added two new test cases.
bq.
bq.
bq. Thanks,
bq.
bq. params
bq.
bq.
> Is sub-workflow lib directory not used?
> ---------------------------------------
>
> Key: OOZIE-567
> URL: https://issues.apache.org/jira/browse/OOZIE-567
> Project: Oozie
> Issue Type: Bug
> Reporter: Parameswaran Raman
>
> Consider the subworkflow scenario as below:
> * Parent workflow is a subworkflow "subwf" with a required library oozie-examples.jar.
> * Child workflow is a java workflow "java-wf" with a required library main.jar
> On submitting the job, it is found that the libraries (.jars in this case) from the child workflow do not appear in the java class path or the mapred.cache. As a result, the job fails with "java.lang.RuntimeException: java.lang.ClassNotFoundException".
> The CLASSPATH of the job (taken from job log on JT) shows libraries that are in the main workflow, not the sub-workflow. However, when the .jars from child workflow were copied to the parent workflow, everything seems to work. This raises the question that whether the child workflows's lib directory is not used?
> Different Scenarios Tested:
> ------
> Parent Lib Directory contains oozie-examples.jar, Child Lib Directory contains main.jar => Application Fails
> Parent Lib Directory contains main.jar, Child Lib Directory is empty => Application Succeeds
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (OOZIE-567) Is sub-workflow lib directory not
used?
Posted by "Parameswaran Raman (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Parameswaran Raman resolved OOZIE-567.
--------------------------------------
Resolution: Fixed
Changes have been committed. Marking as fixed.
> Is sub-workflow lib directory not used?
> ---------------------------------------
>
> Key: OOZIE-567
> URL: https://issues.apache.org/jira/browse/OOZIE-567
> Project: Oozie
> Issue Type: Bug
> Reporter: Parameswaran Raman
>
> Consider the subworkflow scenario as below:
> * Parent workflow is a subworkflow "subwf" with a required library oozie-examples.jar.
> * Child workflow is a java workflow "java-wf" with a required library main.jar
> On submitting the job, it is found that the libraries (.jars in this case) from the child workflow do not appear in the java class path or the mapred.cache. As a result, the job fails with "java.lang.RuntimeException: java.lang.ClassNotFoundException".
> The CLASSPATH of the job (taken from job log on JT) shows libraries that are in the main workflow, not the sub-workflow. However, when the .jars from child workflow were copied to the parent workflow, everything seems to work. This raises the question that whether the child workflows's lib directory is not used?
> Different Scenarios Tested:
> ------
> Parent Lib Directory contains oozie-examples.jar, Child Lib Directory contains main.jar => Application Fails
> Parent Lib Directory contains main.jar, Child Lib Directory is empty => Application Succeeds
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OOZIE-567) Is sub-workflow lib directory not
used?
Posted by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125535#comment-13125535 ]
jiraposter@reviews.apache.org commented on OOZIE-567:
-----------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2156/
-----------------------------------------------------------
(Updated 2011-10-12 02:02:44.996150)
Review request for oozie, Mohammad Islam and Angelo K. Huang.
Changes
-------
Fixed tests to assert on collections (rather than individual elements), so that accidental re-ordering of elements while running the tests doesn't fail them. This was observed on a random basis on some machines.
Summary
-------
OOZIE-567: Is sub-workflow lib directory not used?
Summary:
https://issues.apache.org/jira/browse/OOZIE-567
This addresses bug OOZIE-567.
https://issues.apache.org/jira/browse/OOZIE-567
Diffs (updated)
-----
trunk/core/src/test/java/org/apache/oozie/service/TestLiteWorkflowAppService.java 1182157
Diff: https://reviews.apache.org/r/2156/diff
Testing
-------
Tested against current test cases. Added two new test cases.
Thanks,
params
> Is sub-workflow lib directory not used?
> ---------------------------------------
>
> Key: OOZIE-567
> URL: https://issues.apache.org/jira/browse/OOZIE-567
> Project: Oozie
> Issue Type: Bug
> Reporter: Parameswaran Raman
>
> Consider the subworkflow scenario as below:
> * Parent workflow is a subworkflow "subwf" with a required library oozie-examples.jar.
> * Child workflow is a java workflow "java-wf" with a required library main.jar
> On submitting the job, it is found that the libraries (.jars in this case) from the child workflow do not appear in the java class path or the mapred.cache. As a result, the job fails with "java.lang.RuntimeException: java.lang.ClassNotFoundException".
> The CLASSPATH of the job (taken from job log on JT) shows libraries that are in the main workflow, not the sub-workflow. However, when the .jars from child workflow were copied to the parent workflow, everything seems to work. This raises the question that whether the child workflows's lib directory is not used?
> Different Scenarios Tested:
> ------
> Parent Lib Directory contains oozie-examples.jar, Child Lib Directory contains main.jar => Application Fails
> Parent Lib Directory contains main.jar, Child Lib Directory is empty => Application Succeeds
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OOZIE-567) Is sub-workflow lib directory not
used?
Posted by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13122208#comment-13122208 ]
jiraposter@reviews.apache.org commented on OOZIE-567:
-----------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2156/#review2404
-----------------------------------------------------------
committed
- Mohammad
On 2011-10-04 03:40:26, params wrote:
bq.
bq. -----------------------------------------------------------
bq. This is an automatically generated e-mail. To reply, visit:
bq. https://reviews.apache.org/r/2156/
bq. -----------------------------------------------------------
bq.
bq. (Updated 2011-10-04 03:40:26)
bq.
bq.
bq. Review request for oozie, Mohammad Islam and Angelo K. Huang.
bq.
bq.
bq. Summary
bq. -------
bq.
bq. OOZIE-567: Is sub-workflow lib directory not used?
bq.
bq. Summary:
bq. https://issues.apache.org/jira/browse/OOZIE-567
bq.
bq.
bq. This addresses bug OOZIE-567.
bq. https://issues.apache.org/jira/browse/OOZIE-567
bq.
bq.
bq. Diffs
bq. -----
bq.
bq. trunk/core/src/main/java/org/apache/oozie/service/WorkflowAppService.java 1178596
bq. trunk/core/src/test/java/org/apache/oozie/service/TestLiteWorkflowAppService.java 1178596
bq. trunk/release-log.txt 1178596
bq.
bq. Diff: https://reviews.apache.org/r/2156/diff
bq.
bq.
bq. Testing
bq. -------
bq.
bq. Tested against current test cases. Added two new test cases.
bq.
bq.
bq. Thanks,
bq.
bq. params
bq.
bq.
> Is sub-workflow lib directory not used?
> ---------------------------------------
>
> Key: OOZIE-567
> URL: https://issues.apache.org/jira/browse/OOZIE-567
> Project: Oozie
> Issue Type: Bug
> Reporter: Parameswaran Raman
>
> Consider the subworkflow scenario as below:
> * Parent workflow is a subworkflow "subwf" with a required library oozie-examples.jar.
> * Child workflow is a java workflow "java-wf" with a required library main.jar
> On submitting the job, it is found that the libraries (.jars in this case) from the child workflow do not appear in the java class path or the mapred.cache. As a result, the job fails with "java.lang.RuntimeException: java.lang.ClassNotFoundException".
> The CLASSPATH of the job (taken from job log on JT) shows libraries that are in the main workflow, not the sub-workflow. However, when the .jars from child workflow were copied to the parent workflow, everything seems to work. This raises the question that whether the child workflows's lib directory is not used?
> Different Scenarios Tested:
> ------
> Parent Lib Directory contains oozie-examples.jar, Child Lib Directory contains main.jar => Application Fails
> Parent Lib Directory contains main.jar, Child Lib Directory is empty => Application Succeeds
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OOZIE-567) Is sub-workflow lib directory not
used?
Posted by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OOZIE-567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13119885#comment-13119885 ]
jiraposter@reviews.apache.org commented on OOZIE-567:
-----------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2156/
-----------------------------------------------------------
(Updated 2011-10-04 03:40:26.912026)
Review request for oozie, Mohammad Islam and Angelo K. Huang.
Changes
-------
Incorporated review feedback from diff version1.
Summary
-------
OOZIE-567: Is sub-workflow lib directory not used?
Summary:
https://issues.apache.org/jira/browse/OOZIE-567
This addresses bug OOZIE-567.
https://issues.apache.org/jira/browse/OOZIE-567
Diffs (updated)
-----
trunk/core/src/main/java/org/apache/oozie/service/WorkflowAppService.java 1178596
trunk/core/src/test/java/org/apache/oozie/service/TestLiteWorkflowAppService.java 1178596
trunk/release-log.txt 1178596
Diff: https://reviews.apache.org/r/2156/diff
Testing
-------
Tested against current test cases. Added two new test cases.
Thanks,
params
> Is sub-workflow lib directory not used?
> ---------------------------------------
>
> Key: OOZIE-567
> URL: https://issues.apache.org/jira/browse/OOZIE-567
> Project: Oozie
> Issue Type: Bug
> Reporter: Parameswaran Raman
>
> Consider the subworkflow scenario as below:
> * Parent workflow is a subworkflow "subwf" with a required library oozie-examples.jar.
> * Child workflow is a java workflow "java-wf" with a required library main.jar
> On submitting the job, it is found that the libraries (.jars in this case) from the child workflow do not appear in the java class path or the mapred.cache. As a result, the job fails with "java.lang.RuntimeException: java.lang.ClassNotFoundException".
> The CLASSPATH of the job (taken from job log on JT) shows libraries that are in the main workflow, not the sub-workflow. However, when the .jars from child workflow were copied to the parent workflow, everything seems to work. This raises the question that whether the child workflows's lib directory is not used?
> Different Scenarios Tested:
> ------
> Parent Lib Directory contains oozie-examples.jar, Child Lib Directory contains main.jar => Application Fails
> Parent Lib Directory contains main.jar, Child Lib Directory is empty => Application Succeeds
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira