You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by Satish Mittal <sa...@apache.org> on 2014/04/24 15:04:01 UTC

Re: Review Request 20655: OOZIE-1806: Java Action type jobs are failing with hadoop-0.20.0 and earlier versions on oozie trunk

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20655/
-----------------------------------------------------------

(Updated April 24, 2014, 1:03 p.m.)


Review request for oozie, Ryota Egashira and Purshotam Shah.


Bugs: OOZIE-1806
    https://issues.apache.org/jira/browse/OOZIE-1806


Repository: oozie-git


Description
-------

With oozie trunk, all java action type jobs are failing with hadoop 0.20.2 and earlier versions. This is a regression since oozie 4.0. The map tasks are failing with ClassNotFoundException for OozieLauncherInputFormat.EmptySplit class.


Diffs
-----

  core/src/main/java/org/apache/oozie/action/hadoop/JavaActionExecutor.java 6fcdf2a 

Diff: https://reviews.apache.org/r/20655/diff/


Testing
-------

- Ran unit tests.
- Verified manually on 0.20.2-CDH3u5 cluster that java action jobs are running successfully.


Thanks,

Satish Mittal


Re: Review Request 20655: OOZIE-1806: Java Action type jobs are failing with hadoop-0.20.0 and earlier versions on oozie trunk

Posted by Purshotam Shah <pu...@yahoo-inc.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20655/#review41320
-----------------------------------------------------------



core/src/main/java/org/apache/oozie/action/hadoop/JavaActionExecutor.java
<https://reviews.apache.org/r/20655/#comment74745>

    You can replace this with.
    
    addToCache(conf, appPath, path.trim(), true);
    


- Purshotam Shah


On April 24, 2014, 1:03 p.m., Satish Mittal wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/20655/
> -----------------------------------------------------------
> 
> (Updated April 24, 2014, 1:03 p.m.)
> 
> 
> Review request for oozie, Ryota Egashira and Purshotam Shah.
> 
> 
> Bugs: OOZIE-1806
>     https://issues.apache.org/jira/browse/OOZIE-1806
> 
> 
> Repository: oozie-git
> 
> 
> Description
> -------
> 
> With oozie trunk, all java action type jobs are failing with hadoop 0.20.2 and earlier versions. This is a regression since oozie 4.0. The map tasks are failing with ClassNotFoundException for OozieLauncherInputFormat.EmptySplit class.
> 
> 
> Diffs
> -----
> 
>   core/src/main/java/org/apache/oozie/action/hadoop/JavaActionExecutor.java 6fcdf2a 
> 
> Diff: https://reviews.apache.org/r/20655/diff/
> 
> 
> Testing
> -------
> 
> - Ran unit tests.
> - Verified manually on 0.20.2-CDH3u5 cluster that java action jobs are running successfully.
> 
> 
> Thanks,
> 
> Satish Mittal
> 
>


Re: Review Request 20655: OOZIE-1806: Java Action type jobs are failing with hadoop-0.20.0 and earlier versions on oozie trunk

Posted by Satish Mittal <sa...@apache.org>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20655/
-----------------------------------------------------------

(Updated May 6, 2014, 9:04 a.m.)


Review request for oozie, Ryota Egashira and Purshotam Shah.


Changes
-------

Attached new patch with JobUtils wrapper around addFileToClassPath.


Bugs: OOZIE-1806
    https://issues.apache.org/jira/browse/OOZIE-1806


Repository: oozie-git


Description
-------

With oozie trunk, all java action type jobs are failing with hadoop 0.20.2 and earlier versions. This is a regression since oozie 4.0. The map tasks are failing with ClassNotFoundException for OozieLauncherInputFormat.EmptySplit class.


Diffs (updated)
-----

  core/src/main/java/org/apache/oozie/action/hadoop/JavaActionExecutor.java d4b4f5e 
  core/src/main/java/org/apache/oozie/util/JobUtils.java 25eb735 

Diff: https://reviews.apache.org/r/20655/diff/


Testing
-------

- Ran unit tests.
- Verified manually on 0.20.2-CDH3u5 cluster that java action jobs are running successfully.


Thanks,

Satish Mittal


Re: Review Request 20655: OOZIE-1806: Java Action type jobs are failing with hadoop-0.20.0 and earlier versions on oozie trunk

Posted by Satish Mittal <sa...@apache.org>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20655/
-----------------------------------------------------------

(Updated May 5, 2014, 4:40 p.m.)


Review request for oozie, Ryota Egashira and Purshotam Shah.


Changes
-------

- Updated patch that replaces explicit calls to DistributedCache methods with call to addToCache().
- Verified the patch on hadoop-0.20 (CDH3u5) based cluster.


Bugs: OOZIE-1806
    https://issues.apache.org/jira/browse/OOZIE-1806


Repository: oozie-git


Description
-------

With oozie trunk, all java action type jobs are failing with hadoop 0.20.2 and earlier versions. This is a regression since oozie 4.0. The map tasks are failing with ClassNotFoundException for OozieLauncherInputFormat.EmptySplit class.


Diffs (updated)
-----

  core/src/main/java/org/apache/oozie/action/hadoop/JavaActionExecutor.java d4b4f5e 

Diff: https://reviews.apache.org/r/20655/diff/


Testing
-------

- Ran unit tests.
- Verified manually on 0.20.2-CDH3u5 cluster that java action jobs are running successfully.


Thanks,

Satish Mittal


Re: Review Request 20655: OOZIE-1806: Java Action type jobs are failing with hadoop-0.20.0 and earlier versions on oozie trunk

Posted by Rohini Palaniswamy <ro...@gmail.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20655/#review41317
-----------------------------------------------------------

Ship it!


Ship It!

- Rohini Palaniswamy


On April 24, 2014, 1:03 p.m., Satish Mittal wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/20655/
> -----------------------------------------------------------
> 
> (Updated April 24, 2014, 1:03 p.m.)
> 
> 
> Review request for oozie, Ryota Egashira and Purshotam Shah.
> 
> 
> Bugs: OOZIE-1806
>     https://issues.apache.org/jira/browse/OOZIE-1806
> 
> 
> Repository: oozie-git
> 
> 
> Description
> -------
> 
> With oozie trunk, all java action type jobs are failing with hadoop 0.20.2 and earlier versions. This is a regression since oozie 4.0. The map tasks are failing with ClassNotFoundException for OozieLauncherInputFormat.EmptySplit class.
> 
> 
> Diffs
> -----
> 
>   core/src/main/java/org/apache/oozie/action/hadoop/JavaActionExecutor.java 6fcdf2a 
> 
> Diff: https://reviews.apache.org/r/20655/diff/
> 
> 
> Testing
> -------
> 
> - Ran unit tests.
> - Verified manually on 0.20.2-CDH3u5 cluster that java action jobs are running successfully.
> 
> 
> Thanks,
> 
> Satish Mittal
> 
>


Re: Review Request 20655: OOZIE-1806: Java Action type jobs are failing with hadoop-0.20.0 and earlier versions on oozie trunk

Posted by Rohini Palaniswamy <ro...@gmail.com>.

> On April 24, 2014, 4:07 p.m., Rohini Palaniswamy wrote:
> > core/src/main/java/org/apache/oozie/action/hadoop/JavaActionExecutor.java, line 533
> > <https://reviews.apache.org/r/20655/diff/1/?file=567188#file567188line533>
> >
> >     Can you explain the change and how it resolves ClassNotFoundException for OozieLauncherInputFormat.EmptySplit ?

The explanation was in the jira. Thanks


- Rohini


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20655/#review41315
-----------------------------------------------------------


On April 24, 2014, 1:03 p.m., Satish Mittal wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/20655/
> -----------------------------------------------------------
> 
> (Updated April 24, 2014, 1:03 p.m.)
> 
> 
> Review request for oozie, Ryota Egashira and Purshotam Shah.
> 
> 
> Bugs: OOZIE-1806
>     https://issues.apache.org/jira/browse/OOZIE-1806
> 
> 
> Repository: oozie-git
> 
> 
> Description
> -------
> 
> With oozie trunk, all java action type jobs are failing with hadoop 0.20.2 and earlier versions. This is a regression since oozie 4.0. The map tasks are failing with ClassNotFoundException for OozieLauncherInputFormat.EmptySplit class.
> 
> 
> Diffs
> -----
> 
>   core/src/main/java/org/apache/oozie/action/hadoop/JavaActionExecutor.java 6fcdf2a 
> 
> Diff: https://reviews.apache.org/r/20655/diff/
> 
> 
> Testing
> -------
> 
> - Ran unit tests.
> - Verified manually on 0.20.2-CDH3u5 cluster that java action jobs are running successfully.
> 
> 
> Thanks,
> 
> Satish Mittal
> 
>


Re: Review Request 20655: OOZIE-1806: Java Action type jobs are failing with hadoop-0.20.0 and earlier versions on oozie trunk

Posted by Rohini Palaniswamy <ro...@gmail.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/20655/#review41315
-----------------------------------------------------------



core/src/main/java/org/apache/oozie/action/hadoop/JavaActionExecutor.java
<https://reviews.apache.org/r/20655/#comment74740>

    Can you explain the change and how it resolves ClassNotFoundException for OozieLauncherInputFormat.EmptySplit ? 


- Rohini Palaniswamy


On April 24, 2014, 1:03 p.m., Satish Mittal wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/20655/
> -----------------------------------------------------------
> 
> (Updated April 24, 2014, 1:03 p.m.)
> 
> 
> Review request for oozie, Ryota Egashira and Purshotam Shah.
> 
> 
> Bugs: OOZIE-1806
>     https://issues.apache.org/jira/browse/OOZIE-1806
> 
> 
> Repository: oozie-git
> 
> 
> Description
> -------
> 
> With oozie trunk, all java action type jobs are failing with hadoop 0.20.2 and earlier versions. This is a regression since oozie 4.0. The map tasks are failing with ClassNotFoundException for OozieLauncherInputFormat.EmptySplit class.
> 
> 
> Diffs
> -----
> 
>   core/src/main/java/org/apache/oozie/action/hadoop/JavaActionExecutor.java 6fcdf2a 
> 
> Diff: https://reviews.apache.org/r/20655/diff/
> 
> 
> Testing
> -------
> 
> - Ran unit tests.
> - Verified manually on 0.20.2-CDH3u5 cluster that java action jobs are running successfully.
> 
> 
> Thanks,
> 
> Satish Mittal
> 
>