You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by Denes Bodo <bo...@gmail.com> on 2019/07/26 11:43:37 UTC

Review Request 71168: Oozie not supported for s3 as filesystem

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71168/
-----------------------------------------------------------

Review request for oozie.


Bugs: OOZIE-3529
    https://issues.apache.org/jira/browse/OOZIE-3529


Repository: oozie-git


Description
-------

Many customer who uses s3 file system as secondary one experiences "UnsupportedOperationException: Accessing local file system is not allowed" error when Oozie tries to submit the Yarn application.


Diffs
-----

  core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java 0b53a3611 
  core/src/test/java/org/apache/oozie/service/TestHadoopAccessorService.java 89ce18550 


Diff: https://reviews.apache.org/r/71168/diff/1/


Testing
-------


Thanks,

Denes Bodo


Re: Review Request 71168: Oozie not supported for s3 as filesystem

Posted by Denes Bodo <bo...@gmail.com>.

> On July 26, 2019, 4:05 p.m., Andras Salamon wrote:
> > core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java
> > Lines 638 (patched)
> > <https://reviews.apache.org/r/71168/diff/1/?file=2157981#file2157981line638>
> >
> >     The property name contains the uri scheme, so it will not be possible to list all the possible properties in the oozie-default.xml. It means that we will get lots of "Invalid configuration defined" warning messages (see OOZIE-2338).
> >     
> >     Could you modify ConfigurationService.verifyConfigurationName() just like in the OOZIE-2338 do ingore the warnings.
> 
> Denes Bodo wrote:
>     I think this kind of work is out of scope of this fix. Also number of file systems which shall have custom properties are quite few so in my opinion defining the options in oozie-default.xml with description will help the user to set the configuration more easily.
> 
> Andras Salamon wrote:
>     OK, please open an upstream jira about this limitation, Oozie will print out warnings if someone wants to set filesystem properties other then s3a and link it this this jira and also to OOZIE-2338.

https://issues.apache.org/jira/browse/OOZIE-3546


> On July 26, 2019, 4:05 p.m., Andras Salamon wrote:
> > core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java
> > Lines 646 (patched)
> > <https://reviews.apache.org/r/71168/diff/1/?file=2157981#file2157981line646>
> >
> >     What if a property value contains ","? This solution does not allow that. I'm not familiar with the fs properties. Can we safely assume that there is no , is the values?
> 
> Denes Bodo wrote:
>     This is documented now, we will not allow to use comma in property values nor in property names.
> 
> Andras Salamon wrote:
>     OK, we can live with this limitation now. Could you please also add a sentence to the oozie-default.xml description that we don't allow commas in the property values. 
>     Also please open a new upstream jira which will fix that (no need to solve the jira in foreseable future but show that we plan to do that).

https://issues.apache.org/jira/browse/OOZIE-3547


- Denes


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71168/#review216891
-----------------------------------------------------------


On Oct. 1, 2019, 8:09 a.m., Denes Bodo wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71168/
> -----------------------------------------------------------
> 
> (Updated Oct. 1, 2019, 8:09 a.m.)
> 
> 
> Review request for oozie and Andras Salamon.
> 
> 
> Bugs: OOZIE-3529
>     https://issues.apache.org/jira/browse/OOZIE-3529
> 
> 
> Repository: oozie-git
> 
> 
> Description
> -------
> 
> Many customer who uses s3 file system as secondary one experiences "UnsupportedOperationException: Accessing local file system is not allowed" error when Oozie tries to submit the Yarn application.
> 
> 
> Diffs
> -----
> 
>   core/pom.xml d2a211a89 
>   core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java 0b53a3611 
>   core/src/main/resources/oozie-default.xml f33c7b938 
>   core/src/test/java/org/apache/oozie/service/TestHadoopAccessorService.java 89ce18550 
>   core/src/test/java/org/apache/oozie/test/XFsTestCase.java c0f3c6959 
>   docs/src/site/markdown/AG_HadoopConfiguration.md ab71d7cb6 
> 
> 
> Diff: https://reviews.apache.org/r/71168/diff/3/
> 
> 
> Testing
> -------
> 
> 
> Thanks,
> 
> Denes Bodo
> 
>


Re: Review Request 71168: Oozie not supported for s3 as filesystem

Posted by Denes Bodo <bo...@gmail.com>.

> On July 26, 2019, 4:05 p.m., Andras Salamon wrote:
> > core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java
> > Lines 638 (patched)
> > <https://reviews.apache.org/r/71168/diff/1/?file=2157981#file2157981line638>
> >
> >     The property name contains the uri scheme, so it will not be possible to list all the possible properties in the oozie-default.xml. It means that we will get lots of "Invalid configuration defined" warning messages (see OOZIE-2338).
> >     
> >     Could you modify ConfigurationService.verifyConfigurationName() just like in the OOZIE-2338 do ingore the warnings.

I think this kind of work is out of scope of this fix. Also number of file systems which shall have custom properties are quite few so in my opinion defining the options in oozie-default.xml with description will help the user to set the configuration more easily.


> On July 26, 2019, 4:05 p.m., Andras Salamon wrote:
> > core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java
> > Lines 646 (patched)
> > <https://reviews.apache.org/r/71168/diff/1/?file=2157981#file2157981line646>
> >
> >     What if a property value contains ","? This solution does not allow that. I'm not familiar with the fs properties. Can we safely assume that there is no , is the values?

This is documented now, we will not allow to use comma in property values nor in property names.


> On July 26, 2019, 4:05 p.m., Andras Salamon wrote:
> > core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java
> > Lines 648 (patched)
> > <https://reviews.apache.org/r/71168/diff/1/?file=2157981#file2157981line648>
> >
> >     We should not expect that the entry contains an = sign. Without the = we get ArrayOutOfBoundsException.
> >     
> >     What if it's a=b=c? Should we just ignore the =c part? At least we should print out a warning. Maybe we can just give an error and ignore the whole parameter.
> >     
> >     The solution also assumes that there are no = character in the value.

You are correct. In case there is a property which contains equal sign, then from the second one will be part of the *value*. Please see the update patch.


> On July 26, 2019, 4:05 p.m., Andras Salamon wrote:
> > core/src/test/java/org/apache/oozie/service/TestHadoopAccessorService.java
> > Lines 358 (patched)
> > <https://reviews.apache.org/r/71168/diff/1/?file=2157982#file2157982line358>
> >
> >     Please add a few properties to this empty configuration. It would improve this test.

I do not really think that here we shall add more properties. The purpose of the test is to check the configuration object is untouched.


- Denes


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71168/#review216891
-----------------------------------------------------------


On July 26, 2019, 1:43 p.m., Denes Bodo wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71168/
> -----------------------------------------------------------
> 
> (Updated July 26, 2019, 1:43 p.m.)
> 
> 
> Review request for oozie.
> 
> 
> Bugs: OOZIE-3529
>     https://issues.apache.org/jira/browse/OOZIE-3529
> 
> 
> Repository: oozie-git
> 
> 
> Description
> -------
> 
> Many customer who uses s3 file system as secondary one experiences "UnsupportedOperationException: Accessing local file system is not allowed" error when Oozie tries to submit the Yarn application.
> 
> 
> Diffs
> -----
> 
>   core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java 0b53a3611 
>   core/src/test/java/org/apache/oozie/service/TestHadoopAccessorService.java 89ce18550 
> 
> 
> Diff: https://reviews.apache.org/r/71168/diff/1/
> 
> 
> Testing
> -------
> 
> 
> Thanks,
> 
> Denes Bodo
> 
>


Re: Review Request 71168: Oozie not supported for s3 as filesystem

Posted by Andras Salamon <an...@melda.info>.

> On July 26, 2019, 2:05 p.m., Andras Salamon wrote:
> > core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java
> > Lines 638 (patched)
> > <https://reviews.apache.org/r/71168/diff/1/?file=2157981#file2157981line638>
> >
> >     The property name contains the uri scheme, so it will not be possible to list all the possible properties in the oozie-default.xml. It means that we will get lots of "Invalid configuration defined" warning messages (see OOZIE-2338).
> >     
> >     Could you modify ConfigurationService.verifyConfigurationName() just like in the OOZIE-2338 do ingore the warnings.
> 
> Denes Bodo wrote:
>     I think this kind of work is out of scope of this fix. Also number of file systems which shall have custom properties are quite few so in my opinion defining the options in oozie-default.xml with description will help the user to set the configuration more easily.

OK, please open an upstream jira about this limitation, Oozie will print out warnings if someone wants to set filesystem properties other then s3a and link it this this jira and also to OOZIE-2338.


> On July 26, 2019, 2:05 p.m., Andras Salamon wrote:
> > core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java
> > Lines 646 (patched)
> > <https://reviews.apache.org/r/71168/diff/1/?file=2157981#file2157981line646>
> >
> >     What if a property value contains ","? This solution does not allow that. I'm not familiar with the fs properties. Can we safely assume that there is no , is the values?
> 
> Denes Bodo wrote:
>     This is documented now, we will not allow to use comma in property values nor in property names.

OK, we can live with this limitation now. Could you please also add a sentence to the oozie-default.xml description that we don't allow commas in the property values. 
Also please open a new upstream jira which will fix that (no need to solve the jira in foreseable future but show that we plan to do that).


> On July 26, 2019, 2:05 p.m., Andras Salamon wrote:
> > core/src/test/java/org/apache/oozie/service/TestHadoopAccessorService.java
> > Lines 358 (patched)
> > <https://reviews.apache.org/r/71168/diff/1/?file=2157982#file2157982line358>
> >
> >     Please add a few properties to this empty configuration. It would improve this test.
> 
> Denes Bodo wrote:
>     I do not really think that here we shall add more properties. The purpose of the test is to check the configuration object is untouched.

Yes, but it's much easier to contain the same properties if the original list is empty. For instance a method which deletes all the properties will pass that test but it's definitely not a good implementation. I think adding one fake property will improve the test.


- Andras


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71168/#review216891
-----------------------------------------------------------


On Oct. 1, 2019, 6:09 a.m., Denes Bodo wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71168/
> -----------------------------------------------------------
> 
> (Updated Oct. 1, 2019, 6:09 a.m.)
> 
> 
> Review request for oozie and Andras Salamon.
> 
> 
> Bugs: OOZIE-3529
>     https://issues.apache.org/jira/browse/OOZIE-3529
> 
> 
> Repository: oozie-git
> 
> 
> Description
> -------
> 
> Many customer who uses s3 file system as secondary one experiences "UnsupportedOperationException: Accessing local file system is not allowed" error when Oozie tries to submit the Yarn application.
> 
> 
> Diffs
> -----
> 
>   core/pom.xml d2a211a89 
>   core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java 0b53a3611 
>   core/src/main/resources/oozie-default.xml f33c7b938 
>   core/src/test/java/org/apache/oozie/service/TestHadoopAccessorService.java 89ce18550 
>   core/src/test/java/org/apache/oozie/test/XFsTestCase.java c0f3c6959 
>   docs/src/site/markdown/AG_HadoopConfiguration.md ab71d7cb6 
> 
> 
> Diff: https://reviews.apache.org/r/71168/diff/3/
> 
> 
> Testing
> -------
> 
> 
> Thanks,
> 
> Denes Bodo
> 
>


Re: Review Request 71168: Oozie not supported for s3 as filesystem

Posted by Andras Salamon <an...@melda.info>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71168/#review216891
-----------------------------------------------------------




core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java
Lines 638 (patched)
<https://reviews.apache.org/r/71168/#comment304133>

    The property name contains the uri scheme, so it will not be possible to list all the possible properties in the oozie-default.xml. It means that we will get lots of "Invalid configuration defined" warning messages (see OOZIE-2338).
    
    Could you modify ConfigurationService.verifyConfigurationName() just like in the OOZIE-2338 do ingore the warnings.



core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java
Lines 646 (patched)
<https://reviews.apache.org/r/71168/#comment304131>

    What if a property value contains ","? This solution does not allow that. I'm not familiar with the fs properties. Can we safely assume that there is no , is the values?



core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java
Lines 647 (patched)
<https://reviews.apache.org/r/71168/#comment304132>

    Could we find a more java friendly variable name?



core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java
Lines 648 (patched)
<https://reviews.apache.org/r/71168/#comment304130>

    We should not expect that the entry contains an = sign. Without the = we get ArrayOutOfBoundsException.
    
    What if it's a=b=c? Should we just ignore the =c part? At least we should print out a warning. Maybe we can just give an error and ignore the whole parameter.
    
    The solution also assumes that there are no = character in the value.



core/src/test/java/org/apache/oozie/service/TestHadoopAccessorService.java
Lines 355 (patched)
<https://reviews.apache.org/r/71168/#comment304135>

    Please add a few test cases with invalid values. 
    
    For instance one without the = sign should check if we avoid ArrayOutOfBoundsException.



core/src/test/java/org/apache/oozie/service/TestHadoopAccessorService.java
Lines 358 (patched)
<https://reviews.apache.org/r/71168/#comment304134>

    Please add a few properties to this empty configuration. It would improve this test.


- Andras Salamon


On July 26, 2019, 11:43 a.m., Denes Bodo wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71168/
> -----------------------------------------------------------
> 
> (Updated July 26, 2019, 11:43 a.m.)
> 
> 
> Review request for oozie.
> 
> 
> Bugs: OOZIE-3529
>     https://issues.apache.org/jira/browse/OOZIE-3529
> 
> 
> Repository: oozie-git
> 
> 
> Description
> -------
> 
> Many customer who uses s3 file system as secondary one experiences "UnsupportedOperationException: Accessing local file system is not allowed" error when Oozie tries to submit the Yarn application.
> 
> 
> Diffs
> -----
> 
>   core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java 0b53a3611 
>   core/src/test/java/org/apache/oozie/service/TestHadoopAccessorService.java 89ce18550 
> 
> 
> Diff: https://reviews.apache.org/r/71168/diff/1/
> 
> 
> Testing
> -------
> 
> 
> Thanks,
> 
> Denes Bodo
> 
>


Re: Review Request 71168: Oozie not supported for s3 as filesystem

Posted by Denes Bodo <bo...@gmail.com>.

> On Sept. 27, 2019, 10:19 a.m., Andras Salamon wrote:
> > docs/src/site/markdown/AG_HadoopConfiguration.md
> > Lines 89 (patched)
> > <https://reviews.apache.org/r/71168/diff/2/?file=2166642#file2166642line89>
> >
> >     Instead of "now" please use "since 5.2.0". It will be quite helpful if someone wants to find the first version which supports this feature. (It's a bit confusing before the 5.2.0 release, but better in the long run).

I totally agree with you, @asalamon74.


> On Sept. 27, 2019, 10:19 a.m., Andras Salamon wrote:
> > docs/src/site/markdown/AG_HadoopConfiguration.md
> > Lines 97 (patched)
> > <https://reviews.apache.org/r/71168/diff/2/?file=2166642#file2166642line97>
> >
> >     I think you should use \`aaaa\` instead of \`\`\`aaaa\`\`\` if you want an inline code block.
> >     
> >     A space is missing: thefile

Thank you for noticing it. IDEA showed that me correctly. However, I agree with you.


- Denes


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71168/#review217962
-----------------------------------------------------------


On Oct. 1, 2019, 8:09 a.m., Denes Bodo wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71168/
> -----------------------------------------------------------
> 
> (Updated Oct. 1, 2019, 8:09 a.m.)
> 
> 
> Review request for oozie and Andras Salamon.
> 
> 
> Bugs: OOZIE-3529
>     https://issues.apache.org/jira/browse/OOZIE-3529
> 
> 
> Repository: oozie-git
> 
> 
> Description
> -------
> 
> Many customer who uses s3 file system as secondary one experiences "UnsupportedOperationException: Accessing local file system is not allowed" error when Oozie tries to submit the Yarn application.
> 
> 
> Diffs
> -----
> 
>   core/pom.xml d2a211a89 
>   core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java 0b53a3611 
>   core/src/main/resources/oozie-default.xml f33c7b938 
>   core/src/test/java/org/apache/oozie/service/TestHadoopAccessorService.java 89ce18550 
>   core/src/test/java/org/apache/oozie/test/XFsTestCase.java c0f3c6959 
>   docs/src/site/markdown/AG_HadoopConfiguration.md ab71d7cb6 
> 
> 
> Diff: https://reviews.apache.org/r/71168/diff/3/
> 
> 
> Testing
> -------
> 
> 
> Thanks,
> 
> Denes Bodo
> 
>


Re: Review Request 71168: Oozie not supported for s3 as filesystem

Posted by Andras Salamon <an...@melda.info>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71168/#review217962
-----------------------------------------------------------




docs/src/site/markdown/AG_HadoopConfiguration.md
Lines 88 (patched)
<https://reviews.apache.org/r/71168/#comment305361>

    Great idea to link to the jira.



docs/src/site/markdown/AG_HadoopConfiguration.md
Lines 89 (patched)
<https://reviews.apache.org/r/71168/#comment305360>

    Instead of "now" please use "since 5.2.0". It will be quite helpful if someone wants to find the first version which supports this feature. (It's a bit confusing before the 5.2.0 release, but better in the long run).



docs/src/site/markdown/AG_HadoopConfiguration.md
Lines 97 (patched)
<https://reviews.apache.org/r/71168/#comment305362>

    I think you should use \`aaaa\` instead of \`\`\`aaaa\`\`\` if you want an inline code block.
    
    A space is missing: thefile


- Andras Salamon


On Sept. 25, 2019, 1:41 p.m., Denes Bodo wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/71168/
> -----------------------------------------------------------
> 
> (Updated Sept. 25, 2019, 1:41 p.m.)
> 
> 
> Review request for oozie and Andras Salamon.
> 
> 
> Bugs: OOZIE-3529
>     https://issues.apache.org/jira/browse/OOZIE-3529
> 
> 
> Repository: oozie-git
> 
> 
> Description
> -------
> 
> Many customer who uses s3 file system as secondary one experiences "UnsupportedOperationException: Accessing local file system is not allowed" error when Oozie tries to submit the Yarn application.
> 
> 
> Diffs
> -----
> 
>   core/pom.xml d2a211a89 
>   core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java 0b53a3611 
>   core/src/main/resources/oozie-default.xml f33c7b938 
>   core/src/test/java/org/apache/oozie/service/TestHadoopAccessorService.java 89ce18550 
>   core/src/test/java/org/apache/oozie/test/XFsTestCase.java c0f3c6959 
>   docs/src/site/markdown/AG_HadoopConfiguration.md ab71d7cb6 
> 
> 
> Diff: https://reviews.apache.org/r/71168/diff/2/
> 
> 
> Testing
> -------
> 
> 
> Thanks,
> 
> Denes Bodo
> 
>


Re: Review Request 71168: Oozie not supported for s3 as filesystem

Posted by Denes Bodo <bo...@gmail.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71168/
-----------------------------------------------------------

(Updated Oct. 4, 2019, 8:48 a.m.)


Review request for oozie and Andras Salamon.


Bugs: OOZIE-3529
    https://issues.apache.org/jira/browse/OOZIE-3529


Repository: oozie-git


Description
-------

Many customer who uses s3 file system as secondary one experiences "UnsupportedOperationException: Accessing local file system is not allowed" error when Oozie tries to submit the Yarn application.


Diffs (updated)
-----

  core/pom.xml d2a211a89 
  core/pom.xml d2a211a89 
  core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java 0b53a3611 
  core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java 0b53a3611 
  core/src/main/resources/oozie-default.xml f33c7b938 
  core/src/main/resources/oozie-default.xml f33c7b938 
  core/src/test/java/org/apache/oozie/service/TestHadoopAccessorService.java 89ce18550 
  core/src/test/java/org/apache/oozie/service/TestHadoopAccessorService.java 89ce18550 
  core/src/test/java/org/apache/oozie/test/XFsTestCase.java c0f3c6959 
  core/src/test/java/org/apache/oozie/test/XFsTestCase.java c0f3c6959 
  docs/src/site/markdown/AG_HadoopConfiguration.md ab71d7cb6 
  docs/src/site/markdown/AG_HadoopConfiguration.md ab71d7cb6 


Diff: https://reviews.apache.org/r/71168/diff/4/

Changes: https://reviews.apache.org/r/71168/diff/3-4/


Testing
-------


Thanks,

Denes Bodo


Re: Review Request 71168: Oozie not supported for s3 as filesystem

Posted by Denes Bodo <bo...@gmail.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71168/
-----------------------------------------------------------

(Updated Oct. 1, 2019, 8:09 a.m.)


Review request for oozie and Andras Salamon.


Bugs: OOZIE-3529
    https://issues.apache.org/jira/browse/OOZIE-3529


Repository: oozie-git


Description
-------

Many customer who uses s3 file system as secondary one experiences "UnsupportedOperationException: Accessing local file system is not allowed" error when Oozie tries to submit the Yarn application.


Diffs (updated)
-----

  core/pom.xml d2a211a89 
  core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java 0b53a3611 
  core/src/main/resources/oozie-default.xml f33c7b938 
  core/src/test/java/org/apache/oozie/service/TestHadoopAccessorService.java 89ce18550 
  core/src/test/java/org/apache/oozie/test/XFsTestCase.java c0f3c6959 
  docs/src/site/markdown/AG_HadoopConfiguration.md ab71d7cb6 


Diff: https://reviews.apache.org/r/71168/diff/3/

Changes: https://reviews.apache.org/r/71168/diff/2-3/


Testing
-------


Thanks,

Denes Bodo


Re: Review Request 71168: Oozie not supported for s3 as filesystem

Posted by Denes Bodo <bo...@gmail.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71168/
-----------------------------------------------------------

(Updated Sept. 25, 2019, 3:41 p.m.)


Review request for oozie.


Bugs: OOZIE-3529
    https://issues.apache.org/jira/browse/OOZIE-3529


Repository: oozie-git


Description
-------

Many customer who uses s3 file system as secondary one experiences "UnsupportedOperationException: Accessing local file system is not allowed" error when Oozie tries to submit the Yarn application.


Diffs (updated)
-----

  core/pom.xml d2a211a89 
  core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java 0b53a3611 
  core/src/main/resources/oozie-default.xml f33c7b938 
  core/src/test/java/org/apache/oozie/service/TestHadoopAccessorService.java 89ce18550 
  core/src/test/java/org/apache/oozie/test/XFsTestCase.java c0f3c6959 
  docs/src/site/markdown/AG_HadoopConfiguration.md ab71d7cb6 


Diff: https://reviews.apache.org/r/71168/diff/2/

Changes: https://reviews.apache.org/r/71168/diff/1-2/


Testing
-------


Thanks,

Denes Bodo