You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@oozie.apache.org by Zsombor Gegesy <zs...@apache.org> on 2019/09/06 10:02:31 UTC

Review Request 71443: OOZIE-3542: Handle better HDFS implementation, where the server doesn't handle the setErasureCodingPolicy call

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/71443/
-----------------------------------------------------------

Review request for oozie.


Bugs: OOZIE-3542
    https://issues.apache.org/jira/browse/OOZIE-3542


Repository: oozie-git


Description
-------

Currently, ECPolicyDisabler checks if the local hdfs implementation has the necessary methods to get and set erasure coding policy. However, if the namenode implementation is old, it could throw a org.apache.hadoop.ipc.RemoteException with RpcErrorCodeProto.ERROR_NO_SUCH_METHOD value in it.
In this case, ECPolicyDisabler fails, and prevents the installation to succeed.

This case should be handled just like, when erasure coding is not supported.


Diffs
-----

  tools/src/main/java/org/apache/oozie/tools/ECPolicyDisabler.java 2d7f1f86d 
  tools/src/test/java/org/apache/hadoop/hdfs/protocol/SystemErasureCodingPolicies.java PRE-CREATION 
  tools/src/test/java/org/apache/oozie/tools/ECPolicyDisablerTest.java PRE-CREATION 


Diff: https://reviews.apache.org/r/71443/diff/1/


Testing
-------

With unit tests, and on cluster


Thanks,

Zsombor Gegesy