You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@zeppelin.apache.org by zj...@apache.org on 2018/08/30 03:23:30 UTC

zeppelin git commit: ZEPPELIN-3745. Disable CRC check of hadoop FileSystem

Repository: zeppelin
Updated Branches:
  refs/heads/master a11fc9ee2 -> 26b554d64


ZEPPELIN-3745. Disable CRC check of hadoop FileSystem

### What is this PR for?
Trivial PR to disable CRC check of hadoop FileSystem, otherwise we may get error if we manually change the file content of interpreter-setting.json

### What type of PR is it?
[Bug Fix]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-3745

### How should this be tested?
* CI pass

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Jeff Zhang <zj...@apache.org>

Closes #3162 from zjffdu/ZEPPELIN-3745 and squashes the following commits:

67dc70df2 [Jeff Zhang] ZEPPELIN-3745. Disable CRC check of hadoop FileSystem


Project: http://git-wip-us.apache.org/repos/asf/zeppelin/repo
Commit: http://git-wip-us.apache.org/repos/asf/zeppelin/commit/26b554d6
Tree: http://git-wip-us.apache.org/repos/asf/zeppelin/tree/26b554d6
Diff: http://git-wip-us.apache.org/repos/asf/zeppelin/diff/26b554d6

Branch: refs/heads/master
Commit: 26b554d64123490ceee1b05c77e3ea51dbff6412
Parents: a11fc9e
Author: Jeff Zhang <zj...@apache.org>
Authored: Fri Aug 24 10:08:08 2018 +0800
Committer: Jeff Zhang <zj...@apache.org>
Committed: Thu Aug 30 11:23:24 2018 +0800

----------------------------------------------------------------------
 .../main/java/org/apache/zeppelin/notebook/FileSystemStorage.java  | 2 ++
 1 file changed, 2 insertions(+)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/zeppelin/blob/26b554d6/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/FileSystemStorage.java
----------------------------------------------------------------------
diff --git a/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/FileSystemStorage.java b/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/FileSystemStorage.java
index 4670e20..ebec118 100644
--- a/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/FileSystemStorage.java
+++ b/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/FileSystemStorage.java
@@ -62,6 +62,8 @@ public class FileSystemStorage {
     this.hadoopConf = new Configuration();
     // disable checksum for local file system. because interpreter.json may be updated by
     // non-hadoop filesystem api
+    // disable caching for file:// scheme to avoid getting LocalFS which does CRC checks
+    this.hadoopConf.setBoolean("fs.file.impl.disable.cache", true);
     this.hadoopConf.set("fs.file.impl", RawLocalFileSystem.class.getName());
     this.isSecurityEnabled = UserGroupInformation.isSecurityEnabled();