You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zeppelin.apache.org by "Maziyar PANAHI (JIRA)" <ji...@apache.org> on 2019/02/03 17:02:00 UTC
[jira] [Created] (ZEPPELIN-3987) Zeppelin 0.9.0 fail to access
Notebooks from HDFS
Maziyar PANAHI created ZEPPELIN-3987:
----------------------------------------
Summary: Zeppelin 0.9.0 fail to access Notebooks from HDFS
Key: ZEPPELIN-3987
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3987
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.9.0
Environment: Cloudera 6.1
Spark 2.4
Hadoop 3.0
Shiro, LDAP
Reporter: Maziyar PANAHI
Attachments: Screenshot 2019-02-03 17.59.35.png
Hi,
I have built Zeppelin-0.9.0-SNAPSHOT and copied my configs from previous version 0.8.2 into this new directory. Usually, all the versions after 0.8.0 (0.8.1, 0.8.2) immediately after start will fetch all the notebooks from HDFS. However, in 0.9.0 the UI is empty and the logs also indicate the reading Notebooks did not happen.
{code:java}
<property> <name>zeppelin.notebook.storage</name> <value>org.apache.zeppelin.notebook.repo.FileSystemNotebookRepo</value> <description>hadoop compatible file system notebook persistence layer implementation</description> </property>
<property> <name>zeppelin.notebook.dir</name> <value>hdfs://hadoop-master-1:8020/user/zeppelin/notebook</value> <description>path or URI for notebook persist</description> </property>
{code}
The startup logs:
{code:java}
INFO [2019-02-03 17:55:41,797] ({main} ZeppelinConfiguration.java[create]:127) - Load configuration from file:/opt/zeppelin-0.9.0-SNAPSHOT/conf/zeppelin-site.xml
INFO [2019-02-03 17:55:41,856] ({main} ZeppelinConfiguration.java[create]:135) - Server Host: 0.0.0.0
INFO [2019-02-03 17:55:41,857] ({main} ZeppelinConfiguration.java[create]:137) - Server Port: 8080
INFO [2019-02-03 17:55:41,857] ({main} ZeppelinConfiguration.java[create]:141) - Context Path: /
INFO [2019-02-03 17:55:41,857] ({main} ZeppelinConfiguration.java[create]:142) - Zeppelin Version: 0.9.0-SNAPSHOT
INFO [2019-02-03 17:55:41,876] ({main} Log.java[initialized]:193) - Logging initialized @440ms to org.eclipse.jetty.util.log.Slf4jLog
WARN [2019-02-03 17:55:41,994] ({main} ServerConnector.java[setSoLingerTime]:458) - Ignoring deprecated socket close linger time
INFO [2019-02-03 17:55:42,064] ({main} ZeppelinServer.java[setupWebAppContext]:403) - ZeppelinServer Webapp path: /opt/zeppelin-0.9.0-SNAPSHOT/webapps
WARN [2019-02-03 17:55:42,223] ({main} NotebookAuthorization.java[getInstance]:79) - Notebook authorization module was called without initialization, initializing with default configuration
WARN [2019-02-03 17:55:42,225] ({main} ZeppelinConfiguration.java[getConfigFSDir]:545) - zeppelin.config.fs.dir is not specified, fall back to local conf directory zeppelin.conf.dir
WARN [2019-02-03 17:55:42,225] ({main} ZeppelinConfiguration.java[getConfigFSDir]:545) - zeppelin.config.fs.dir is not specified, fall back to local conf directory zeppelin.conf.dir
INFO [2019-02-03 17:55:42,225] ({main} LocalConfigStorage.java[loadNotebookAuthorization]:84) - Load notebook authorization from file: /opt/zeppelin-0.9.0-SNAPSHOT/conf/notebook-authorization.json
INFO [2019-02-03 17:55:42,279] ({main} Credentials.java[loadFromFile]:121) - /opt/zeppelin-0.9.0-SNAPSHOT/conf/credentials.json
INFO [2019-02-03 17:55:42,350] ({main} NotebookServer.java[<init>]:145) - NotebookServer instantiated: org.apache.zeppelin.socket.NotebookServer@ae13544
INFO [2019-02-03 17:55:42,350] ({main} NotebookServer.java[setServiceLocator]:150) - Injected ServiceLocator: ServiceLocatorImpl(shared-locator,0,1089504328)
INFO [2019-02-03 17:55:42,351] ({main} NotebookServer.java[setNotebook]:156) - Injected NotebookProvider
INFO [2019-02-03 17:55:42,353] ({main} NotebookServer.java[setNotebookService]:163) - Injected NotebookServiceProvider
INFO [2019-02-03 17:55:42,359] ({main} ZeppelinServer.java[main]:233) - Starting zeppelin server
INFO [2019-02-03 17:55:42,361] ({main} Server.java[doStart]:370) - jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_201-b09
INFO [2019-02-03 17:55:44,696] ({main} StandardDescriptorProcessor.java[visitServlet]:283) - NO JSP Support for /, did not find org.eclipse.jetty.jsp.JettyJspServlet
INFO [2019-02-03 17:55:44,711] ({main} DefaultSessionIdManager.java[doStart]:365) - DefaultSessionIdManager workerName=node0
INFO [2019-02-03 17:55:44,711] ({main} DefaultSessionIdManager.java[doStart]:370) - No SessionScavenger set, using defaults
INFO [2019-02-03 17:55:44,713] ({main} HouseKeeper.java[startScavenging]:149) - node0 Scavenging every 660000ms
INFO [2019-02-03 17:55:44,720] ({main} ContextHandler.java[log]:2345) - Initializing Shiro environment
INFO [2019-02-03 17:55:44,720] ({main} EnvironmentLoader.java[initEnvironment]:133) - Starting Shiro environment initialization.
INFO [2019-02-03 17:55:45,078] ({main} IniRealm.java[processDefinitions]:188) - IniRealm defined, but there is no [users] section defined. This realm will not be populated with any users and it is assumed that they will be populated programatically. Users must be defined for this Realm instance to be useful.
INFO [2019-02-03 17:55:45,078] ({main} IniSecurityManagerFactory.java[isAutoApplyRealms]:127) - Realms have been explicitly set on the SecurityManager instance - auto-setting of realms will not occur.
INFO [2019-02-03 17:55:45,082] ({main} EnvironmentLoader.java[initEnvironment]:147) - Shiro environment initialized in 361 ms.
INFO [2019-02-03 17:55:46,010] ({main} ContextHandler.java[doStart]:855) - Started o.e.j.w.WebAppContext@38e79ae3{zeppelin-web,/,file:///opt/zeppelin-0.9.0-SNAPSHOT/webapps/webapp/,AVAILABLE}{/opt/zeppelin-0.9.0-SNAPSHOT/zeppelin-web-0.9.0-SNAPSHOT.war}
INFO [2019-02-03 17:55:46,027] ({main} AbstractConnector.java[doStart]:292) - Started ServerConnector@7a18e8d{HTTP/1.1,[http/1.1]}{0.0.0.0:8080}
INFO [2019-02-03 17:55:46,027] ({main} Server.java[doStart]:407) - Started @4593ms
INFO [2019-02-03 17:55:46,027] ({main} ZeppelinServer.java[main]:243) - Done, zeppelin server started
{code}
Built by
{code:java}
mvn clean package -Pbuild-distr -DskipTests -Pspark-2.4 -Pscala-2.11 -pl '!beam'
{code}
And
{code:java}
mvn clean package -Pbuild-distr -DskipTests -Dhadoop3 -Pspark-2.4 -Pscala-2.11 -pl '!beam'
{code}
With the same result of missing Notebooks. If I start my Zeppelin 0.8.x with the same conf directory, all the notebooks are there.
Thanks.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)