[jira] [Created] (ZEPPELIN-2115) Could not rename .note.json to note.json in afterStatusChange after a terminated job

["Frank Rosner (JIRA)" <ji...@apache.org>]

Frank Rosner created ZEPPELIN-2115:
--------------------------------------

             Summary: Could not rename .note.json to note.json in afterStatusChange after a terminated job
                 Key: ZEPPELIN-2115
                 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2115
             Project: Zeppelin
          Issue Type: Bug
    Affects Versions: 0.7.0
            Reporter: Frank Rosner


h4. Problem

When using a notebook on some actions we are getting the following error messages. Looking at the filesystem after some time we actually are able to see the file so it managed to rename it eventually. Could that be some kind of race condition when editing the note while some jobs are running or running different jobs (of different interpreters) at the same time?

It happened, e.g., when clicking "run all" but also in other situations it seems.

h4. Error

{noformat}
ERROR [2017-02-14 15:31:32,681] ({pool-2-thread-59} NotebookServer.java[afterStatusChange]:2034) - org.apache.commons.vfs2.FileSystemException: Could not rename "file:///usr/local/zeppelin/notebooks/2C9UB669K/.note.json" to "file:///usr/local/zeppelin/notebooks/2C9UB669K/note.json".
org.apache.commons.vfs2.FileSystemException: Could not rename "file:///usr/local/zeppelin/notebooks/2C9UB669K/.note.json" to "file:///usr/local/zeppelin/notebooks/2C9UB669K/note.json".
	at org.apache.commons.vfs2.provider.AbstractFileObject.moveTo(AbstractFileObject.java:1116)
	at org.apache.zeppelin.notebook.repo.VFSNotebookRepo.save(VFSNotebookRepo.java:250)
	at org.apache.zeppelin.notebook.repo.NotebookRepoSync.save(NotebookRepoSync.java:185)
	at org.apache.zeppelin.notebook.Note.persist(Note.java:678)
	at org.apache.zeppelin.socket.NotebookServer$ParagraphListenerImpl.afterStatusChange(NotebookServer.java:2032)
	at org.apache.zeppelin.scheduler.Job.setStatus(Job.java:149)
	at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.afterStatusChange(RemoteScheduler.java:386)
	at org.apache.zeppelin.scheduler.RemoteScheduler$JobStatusPoller.getStatus(RemoteScheduler.java:268)
	at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:342)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.commons.vfs2.FileSystemException: Could not rename file "/usr/local/zeppelin/notebooks/2C9UB669K/.note.json" to "file:///usr/local/zeppelin/notebooks/2C9UB669K/note.json".
	at org.apache.commons.vfs2.provider.local.LocalFile.doRename(LocalFile.java:140)
	at org.apache.commons.vfs2.provider.AbstractFileObject.moveTo(AbstractFileObject.java:1102)
	... 15 more
{noformat}

https://github.com/apache/zeppelin/blob/5eeebeb0aaefa87ddcd6a06ff121ff2824d5d937/zeppelin-server/src/main/java/org/apache/zeppelin/socket/NotebookServer.java#L2034



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)