You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2020/09/30 03:32:25 UTC
[GitHub] [incubator-dolphinscheduler] 939598604 opened a new issue #3859: work节点运行mr程序怎么会清理客户端本地hadoop目录下的mapred临时文件？
939598604 opened a new issue #3859:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3859
[INFO] 2020-09-30 11:24:23.012 - [taskAppId=TASK-1-5-5]:[121] - -> 20/09/30 11:24:23 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
[INFO] 2020-09-30 11:24:23.798 - [taskAppId=TASK-1-5-5]:[121] - -> 20/09/30 11:24:23 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
20/09/30 11:24:23 INFO mapreduce.JobSubmitter: Cleaning up the staging area file:/data/hadoop-2.7.1/tmp/mapred/staging/test54419378/.staging/job_local54419378_0001
ENOENT: No such file or directory
at org.apache.hadoop.io.nativeio.NativeIO$POSIX.chmodImpl(Native Method)
at org.apache.hadoop.io.nativeio.NativeIO$POSIX.chmod(NativeIO.java:230)
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:724)
at org.apache.hadoop.fs.FilterFileSystem.setPermission(FilterFileSystem.java:502)
at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:600)
at org.apache.hadoop.mapreduce.JobResourceUploader.uploadFiles(JobResourceUploader.java:94)
at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:95)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:190)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308)
at org.apache.hadoop.examples.WordCount.main(WordCount.java:87)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] dailidong commented on issue #3859: work节点运行mr程序怎么会清理客户端本地hadoop目录下的mapred临时文件？
Posted by GitBox <gi...@apache.org>.
dailidong commented on issue #3859:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3859#issuecomment-705624756
this is not the behaver of DolphinScheduler, DolphinScheduler just submit the task to Hadoop Cluster
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] xingchun-chen commented on issue #3859: work节点运行mr程序怎么会清理客户端本地hadoop目录下的mapred临时文件？
Posted by GitBox <gi...@apache.org>.
xingchun-chen commented on issue #3859:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3859#issuecomment-701215850
please update the title in English
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] dailidong closed issue #3859: work节点运行mr程序怎么会清理客户端本地hadoop目录下的mapred临时文件？
Posted by GitBox <gi...@apache.org>.
dailidong closed issue #3859:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3859
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] dailidong commented on issue #3859: work节点运行mr程序怎么会清理客户端本地hadoop目录下的mapred临时文件？
Posted by GitBox <gi...@apache.org>.
dailidong commented on issue #3859:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3859#issuecomment-705624756
this is not the behaver of DolphinScheduler, DolphinScheduler just submit the task to Hadoop Cluster
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] dailidong closed issue #3859: work节点运行mr程序怎么会清理客户端本地hadoop目录下的mapred临时文件？
Posted by GitBox <gi...@apache.org>.
dailidong closed issue #3859:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/3859
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org