You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2022/10/27 11:04:35 UTC

[GitHub] [dolphinscheduler] SmallConchs opened a new issue, #12569: shell script sava failed

SmallConchs opened a new issue, #12569:
URL: https://github.com/apache/dolphinscheduler/issues/12569

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### What happened
   
   When I create a workflow instance or create a shell resource, I occasionally fail to save some scripts
   ![image](https://user-images.githubusercontent.com/37462425/198266939-105a7216-cd96-4a62-84bc-7c1b0cb5c324.png)
   Description The api interface reported an error
   ![image](https://user-images.githubusercontent.com/37462425/198267436-508444d7-53cf-4d8d-8654-59c7a52c4ae0.png)
   
   If I randomly add some content in, I can save successfully
   ![image](https://user-images.githubusercontent.com/37462425/198267159-cc160869-c5e8-485c-b8d6-180c93978002.png)
   
   
   ### What you expected to happen
   
   [ERROR] 2022-10-27 18:57:40.433 org.apache.dolphinscheduler.api.exceptions.ApiExceptionHandler:[42] - null
   org.eclipse.jetty.io.EofException: null
   	at org.eclipse.jetty.io.ChannelEndPoint.flush(ChannelEndPoint.java:279)
   	at org.eclipse.jetty.io.WriteFlusher.flush(WriteFlusher.java:422)
   	at org.eclipse.jetty.io.WriteFlusher.write(WriteFlusher.java:277)
   	at org.eclipse.jetty.io.AbstractEndPoint.write(AbstractEndPoint.java:381)
   	at org.eclipse.jetty.server.HttpConnection$SendCallback.process(HttpConnection.java:825)
   	at org.eclipse.jetty.util.IteratingCallback.processing(IteratingCallback.java:241)
   	at org.eclipse.jetty.util.IteratingCallback.iterate(IteratingCallback.java:223)
   	at org.eclipse.jetty.server.HttpConnection.send(HttpConnection.java:555)
   	at org.eclipse.jetty.server.HttpChannel.sendResponse(HttpChannel.java:922)
   	at org.eclipse.jetty.server.HttpChannel.write(HttpChannel.java:999)
   	at org.eclipse.jetty.server.handler.gzip.GzipHttpOutputInterceptor.commit(GzipHttpOutputInterceptor.java:166)
   	at org.eclipse.jetty.server.handler.gzip.GzipHttpOutputInterceptor.write(GzipHttpOutputInterceptor.java:109)
   	at org.eclipse.jetty.server.HttpOutput.channelWrite(HttpOutput.java:285)
   	at org.eclipse.jetty.server.HttpOutput.channelWrite(HttpOutput.java:269)
   	at org.eclipse.jetty.server.HttpOutput.flush(HttpOutput.java:751)
   	at java.io.FilterOutputStream.flush(FilterOutputStream.java:140)
   	at com.fasterxml.jackson.core.json.UTF8JsonGenerator.flush(UTF8JsonGenerator.java:1153)
   	at com.fasterxml.jackson.databind.ObjectWriter.writeValue(ObjectWriter.java:923)
   	at org.springframework.http.converter.json.AbstractJackson2HttpMessageConverter.writeInternal(AbstractJackson2HttpMessageConverter.java:454)
   	at org.springframework.http.converter.AbstractGenericHttpMessageConverter.write(AbstractGenericHttpMessageConverter.java:104)
   	at org.springframework.web.servlet.mvc.method.annotation.AbstractMessageConverterMethodProcessor.writeWithMessageConverters(AbstractMessageConverterMethodProcessor.java:290)
   	at org.springframework.web.servlet.mvc.method.annotation.HttpEntityMethodProcessor.handleReturnValue(HttpEntityMethodProcessor.java:219)
   	at org.springframework.web.method.support.HandlerMethodReturnValueHandlerComposite.handleReturnValue(HandlerMethodReturnValueHandlerComposite.java:78)
   	at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:135)
   	at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895)
   	at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808)
   	at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87)
   	at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1067)
   	at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:963)
   	at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006)
   	at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:898)
   	at javax.servlet.http.HttpServlet.service(HttpServlet.java:497)
   	at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883)
   	at javax.servlet.http.HttpServlet.service(HttpServlet.java:584)
   	at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
   	at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1631)
   	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:103)
   	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   	at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100)
   	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)
   	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:103)
   	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:103)
   	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
   	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
   	at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:618)
   	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235)
   	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624)
   	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
   	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
   	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
   	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594)
   	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
   	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)
   	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   	at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:229)
   	at org.eclipse.jetty.server.Dispatcher.error(Dispatcher.java:86)
   	at org.eclipse.jetty.server.handler.ErrorHandler.doError(ErrorHandler.java:119)
   	at org.eclipse.jetty.server.handler.ErrorHandler.handle(ErrorHandler.java:95)
   	at org.springframework.boot.web.embedded.jetty.JettyEmbeddedErrorHandler.handle(JettyEmbeddedErrorHandler.java:57)
   	at org.eclipse.jetty.server.HttpChannel.lambda$handle$3(HttpChannel.java:449)
   	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:645)
   	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:447)
   	at org.eclipse.jetty.server.HttpChannelOverHttp.earlyEOF(HttpChannelOverHttp.java:237)
   	at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:1620)
   	at org.eclipse.jetty.server.HttpConnection.parseRequestBuffer(HttpConnection.java:381)
   	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:265)
   	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
   	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
   	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
   	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
   	at java.lang.Thread.run(Thread.java:748)
   Caused by: java.io.IOException: 断开的管道
   	at sun.nio.ch.FileDispatcherImpl.writev0(Native Method)
   	at sun.nio.ch.SocketDispatcher.writev(SocketDispatcher.java:51)
   	at sun.nio.ch.IOUtil.write(IOUtil.java:148)
   	at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:504)
   	at java.nio.channels.SocketChannel.write(SocketChannel.java:502)
   	at org.eclipse.jetty.io.ChannelEndPoint.flush(ChannelEndPoint.java:273)
   	... 80 common frames omitted
   [WARN] 2022-10-27 18:57:40.435 org.springframework.web.servlet.mvc.method.annotation.ExceptionHandlerExceptionResolver:[434] - Failure in @ExceptionHandler org.apache.dolphinscheduler.api.exceptions.ApiExceptionHandler#exceptionHandler(Exception, HandlerMethod)
   org.eclipse.jetty.io.EofException: Closed
   	at org.eclipse.jetty.server.HttpOutput.checkWritable(HttpOutput.java:771)
   	at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:795)
   	at org.springframework.util.StreamUtils$NonClosingOutputStream.write(StreamUtils.java:287)
   	at com.fasterxml.jackson.core.json.UTF8JsonGenerator._flushBuffer(UTF8JsonGenerator.java:2137)
   	at com.fasterxml.jackson.core.json.UTF8JsonGenerator.flush(UTF8JsonGenerator.java:1150)
   	at com.fasterxml.jackson.databind.ObjectWriter.writeValue(ObjectWriter.java:923)
   	at org.springframework.http.converter.json.AbstractJackson2HttpMessageConverter.writeInternal(AbstractJackson2HttpMessageConverter.java:454)
   	at org.springframework.http.converter.AbstractGenericHttpMessageConverter.write(AbstractGenericHttpMessageConverter.java:104)
   	at org.springframework.web.servlet.mvc.method.annotation.AbstractMessageConverterMethodProcessor.writeWithMessageConverters(AbstractMessageConverterMethodProcessor.java:290)
   	at org.springframework.web.servlet.mvc.method.annotation.RequestResponseBodyMethodProcessor.handleReturnValue(RequestResponseBodyMethodProcessor.java:183)
   	at org.springframework.web.method.support.HandlerMethodReturnValueHandlerComposite.handleReturnValue(HandlerMethodReturnValueHandlerComposite.java:78)
   	at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:135)
   	at org.springframework.web.servlet.mvc.method.annotation.ExceptionHandlerExceptionResolver.doResolveHandlerMethodException(ExceptionHandlerExceptionResolver.java:428)
   	at org.springframework.web.servlet.handler.AbstractHandlerMethodExceptionResolver.doResolveException(AbstractHandlerMethodExceptionResolver.java:75)
   	at org.springframework.web.servlet.handler.AbstractHandlerExceptionResolver.resolveException(AbstractHandlerExceptionResolver.java:142)
   	at org.springframework.web.servlet.handler.HandlerExceptionResolverComposite.resolveException(HandlerExceptionResolverComposite.java:80)
   	at org.springframework.web.servlet.DispatcherServlet.processHandlerException(DispatcherServlet.java:1327)
   	at org.springframework.web.servlet.DispatcherServlet.processDispatchResult(DispatcherServlet.java:1138)
   	at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1084)
   	at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:963)
   	at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006)
   	at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:898)
   	at javax.servlet.http.HttpServlet.service(HttpServlet.java:497)
   	at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883)
   	at javax.servlet.http.HttpServlet.service(HttpServlet.java:584)
   	at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
   	at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1631)
   	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:103)
   	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   	at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100)
   	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)
   	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:103)
   	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:103)
   	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
   	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
   	at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:618)
   	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235)
   	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624)
   	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
   	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
   	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
   	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594)
   	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
   	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)
   	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   	at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:229)
   	at org.eclipse.jetty.server.Dispatcher.error(Dispatcher.java:86)
   	at org.eclipse.jetty.server.handler.ErrorHandler.doError(ErrorHandler.java:119)
   	at org.eclipse.jetty.server.handler.ErrorHandler.handle(ErrorHandler.java:95)
   	at org.springframework.boot.web.embedded.jetty.JettyEmbeddedErrorHandler.handle(JettyEmbeddedErrorHandler.java:57)
   	at org.eclipse.jetty.server.HttpChannel.lambda$handle$3(HttpChannel.java:449)
   	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:645)
   	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:447)
   	at org.eclipse.jetty.server.HttpChannelOverHttp.earlyEOF(HttpChannelOverHttp.java:237)
   	at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:1620)
   	at org.eclipse.jetty.server.HttpConnection.parseRequestBuffer(HttpConnection.java:381)
   	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:265)
   	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
   	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
   	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
   	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
   	at java.lang.Thread.run(Thread.java:748)
   
   
   ### How to reproduce
   
   Create a script and save it
   hive -e "
   set hive.exec.dynamic.partition=true\;
   set hive.exec.dynamic.partition.mode=nonstrict\;
   set hive.exec.max.dynamic.partitions.pernode=5000\;
   set hive.exec.max.dynamic.partitions=50000\;
   set hive.exec.max.created.files=100000\;
   
   INSERT OVERWRITE TABLE ODS.ODS_SYS_CODE_VALUE_B_DI partition (dt)
   SELECT
         CODE_VALUE_ID
        ,CODE_ID
        ,VALUE
        ,MEANING
        ,DESCRIPTION
        ,OBJECT_VERSION_NUMBER
        ,REQUEST_ID
        ,PROGRAM_ID
        ,CREATED_BY
        ,CREATION_DATE
        ,LAST_UPDATED_BY
        ,LAST_UPDATE_DATE
        ,LAST_UPDATE_LOGIN
        ,ATTRIBUTE_CATEGORY
        ,ATTRIBUTE1
        ,ATTRIBUTE2
        ,ATTRIBUTE3
        ,ATTRIBUTE4
        ,ATTRIBUTE5
        ,ATTRIBUTE6
        ,ATTRIBUTE7
        ,ATTRIBUTE8
        ,ATTRIBUTE9
        ,ATTRIBUTE10
        ,ATTRIBUTE11
        ,ATTRIBUTE12
        ,ATTRIBUTE13
        ,ATTRIBUTE14
        ,ATTRIBUTE15
        ,ORDER_SEQ
        ,TAG
        ,ENABLED_FLAG
        ,PARENT_CODE_VALUE_ID
        ,substr(CREATION_DATE,0,10)
   FROM tmp.SYS_CODE_VALUE_B_DI WHERE dt = \'1949-01-01\'
   
   "
   
   
   
   
   ### Anything else
   
   _No response_
   
   ### Version
   
   2.0.x
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] github-actions[bot] closed issue #12569: [BUG][Resource Center]shell script sava failed

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #12569: [BUG][Resource Center]shell  script sava failed
URL: https://github.com/apache/dolphinscheduler/issues/12569


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #12569: shell script sava failed

Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #12569:
URL: https://github.com/apache/dolphinscheduler/issues/12569#issuecomment-1293408298

   Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
   * In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
   * If you haven't received a reply for a long time, you can [join our slack](https://s.apache.org/dolphinscheduler-slack) and send your question to channel `#troubleshooting`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #12569: [BUG][Resource Center]shell script sava failed

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #12569:
URL: https://github.com/apache/dolphinscheduler/issues/12569#issuecomment-1451088579

   This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #12569: [BUG][Resource Center]shell script sava failed

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #12569:
URL: https://github.com/apache/dolphinscheduler/issues/12569#issuecomment-1441043385

   This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #12569: shell script sava failed

Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #12569:
URL: https://github.com/apache/dolphinscheduler/issues/12569#issuecomment-1293407972

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### What happened
   
   When I create a workflow instance or create a shell resource, I occasionally fail to save some scripts
   ![image](https://user-images.githubusercontent.com/37462425/198266939-105a7216-cd96-4a62-84bc-7c1b0cb5c324.png)
   Description The api interface reported an error
   ![image](https://user-images.githubusercontent.com/37462425/198267436-508444d7-53cf-4d8d-8654-59c7a52c4ae0.png)
   
   If I randomly add some content in, I can save successfully
   ![image](https://user-images.githubusercontent.com/37462425/198267159-cc160869-c5e8-485c-b8d6-180c93978002.png)
   
   
   ### What you expected to happen
   
   [ERROR] 2022-10-27 18:57:40.433 org.apache.dolphinscheduler.api.exceptions.ApiExceptionHandler:[42] - null
   org.eclipse.jetty.io.EofException: null
   	at org.eclipse.jetty.io.ChannelEndPoint.flush(ChannelEndPoint.java:279)
   	at org.eclipse.jetty.io.WriteFlusher.flush(WriteFlusher.java:422)
   	at org.eclipse.jetty.io.WriteFlusher.write(WriteFlusher.java:277)
   	at org.eclipse.jetty.io.AbstractEndPoint.write(AbstractEndPoint.java:381)
   	at org.eclipse.jetty.server.HttpConnection$SendCallback.process(HttpConnection.java:825)
   	at org.eclipse.jetty.util.IteratingCallback.processing(IteratingCallback.java:241)
   	at org.eclipse.jetty.util.IteratingCallback.iterate(IteratingCallback.java:223)
   	at org.eclipse.jetty.server.HttpConnection.send(HttpConnection.java:555)
   	at org.eclipse.jetty.server.HttpChannel.sendResponse(HttpChannel.java:922)
   	at org.eclipse.jetty.server.HttpChannel.write(HttpChannel.java:999)
   	at org.eclipse.jetty.server.handler.gzip.GzipHttpOutputInterceptor.commit(GzipHttpOutputInterceptor.java:166)
   	at org.eclipse.jetty.server.handler.gzip.GzipHttpOutputInterceptor.write(GzipHttpOutputInterceptor.java:109)
   	at org.eclipse.jetty.server.HttpOutput.channelWrite(HttpOutput.java:285)
   	at org.eclipse.jetty.server.HttpOutput.channelWrite(HttpOutput.java:269)
   	at org.eclipse.jetty.server.HttpOutput.flush(HttpOutput.java:751)
   	at java.io.FilterOutputStream.flush(FilterOutputStream.java:140)
   	at com.fasterxml.jackson.core.json.UTF8JsonGenerator.flush(UTF8JsonGenerator.java:1153)
   	at com.fasterxml.jackson.databind.ObjectWriter.writeValue(ObjectWriter.java:923)
   	at org.springframework.http.converter.json.AbstractJackson2HttpMessageConverter.writeInternal(AbstractJackson2HttpMessageConverter.java:454)
   	at org.springframework.http.converter.AbstractGenericHttpMessageConverter.write(AbstractGenericHttpMessageConverter.java:104)
   	at org.springframework.web.servlet.mvc.method.annotation.AbstractMessageConverterMethodProcessor.writeWithMessageConverters(AbstractMessageConverterMethodProcessor.java:290)
   	at org.springframework.web.servlet.mvc.method.annotation.HttpEntityMethodProcessor.handleReturnValue(HttpEntityMethodProcessor.java:219)
   	at org.springframework.web.method.support.HandlerMethodReturnValueHandlerComposite.handleReturnValue(HandlerMethodReturnValueHandlerComposite.java:78)
   	at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:135)
   	at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895)
   	at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808)
   	at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87)
   	at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1067)
   	at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:963)
   	at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006)
   	at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:898)
   	at javax.servlet.http.HttpServlet.service(HttpServlet.java:497)
   	at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883)
   	at javax.servlet.http.HttpServlet.service(HttpServlet.java:584)
   	at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
   	at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1631)
   	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:103)
   	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   	at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100)
   	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)
   	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:103)
   	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:103)
   	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
   	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
   	at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:618)
   	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235)
   	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624)
   	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
   	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
   	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
   	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594)
   	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
   	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)
   	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   	at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:229)
   	at org.eclipse.jetty.server.Dispatcher.error(Dispatcher.java:86)
   	at org.eclipse.jetty.server.handler.ErrorHandler.doError(ErrorHandler.java:119)
   	at org.eclipse.jetty.server.handler.ErrorHandler.handle(ErrorHandler.java:95)
   	at org.springframework.boot.web.embedded.jetty.JettyEmbeddedErrorHandler.handle(JettyEmbeddedErrorHandler.java:57)
   	at org.eclipse.jetty.server.HttpChannel.lambda$handle$3(HttpChannel.java:449)
   	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:645)
   	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:447)
   	at org.eclipse.jetty.server.HttpChannelOverHttp.earlyEOF(HttpChannelOverHttp.java:237)
   	at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:1620)
   	at org.eclipse.jetty.server.HttpConnection.parseRequestBuffer(HttpConnection.java:381)
   	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:265)
   	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
   	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
   	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
   	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
   	at java.lang.Thread.run(Thread.java:748)
   Caused by: java.io.IOException: 断开的管道
   	at sun.nio.ch.FileDispatcherImpl.writev0(Native Method)
   	at sun.nio.ch.SocketDispatcher.writev(SocketDispatcher.java:51)
   	at sun.nio.ch.IOUtil.write(IOUtil.java:148)
   	at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:504)
   	at java.nio.channels.SocketChannel.write(SocketChannel.java:502)
   	at org.eclipse.jetty.io.ChannelEndPoint.flush(ChannelEndPoint.java:273)
   	... 80 common frames omitted
   [WARN] 2022-10-27 18:57:40.435 org.springframework.web.servlet.mvc.method.annotation.ExceptionHandlerExceptionResolver:[434] - Failure in @ExceptionHandler org.apache.dolphinscheduler.api.exceptions.ApiExceptionHandler#exceptionHandler(Exception, HandlerMethod)
   org.eclipse.jetty.io.EofException: Closed
   	at org.eclipse.jetty.server.HttpOutput.checkWritable(HttpOutput.java:771)
   	at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:795)
   	at org.springframework.util.StreamUtils$NonClosingOutputStream.write(StreamUtils.java:287)
   	at com.fasterxml.jackson.core.json.UTF8JsonGenerator._flushBuffer(UTF8JsonGenerator.java:2137)
   	at com.fasterxml.jackson.core.json.UTF8JsonGenerator.flush(UTF8JsonGenerator.java:1150)
   	at com.fasterxml.jackson.databind.ObjectWriter.writeValue(ObjectWriter.java:923)
   	at org.springframework.http.converter.json.AbstractJackson2HttpMessageConverter.writeInternal(AbstractJackson2HttpMessageConverter.java:454)
   	at org.springframework.http.converter.AbstractGenericHttpMessageConverter.write(AbstractGenericHttpMessageConverter.java:104)
   	at org.springframework.web.servlet.mvc.method.annotation.AbstractMessageConverterMethodProcessor.writeWithMessageConverters(AbstractMessageConverterMethodProcessor.java:290)
   	at org.springframework.web.servlet.mvc.method.annotation.RequestResponseBodyMethodProcessor.handleReturnValue(RequestResponseBodyMethodProcessor.java:183)
   	at org.springframework.web.method.support.HandlerMethodReturnValueHandlerComposite.handleReturnValue(HandlerMethodReturnValueHandlerComposite.java:78)
   	at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:135)
   	at org.springframework.web.servlet.mvc.method.annotation.ExceptionHandlerExceptionResolver.doResolveHandlerMethodException(ExceptionHandlerExceptionResolver.java:428)
   	at org.springframework.web.servlet.handler.AbstractHandlerMethodExceptionResolver.doResolveException(AbstractHandlerMethodExceptionResolver.java:75)
   	at org.springframework.web.servlet.handler.AbstractHandlerExceptionResolver.resolveException(AbstractHandlerExceptionResolver.java:142)
   	at org.springframework.web.servlet.handler.HandlerExceptionResolverComposite.resolveException(HandlerExceptionResolverComposite.java:80)
   	at org.springframework.web.servlet.DispatcherServlet.processHandlerException(DispatcherServlet.java:1327)
   	at org.springframework.web.servlet.DispatcherServlet.processDispatchResult(DispatcherServlet.java:1138)
   	at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1084)
   	at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:963)
   	at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006)
   	at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:898)
   	at javax.servlet.http.HttpServlet.service(HttpServlet.java:497)
   	at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883)
   	at javax.servlet.http.HttpServlet.service(HttpServlet.java:584)
   	at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
   	at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1631)
   	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:103)
   	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   	at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100)
   	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:119)
   	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:103)
   	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:103)
   	at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
   	at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601)
   	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548)
   	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
   	at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:618)
   	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235)
   	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624)
   	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434)
   	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
   	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501)
   	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594)
   	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
   	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349)
   	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   	at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:229)
   	at org.eclipse.jetty.server.Dispatcher.error(Dispatcher.java:86)
   	at org.eclipse.jetty.server.handler.ErrorHandler.doError(ErrorHandler.java:119)
   	at org.eclipse.jetty.server.handler.ErrorHandler.handle(ErrorHandler.java:95)
   	at org.springframework.boot.web.embedded.jetty.JettyEmbeddedErrorHandler.handle(JettyEmbeddedErrorHandler.java:57)
   	at org.eclipse.jetty.server.HttpChannel.lambda$handle$3(HttpChannel.java:449)
   	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:645)
   	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:447)
   	at org.eclipse.jetty.server.HttpChannelOverHttp.earlyEOF(HttpChannelOverHttp.java:237)
   	at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:1620)
   	at org.eclipse.jetty.server.HttpConnection.parseRequestBuffer(HttpConnection.java:381)
   	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:265)
   	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
   	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   	at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
   	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
   	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
   	at java.lang.Thread.run(Thread.java:748)
   
   
   ### How to reproduce
   
   Create a script and save it
   hive -e "
   set hive.exec.dynamic.partition=true\;
   set hive.exec.dynamic.partition.mode=nonstrict\;
   set hive.exec.max.dynamic.partitions.pernode=5000\;
   set hive.exec.max.dynamic.partitions=50000\;
   set hive.exec.max.created.files=100000\;
   
   INSERT OVERWRITE TABLE ODS.ODS_SYS_CODE_VALUE_B_DI partition (dt)
   SELECT
         CODE_VALUE_ID
        ,CODE_ID
        ,VALUE
        ,MEANING
        ,DESCRIPTION
        ,OBJECT_VERSION_NUMBER
        ,REQUEST_ID
        ,PROGRAM_ID
        ,CREATED_BY
        ,CREATION_DATE
        ,LAST_UPDATED_BY
        ,LAST_UPDATE_DATE
        ,LAST_UPDATE_LOGIN
        ,ATTRIBUTE_CATEGORY
        ,ATTRIBUTE1
        ,ATTRIBUTE2
        ,ATTRIBUTE3
        ,ATTRIBUTE4
        ,ATTRIBUTE5
        ,ATTRIBUTE6
        ,ATTRIBUTE7
        ,ATTRIBUTE8
        ,ATTRIBUTE9
        ,ATTRIBUTE10
        ,ATTRIBUTE11
        ,ATTRIBUTE12
        ,ATTRIBUTE13
        ,ATTRIBUTE14
        ,ATTRIBUTE15
        ,ORDER_SEQ
        ,TAG
        ,ENABLED_FLAG
        ,PARENT_CODE_VALUE_ID
        ,substr(CREATION_DATE,0,10)
   FROM tmp.SYS_CODE_VALUE_B_DI WHERE dt = \'1949-01-01\'
   
   "
   
   
   
   
   ### Anything else
   
   _No response_
   
   ### Version
   
   2.0.x
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] JinyLeeChina commented on issue #12569: [BUG][Resource Center]shell script sava failed

Posted by GitBox <gi...@apache.org>.
JinyLeeChina commented on issue #12569:
URL: https://github.com/apache/dolphinscheduler/issues/12569#issuecomment-1380265471

   Which version appears ?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] SmallConchs commented on issue #12569: shell script sava failed

Posted by GitBox <gi...@apache.org>.
SmallConchs commented on issue #12569:
URL: https://github.com/apache/dolphinscheduler/issues/12569#issuecomment-1294283646

   dolphinscheduler 2.0.6 v


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #12569: [BUG][Resource Center]shell script sava failed

Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #12569:
URL: https://github.com/apache/dolphinscheduler/issues/12569#issuecomment-1328381660

   This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org