You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "lanyuanxiaoyao (via GitHub)" <gi...@apache.org> on 2023/03/08 10:12:16 UTC
[GitHub] [hudi] lanyuanxiaoyao opened a new issue, #8126: [SUPPORT] Exit code 137 (interrupted by signal 9: SIGKILL) when StreamWriteFunction detect object size
lanyuanxiaoyao opened a new issue, #8126:
URL: https://github.com/apache/hudi/issues/8126
**Describe the problem you faced**
In `StreamWriteFunction#detect`, when `ObjectSizeCalculator#getObjectSize` is executed and the process would exit with code 137 (interrupted by signal 9: SIGKILL). After debugging, I found that the process was killed by system when executing `ServiceabilityAgentSupport#needSudo` in the ServiceabilityAgentSupport's constructor function. Specifically, it is exit when executing `out.flush()` in `ServiceabilityAgentSupport#callAgent(null, true, style)`. And the current user has sudo with `NOPASSWD`. The code was running well with hudi version 0.11.0 and it is running well in windows. Anything i missed?
**Environment Description**
* Hudi version : 0.14.0-SNAPSHOT
* JDK version : 1.8.0+362
* System version : macOS Monterey 12.0.1
* Hadoop version : 3.1.2
* Storage (HDFS/S3/GCS..) : HDFS
* Running on Docker? (yes/no) : no
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] lanyuanxiaoyao commented on issue #8126: [SUPPORT] Exit code 137 (interrupted by signal 9: SIGKILL) when StreamWriteFunction detect object size
Posted by "lanyuanxiaoyao (via GitHub)" <gi...@apache.org>.
lanyuanxiaoyao commented on issue #8126:
URL: https://github.com/apache/hudi/issues/8126#issuecomment-1461156890
> Interesting, not an expert of MacOS, we can have more search here
I can't find any solution in the internet, even the openjdk-jol-core's issues also have nothing to help this.
And today, i try to use jdk-11 to run the code, it works.
I believe that the macOS cause this problem, but i don't know how to fix it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 closed issue #8126: [SUPPORT] Exit code 137 (interrupted by signal 9: SIGKILL) when StreamWriteFunction detect object size
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 closed issue #8126: [SUPPORT] Exit code 137 (interrupted by signal 9: SIGKILL) when StreamWriteFunction detect object size
URL: https://github.com/apache/hudi/issues/8126
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on issue #8126: [SUPPORT] Exit code 137 (interrupted by signal 9: SIGKILL) when StreamWriteFunction detect object size
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on issue #8126:
URL: https://github.com/apache/hudi/issues/8126#issuecomment-1459985773
Interesting, not an expert of MacOS, we can have more search here
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on issue #8126: [SUPPORT] Exit code 137 (interrupted by signal 9: SIGKILL) when StreamWriteFunction detect object size
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on issue #8126:
URL: https://github.com/apache/hudi/issues/8126#issuecomment-1461206208
Yeah, we can keep this issue open and still thanks for the feedback.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] ChestnutQiang commented on issue #8126: [SUPPORT] Exit code 137 (interrupted by signal 9: SIGKILL) when StreamWriteFunction detect object size
Posted by "ChestnutQiang (via GitHub)" <gi...@apache.org>.
ChestnutQiang commented on issue #8126:
URL: https://github.com/apache/hudi/issues/8126#issuecomment-1582587226
I tried using JDK azu1-1.8_372 but encountered the same problem. I resolved it by changing the JDK version to 1.8_144.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on issue #8126: [SUPPORT] Exit code 137 (interrupted by signal 9: SIGKILL) when StreamWriteFunction detect object size
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on issue #8126:
URL: https://github.com/apache/hudi/issues/8126#issuecomment-1583957629
Yeah, it is introduced by https://github.com/apache/hudi/pull/6657, @codope , do you have any thoughts here?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] voonhous commented on issue #8126: [SUPPORT] Exit code 137 (interrupted by signal 9: SIGKILL) when StreamWriteFunction detect object size
Posted by "voonhous (via GitHub)" <gi...@apache.org>.
voonhous commented on issue #8126:
URL: https://github.com/apache/hudi/issues/8126#issuecomment-1667127821
https://stackoverflow.com/questions/64593567/run-jol-core-exception-the-exception-message-is-process-finished-with-exit-cod
A stack overflow question documenting this. Pasting the answer/solution that one of the commenter + OP agreed on.
# OP
```
After testing I have found the problem and documented it here in the hope that it will help you. The problem occurs because jol-core is an extension for the OpenJDK and cannot be used on the Oracle Java Development Kit. For this reason I changed the local JDK to OpenJDK and ran the code in question to get the correct result
```
# Commentor
```
Because the JDK used by IDEA by default is not OpenJDK, just replace the Project SDK with Open JDK
```
Swapping from an Oracle JDK (which will throw the error) to OpenJDK fixed my issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on issue #8126: [SUPPORT] Exit code 137 (interrupted by signal 9: SIGKILL) when StreamWriteFunction detect object size
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on issue #8126:
URL: https://github.com/apache/hudi/issues/8126#issuecomment-1667132254
Close because we already have a solution ~
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org