You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "longfeiJiang (Jira)" <ji...@apache.org> on 2023/02/03 07:18:00 UTC
[jira] [Comment Edited] (KYLIN-5411) Setting the noexec attribute on the /tmp directory causes build tasks to fail
[ https://issues.apache.org/jira/browse/KYLIN-5411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17683706#comment-17683706 ]
longfeiJiang edited comment on KYLIN-5411 at 2/3/23 7:17 AM:
-------------------------------------------------------------
*Workaround*
Manually decompress the dependent jar package in advance, and put the .so library file in a certain directory.
Specify the library file path inextraJavaOptions of the driver in the build configuration parameter for support.
e.g.
!image-2023-02-03-15-05-04-711.png!
Add check "Setting the noexec attribute on the /tmp directory" in Kylin Checking Spark Availability stage.
When the user configures the following 2 parameters, the check is skipped:
{code:java}
kylin.engine.spark-conf.spark.shuffle.mapStatus.compression.codec(Not NUll and not zstd)
kylin.storage.columnar.spark-conf.spark.shuffle.mapStatus.compression.codec(Not NUll and not zstd)
{code}
was (Author: JIRAUSER298472):
*Workaround*
Manually decompress the dependent jar package in advance, and put the .so library file in a certain directory.
Specify the library file path inextraJavaOptions of the driver in the build configuration parameter for support.
e.g.
!image-2023-02-03-15-05-04-711.png!
> Setting the noexec attribute on the /tmp directory causes build tasks to fail
> -----------------------------------------------------------------------------
>
> Key: KYLIN-5411
> URL: https://issues.apache.org/jira/browse/KYLIN-5411
> Project: Kylin
> Issue Type: Bug
> Affects Versions: 5.0-alpha
> Reporter: longfeiJiang
> Assignee: longfeiJiang
> Priority: Major
> Fix For: 5.0-alpha
>
> Attachments: image-2023-02-03-15-05-04-711.png
>
>
> Some compression functions will be used during the execution of spark.
> The zstd algorithm is used by default, and the zstd-jni-xxx.jar dependency that comes with spark will be used.
> This dependency comes with a .so library file, which will be automatically decompressed to the system /tmp directory after loading.
> When the /tmp directory is given the noexec attribute, the library file will not be loaded.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)