You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Hadoop QA (JIRA)" <ji...@apache.org> on 2019/02/12 13:28:00 UTC
[jira] [Commented] (HDDS-1090) Add a recipe to the ozone docs about
using Spark, OzoneFS, and K8s
[ https://issues.apache.org/jira/browse/HDDS-1090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16766017#comment-16766017 ]
Hadoop QA commented on HDDS-1090:
---------------------------------
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m 46s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 55s{color} | {color:green} The patch does not generate ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 2m 38s{color} | {color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hadoop:8f97d6f |
| JIRA Issue | HDDS-1090 |
| JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12958387/HDDS-1090.002.patch |
| Optional Tests | asflicense |
| uname | Linux f5f87c1dc97e 3.13.0-153-generic #203-Ubuntu SMP Thu Jun 14 08:52:28 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /home/jenkins/jenkins-slave/workspace/PreCommit-HDDS-Build/ozone.sh |
| git revision | trunk / 20b92cd |
| maven | version: Apache Maven 3.3.9 |
| Max. process+thread count | 47 (vs. ulimit of 10000) |
| modules | C: hadoop-hdds/docs U: hadoop-hdds/docs |
| Console output | https://builds.apache.org/job/PreCommit-HDDS-Build/2235/console |
| Powered by | Apache Yetus 0.8.0-SNAPSHOT http://yetus.apache.org |
This message was automatically generated.
> Add a recipe to the ozone docs about using Spark, OzoneFS, and K8s
> ------------------------------------------------------------------
>
> Key: HDDS-1090
> URL: https://issues.apache.org/jira/browse/HDDS-1090
> Project: Hadoop Distributed Data Store
> Issue Type: Improvement
> Reporter: Elek, Marton
> Assignee: Elek, Marton
> Priority: Major
> Attachments: HDDS-1090.002.patch
>
>
> With the isolated classloader (HDDS-922) it's possible to use the regular spark distribution (which includes hadoop-2.7) and ozonefs (based on hadoop-3.2) together.
> In HDDS-846 we started to add '_recipes_' to the documentation to provide how-to style pages for different use-cases.
> I would add a new page about using the following components together:
> * Spark2.4-hadoop-2.7
> * Ozonefs (isolated classloader)
> * Kubernetes spark executor
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org