You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "shane knapp (JIRA)" <ji...@apache.org> on 2019/01/30 19:24:00 UTC
[jira] [Comment Edited] (SPARK-26775) Update Jenkins nodes to
support local volumes for K8s integration tests
[ https://issues.apache.org/jira/browse/SPARK-26775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16756415#comment-16756415 ]
shane knapp edited comment on SPARK-26775 at 1/30/19 7:23 PM:
--------------------------------------------------------------
ill install the latest version on my test worker and run a couple of builds to check for compatibility... it should be fine...
...i hope. :)
this is definitely out of scope for this issue btw and it won't be a gating factor for resolving this.
also, i launched a test for the new k8s version:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/7593/
-looks good so far!- the build failed, sadly:
{noformat}
- Test PVs with local storage *** FAILED ***
The code passed to eventually never returned normally. Attempted 64 times over 2.01437391135 minutes. Last failure message: container not found ("spark-kubernetes-driver"). (PVTestsSuite.scala:119)
{noformat}
was (Author: shaneknapp):
ill install the latest version on my test worker and run a couple of builds to check for compatibility... it should be fine...
...i hope. :)
this is definitely out of scope for this issue btw and it won't be a gating factor for resolving this.
also, i launched a test for the new k8s version:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/7593/
looks good so far!
> Update Jenkins nodes to support local volumes for K8s integration tests
> -----------------------------------------------------------------------
>
> Key: SPARK-26775
> URL: https://issues.apache.org/jira/browse/SPARK-26775
> Project: Spark
> Issue Type: Improvement
> Components: jenkins, Kubernetes
> Affects Versions: 3.0.0
> Reporter: Stavros Kontopoulos
> Assignee: shane knapp
> Priority: Major
>
> Current version of Minikube on test machines does not support properly the local persistent volume feature required by this PR: [https://github.com/apache/spark/pull/23514].
> We get his error:
> "spec.local: Forbidden: Local volumes are disabled by feature-gate, metadata.annotations: Required value: Local volume requires node affinity"
> This is probably due to this: [https://github.com/rancher/rancher/issues/13864] which implies that we need to update to 1.10+ as described in [https://kubernetes.io/docs/concepts/storage/volumes/#local]. Fabric8io client is already updated in the PR mentioned at the beginning.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org