You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ignite.apache.org by "Shenson Joseph (Jira)" <ji...@apache.org> on 2019/11/22 17:39:00 UTC
[jira] [Commented] (IGNITE-12247) [Spark] Add initial support of
Spark 2.4
[ https://issues.apache.org/jira/browse/IGNITE-12247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16980354#comment-16980354 ]
Shenson Joseph commented on IGNITE-12247:
-----------------------------------------
[~zaleslaw] Can you please let me know if the patch is available for download?I am seeing following errors with spark-ignite environment.
19/11/22 16:36:07 INFO CoarseGrainedExecutorBackend: Got assigned task 16523719/11/22 16:36:07 INFO CoarseGrainedExecutorBackend: Got assigned task 16523719/11/22 16:36:07 INFO Executor: Running task 0.2 in stage 1648.0 (TID 165237)19/11/22 16:36:07 ERROR Executor: Exception in task 0.2 in stage 1648.0 (TID 165237)class org.apache.ignite.IgniteIllegalStateException: Ignite instance with provided name doesn't exist. Did you call Ignition.start(..) to start an Ignite instance? [name=shared-grid] at org.apache.ignite.internal.IgnitionEx.grid(IgnitionEx.java:1390) at org.apache.ignite.Ignition.ignite(Ignition.java:531) at org.apache.ignite.spark.impl.package$.ignite(package.scala:86) at org.apache.ignite.spark.impl.IgniteRelationProvider$$anonfun$configProvider$1$2.apply(IgniteRelationProvider.scala:226) at org.apache.ignite.spark.impl.IgniteRelationProvider$$anonfun$configProvider$1$2.apply(IgniteRelationProvider.scala:223) at org.apache.ignite.spark.Once.apply(IgniteContext.scala:224) at org.apache.ignite.spark.IgniteContext.ignite(IgniteContext.scala:145) at org.apache.ignite.spark.impl.IgniteSQLDataFrameRDD.compute(IgniteSQLDataFrameRDD.scala:65) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99) at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:55) at org.apache.spark.scheduler.Task.run(Task.scala:123) at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
> [Spark] Add initial support of Spark 2.4
> ----------------------------------------
>
> Key: IGNITE-12247
> URL: https://issues.apache.org/jira/browse/IGNITE-12247
> Project: Ignite
> Issue Type: Sub-task
> Components: spark
> Affects Versions: 2.8
> Reporter: Alexey Zinoviev
> Assignee: Alexey Zinoviev
> Priority: Critical
> Labels: await
> Fix For: 2.8
>
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> This solution provides the initial support of spark 2.4 with copied codebase from spark and with initial support of ExternalCatalog refactoring
--
This message was sent by Atlassian Jira
(v8.3.4#803005)