You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by salexln <sa...@gmail.com> on 2016/03/27 21:24:57 UTC
BlockManager WARNINGS and ERRORS
HI all,
I started testing my code (https://github.com/salexln/FinalProject_FCM)
with the latest Spark available in GitHub,
and when I run it I get the following errors:
*scala> val clusters = FuzzyCMeans.train(parsedData, 2, 20, 2.0)*
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 ERROR Executor: 2 block locks were not released by TID =
32:
[rdd_8_0, rdd_35_0]
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 ERROR Executor: 2 block locks were not released by TID =
35:
[rdd_8_0, rdd_35_0]
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 ERROR Executor: 2 block locks were not released by TID =
38:
[rdd_8_0, rdd_35_0]
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 ERROR Executor: 2 block locks were not released by TID =
41:
[rdd_8_0, rdd_35_0]
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 ERROR Executor: 2 block locks were not released by TID =
44:
[rdd_8_0, rdd_35_0]
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
machine; not re-adding it
I did not get these previously, is it something new?
--
View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/BlockManager-WARNINGS-and-ERRORS-tp16878.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: BlockManager WARNINGS and ERRORS
Posted by Ted Yu <yu...@gmail.com>.
The warning was added by:
SPARK-12757 Add block-level read/write locks to BlockManager
On Sun, Mar 27, 2016 at 12:24 PM, salexln <sa...@gmail.com> wrote:
> HI all,
>
> I started testing my code (https://github.com/salexln/FinalProject_FCM)
> with the latest Spark available in GitHub,
> and when I run it I get the following errors:
>
> *scala> val clusters = FuzzyCMeans.train(parsedData, 2, 20, 2.0)*
>
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 ERROR Executor: 2 block locks were not released by TID =
> 32:
> [rdd_8_0, rdd_35_0]
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 ERROR Executor: 2 block locks were not released by TID =
> 35:
> [rdd_8_0, rdd_35_0]
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 ERROR Executor: 2 block locks were not released by TID =
> 38:
> [rdd_8_0, rdd_35_0]
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 ERROR Executor: 2 block locks were not released by TID =
> 41:
> [rdd_8_0, rdd_35_0]
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 ERROR Executor: 2 block locks were not released by TID =
> 44:
> [rdd_8_0, rdd_35_0]
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
> machine; not re-adding it
>
> I did not get these previously, is it something new?
>
>
>
>
>
> --
> View this message in context:
> http://apache-spark-developers-list.1001551.n3.nabble.com/BlockManager-WARNINGS-and-ERRORS-tp16878.html
> Sent from the Apache Spark Developers List mailing list archive at
> Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>