You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@griffin.apache.org by "Maxim Galiev (Jira)" <ji...@apache.org> on 2022/04/27 11:27:00 UTC
[jira] [Comment Edited] (GRIFFIN-352) Running measure fails with NoSuchMethodError
[ https://issues.apache.org/jira/browse/GRIFFIN-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17528741#comment-17528741 ]
Maxim Galiev edited comment on GRIFFIN-352 at 4/27/22 11:26 AM:
----------------------------------------------------------------
Hi [~guoyp]
I have same problems.
Here is my files.
I use spark 3.2 and scala 2.12
was (Author: JIRAUSER288658):
Hi [~guoyp]
I have same problems.
Here is my files.
> Running measure fails with NoSuchMethodError
> --------------------------------------------
>
> Key: GRIFFIN-352
> URL: https://issues.apache.org/jira/browse/GRIFFIN-352
> Project: Griffin
> Issue Type: Bug
> Components: Measure Module
> Affects Versions: 0.6.0
> Environment: spark 2.4, Hive 3.1
> Reporter: Vijay Kiran
> Assignee: William Guo
> Priority: Major
> Attachments: env_batch.json, env_streaming.json
>
>
> With 0.6.0 and 0.7.0-SNAPSHOT, running measure with console sink fails with NSME - please see the log below
> {code}
> 20/11/17 17:21:23 INFO transform.SparkSqlTransformStep: main begin transform step :
> accu
> | |---__missCount
> | | |---__missRecords
> | |---__totalCount
> Exception in thread "main" java.lang.NoSuchMethodError: com.google.common.util.concurrent.MoreExecutors.sameThreadExecutor()Lcom/google/common/util/concurrent/ListeningExecutorService;
> at org.apache.griffin.measure.utils.ThreadUtils$.<init>(ThreadUtils.scala:35)
> at org.apache.griffin.measure.utils.ThreadUtils$.<clinit>(ThreadUtils.scala)
> at org.apache.griffin.measure.step.transform.TransformStep$.<init>(TransformStep.scala:118)
> at org.apache.griffin.measure.step.transform.TransformStep$.<clinit>(TransformStep.scala)
> at org.apache.griffin.measure.step.transform.TransformStep$$anonfun$3.apply(TransformStep.scala:61)
> at org.apache.griffin.measure.step.transform.TransformStep$$anonfun$3.apply(TransformStep.scala:51)
> at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
> at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
> at scala.collection.mutable.HashSet.foreach(HashSet.scala:78)
> at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
> at scala.collection.mutable.AbstractSet.scala$collection$SetLike$$super$map(Set.scala:46)
> at scala.collection.SetLike$class.map(SetLike.scala:92)
> at scala.collection.mutable.AbstractSet.map(Set.scala:46)
> at org.apache.griffin.measure.step.transform.TransformStep$class.execute(TransformStep.scala:51)
> at org.apache.griffin.measure.step.transform.SparkSqlTransformStep.execute(SparkSqlTransformStep.scala:28)
> at org.apache.griffin.measure.job.DQJob$$anonfun$execute$2.apply(DQJob.scala:29)
> at org.apache.griffin.measure.job.DQJob$$anonfun$execute$2.apply(DQJob.scala:29)
> at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
> at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
> at scala.collection.immutable.List.foreach(List.scala:392)
> at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
> at scala.collection.immutable.List.map(List.scala:296)
> at org.apache.griffin.measure.job.DQJob.execute(DQJob.scala:29)
> at org.apache.griffin.measure.launch.batch.BatchDQApp$$anonfun$1.apply(BatchDQApp.scala:85)
> at org.apache.griffin.measure.launch.batch.BatchDQApp$$anonfun$1.apply(BatchDQApp.scala:64)
> at org.apache.griffin.measure.utils.CommonUtils$.timeThis(CommonUtils.scala:36)
> at org.apache.griffin.measure.launch.batch.BatchDQApp.run(BatchDQApp.scala:64)
> at org.apache.griffin.measure.Application$.main(Application.scala:92)
> at org.apache.griffin.measure.Application.main(Application.scala)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
> at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:847)
> at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161)
> at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184)
> at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
> at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:922)
> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:931)
> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> {code}
>
--
This message was sent by Atlassian Jira
(v8.20.7#820007)