You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2020/10/16 02:42:00 UTC
[jira] [Resolved] (SPARK-33165) Remove
dependencies(scalatest,scalactic) from Benchmark
[ https://issues.apache.org/jira/browse/SPARK-33165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon resolved SPARK-33165.
----------------------------------
Fix Version/s: 3.1.0
3.0.2
Resolution: Fixed
Fixed in https://github.com/apache/spark/pull/30064
> Remove dependencies(scalatest,scalactic) from Benchmark
> -------------------------------------------------------
>
> Key: SPARK-33165
> URL: https://issues.apache.org/jira/browse/SPARK-33165
> Project: Spark
> Issue Type: Test
> Components: SQL, Tests
> Affects Versions: 3.0.1, 3.1.0
> Reporter: Takeshi Yamamuro
> Priority: Major
> Fix For: 3.0.2, 3.1.0
>
>
> This ticket aims at removing `assert` from `Benchmark` for making it easier to run benchmark codes via `spark-submit`.
> Since the current `Benchmark` (`master` and `branch-3.0`) has `assert`, we need to pass the proper jars of `scalatest` and `scalactic`;
> - scalatest-core_2.12-3.2.0.jar
> - scalatest-compatible-3.2.0.jar
> - scalactic_2.12-3.0.jar
> {code}
> ./bin/spark-submit --jars scalatest-core_2.12-3.2.0.jar,scalatest-compatible-3.2.0.jar,scalactic_2.12-3.0.jar,./sql/catalyst/target/spark-catalyst_2.12-3.1.0-SNAPSHOT-tests.jar,./core/target/spark-core_2.12-3.1.0-SNAPSHOT-tests.jar --class org.apache.spark.sql.execution.benchmark.TPCDSQueryBenchmark ./sql/core/target/spark-sql_2.12-3.1.0-SNAPSHOT-tests.jar --data-location /tmp/tpcds-sf1
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org