You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Takeshi Yamamuro (Jira)" <ji...@apache.org> on 2020/10/16 00:56:00 UTC

[jira] [Created] (SPARK-33165) Remove dependencies(scalatest,scalactic) from Benchmark

Takeshi Yamamuro created SPARK-33165:
----------------------------------------

             Summary: Remove dependencies(scalatest,scalactic) from Benchmark
                 Key: SPARK-33165
                 URL: https://issues.apache.org/jira/browse/SPARK-33165
             Project: Spark
          Issue Type: Test
          Components: SQL, Tests
    Affects Versions: 3.0.1, 3.1.0
            Reporter: Takeshi Yamamuro


This ticket aims at removing `assert` from `Benchmark` for making it easier to run benchmark codes via `spark-submit`.
Since the current `Benchmark` (`master` and `branch-3.0`) has `assert`, we need to pass the proper jars of `scalatest` and `scalactic`;
 - scalatest-core_2.12-3.2.0.jar
 - scalatest-compatible-3.2.0.jar
 - scalactic_2.12-3.0.jar
{code}
./bin/spark-submit --jars scalatest-core_2.12-3.2.0.jar,scalatest-compatible-3.2.0.jar,scalactic_2.12-3.0.jar,./sql/catalyst/target/spark-catalyst_2.12-3.1.0-SNAPSHOT-tests.jar,./core/target/spark-core_2.12-3.1.0-SNAPSHOT-tests.jar --class org.apache.spark.sql.execution.benchmark.TPCDSQueryBenchmark ./sql/core/target/spark-sql_2.12-3.1.0-SNAPSHOT-tests.jar --data-location /tmp/tpcds-sf1
{code}




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org