You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2020/04/29 15:39:29 UTC
[GitHub] [spark] yaooqinn removed a comment on pull request #28055: [SPARK-31289][TEST][test-hive1.2] Eliminate org.apache.spark.sql.hive.thriftserver.CliSuite flakiness
yaooqinn removed a comment on pull request #28055:
URL: https://github.com/apache/spark/pull/28055#issuecomment-619751851
Master vs this PR, run 2 times each, there seems half minute delay if there no error happens
```scala
[info] CliSuite:
[info] - load warehouse dir from hive-site.xml (14 seconds, 416 milliseconds)
[info] - load warehouse dir from --hiveconf (12 seconds, 197 milliseconds)
[info] - load warehouse dir from --conf spark(.hadoop).hive.* (23 seconds, 489 milliseconds)
[info] - load warehouse dir from spark.sql.warehouse.dir (12 seconds, 148 milliseconds)
[info] - Simple commands (21 seconds, 337 milliseconds)
[info] - Single command with -e (11 seconds, 137 milliseconds)
[info] - Single command with --database (22 seconds, 780 milliseconds)
[info] - Commands using SerDe provided in --jars (17 seconds, 242 milliseconds)
[info] - SPARK-29022: Commands using SerDe provided in --hive.aux.jars.path (18 seconds, 253 milliseconds)
[info] - SPARK-11188 Analysis error reporting (11 seconds, 387 milliseconds)
[info] - SPARK-11624 Spark SQL CLI should set sessionState only once (9 seconds, 120 milliseconds)
[info] - list jars (11 seconds, 997 milliseconds)
[info] - list jar <jarfile> (12 seconds, 54 milliseconds)
[info] - list files (12 seconds, 142 milliseconds)
[info] - list file <filepath> (11 seconds, 461 milliseconds)
[info] - apply hiveconf from cli command (11 seconds, 657 milliseconds)
[info] - Support hive.aux.jars.path (17 seconds, 229 milliseconds)
[info] - SPARK-28840 test --jars command (13 seconds, 939 milliseconds)
[info] - SPARK-28840 test --jars and hive.aux.jars.path command (14 seconds, 198 milliseconds)
[info] - SPARK-29022 Commands using SerDe provided in ADD JAR sql (18 seconds, 716 milliseconds)
[info] - SPARK-26321 Should not split semicolon within quoted string literals (13 seconds, 477 milliseconds)
[info] - Pad Decimal numbers with trailing zeros to the scale of the column (13 seconds, 814 milliseconds)
[info] - SPARK-30049 Should not complain for quotes in commented lines (14 seconds, 641 milliseconds)
[info] - SPARK-30049 Should not complain for quotes in commented with multi-lines (26 seconds, 232 milliseconds)
[info] ScalaTest
[info] Run completed in 6 minutes, 8 seconds.
[info] Total number of tests run: 24
[info] Suites: completed 1, aborted 0
[info] Tests: succeeded 24, failed 0, canceled 0, ignored 0, pending 0
[info] All tests passed.
[info] Passed: Total 24, Failed 0, Errors 0, Passed 24
[success] Total time: 620 s, completed 2020-4-27 13:48:54
[info] CliSuite:
[info] - load warehouse dir from hive-site.xml (11 seconds, 917 milliseconds)
[info] - load warehouse dir from --hiveconf (12 seconds, 254 milliseconds)
[info] - load warehouse dir from --conf spark(.hadoop).hive.* (23 seconds, 285 milliseconds)
[info] - load warehouse dir from spark.sql.warehouse.dir (12 seconds, 139 milliseconds)
[info] - Simple commands (16 seconds, 821 milliseconds)
[info] - Single command with -e (11 seconds, 601 milliseconds)
[info] - Single command with --database (23 seconds, 393 milliseconds)
[info] - Commands using SerDe provided in --jars (16 seconds, 825 milliseconds)
[info] - SPARK-29022: Commands using SerDe provided in --hive.aux.jars.path (16 seconds, 525 milliseconds)
[info] - SPARK-11188 Analysis error reporting (9 seconds, 934 milliseconds)
[info] - SPARK-11624 Spark SQL CLI should set sessionState only once (9 seconds, 79 milliseconds)
[info] - list jars (11 seconds, 576 milliseconds)
[info] - list jar <jarfile> (11 seconds, 989 milliseconds)
[info] - list files (11 seconds, 907 milliseconds)
[info] - list file <filepath> (12 seconds, 115 milliseconds)
[info] - apply hiveconf from cli command (11 seconds, 520 milliseconds)
[info] - Support hive.aux.jars.path (13 seconds, 159 milliseconds)
[info] - SPARK-28840 test --jars command (12 seconds, 820 milliseconds)
[info] - SPARK-28840 test --jars and hive.aux.jars.path command (13 seconds, 326 milliseconds)
[info] - SPARK-29022 Commands using SerDe provided in ADD JAR sql (15 seconds, 459 milliseconds)
[info] - SPARK-26321 Should not split semicolon within quoted string literals (12 seconds, 574 milliseconds)
[info] - Pad Decimal numbers with trailing zeros to the scale of the column (12 seconds, 813 milliseconds)
[info] - SPARK-30049 Should not complain for quotes in commented lines (12 seconds, 501 milliseconds)
[info] - SPARK-30049 Should not complain for quotes in commented with multi-lines (24 seconds, 560 milliseconds)
[info] ScalaTest
[info] Run completed in 5 minutes, 42 seconds.
[info] Total number of tests run: 24
[info] Suites: completed 1, aborted 0
[info] Tests: succeeded 24, failed 0, canceled 0, ignored 0, pending 0
[info] All tests passed.
[info] Passed: Total 24, Failed 0, Errors 0, Passed 24
[success] Total time: 370 s, completed 2020-4-27 13:56:31
```
```scala
[info] CliSuite:
[info] - load warehouse dir from hive-site.xml (16 seconds, 470 milliseconds)
[info] - load warehouse dir from --hiveconf (12 seconds, 245 milliseconds)
[info] - load warehouse dir from --conf spark(.hadoop).hive.* (23 seconds, 133 milliseconds)
[info] - load warehouse dir from spark.sql.warehouse.dir (11 seconds, 622 milliseconds)
[info] - Simple commands (15 seconds, 746 milliseconds)
[info] - Single command with -e (1 second, 18 milliseconds)
[info] - Single command with --database (16 seconds, 449 milliseconds)
[info] - Commands using SerDe provided in --jars (15 seconds, 69 milliseconds)
[info] - SPARK-29022: Commands using SerDe provided in --hive.aux.jars.path (14 seconds, 257 milliseconds)
[info] - SPARK-11188 Analysis error reporting (8 seconds, 882 milliseconds)
[info] - SPARK-11624 Spark SQL CLI should set sessionState only once (7 seconds, 894 milliseconds)
[info] - list jars (10 seconds, 76 milliseconds)
[info] - list jar <jarfile> (10 seconds, 64 milliseconds)
[info] - list files (8 seconds, 371 milliseconds)
[info] - list file <filepath> (8 seconds, 677 milliseconds)
[info] - apply hiveconf from cli command (10 seconds, 610 milliseconds)
[info] - Support hive.aux.jars.path (12 seconds, 422 milliseconds)
[info] - SPARK-28840 test --jars command (11 seconds, 970 milliseconds)
[info] - SPARK-28840 test --jars and hive.aux.jars.path command (12 seconds, 642 milliseconds)
[info] - SPARK-29022 Commands using SerDe provided in ADD JAR sql (15 seconds, 971 milliseconds)
[info] - SPARK-26321 Should not split semicolon within quoted string literals (13 seconds, 659 milliseconds)
[info] - Pad Decimal numbers with trailing zeros to the scale of the column (11 seconds, 810 milliseconds)
[info] - SPARK-30049 Should not complain for quotes in commented lines (11 seconds, 466 milliseconds)
[info] - SPARK-30049 Should not complain for quotes in commented with multi-lines (23 seconds, 413 milliseconds)
[info] ScalaTest
[info] Run completed in 5 minutes, 6 seconds.
[info] Total number of tests run: 24
[info] Suites: completed 1, aborted 0
[info] Tests: succeeded 24, failed 0, canceled 0, ignored 0, pending 0
[info] All tests passed.
[info] Passed: Total 24, Failed 0, Errors 0, Passed 24
[success] Total time: 563 s, completed 2020-4-27 14:07:39
[info] CliSuite:
[info] - load warehouse dir from hive-site.xml (11 seconds, 901 milliseconds)
[info] - load warehouse dir from --hiveconf (11 seconds, 803 milliseconds)
[info] - load warehouse dir from --conf spark(.hadoop).hive.* (28 seconds, 325 milliseconds)
[info] - load warehouse dir from spark.sql.warehouse.dir (12 seconds, 106 milliseconds)
[info] - Simple commands (12 seconds, 178 milliseconds)
[info] - Single command with -e (1 second, 19 milliseconds)
[info] - Single command with --database (16 seconds, 795 milliseconds)
[info] - Commands using SerDe provided in --jars (15 seconds, 255 milliseconds)
[info] - SPARK-29022: Commands using SerDe provided in --hive.aux.jars.path (14 seconds, 817 milliseconds)
[info] - SPARK-11188 Analysis error reporting (9 seconds, 60 milliseconds)
[info] - SPARK-11624 Spark SQL CLI should set sessionState only once (10 seconds, 225 milliseconds)
[info] - list jars (11 seconds, 240 milliseconds)
[info] - list jar <jarfile> (10 seconds, 250 milliseconds)
[info] - list files (8 seconds, 521 milliseconds)
[info] - list file <filepath> (8 seconds, 451 milliseconds)
[info] - apply hiveconf from cli command (10 seconds, 679 milliseconds)
[info] - Support hive.aux.jars.path (12 seconds, 246 milliseconds)
[info] - SPARK-28840 test --jars command (11 seconds, 850 milliseconds)
[info] - SPARK-28840 test --jars and hive.aux.jars.path command (12 seconds, 399 milliseconds)
[info] - SPARK-29022 Commands using SerDe provided in ADD JAR sql (14 seconds, 877 milliseconds)
[info] - SPARK-26321 Should not split semicolon within quoted string literals (11 seconds, 638 milliseconds)
[info] - Pad Decimal numbers with trailing zeros to the scale of the column (11 seconds, 433 milliseconds)
[info] - SPARK-30049 Should not complain for quotes in commented lines (11 seconds, 534 milliseconds)
[info] - SPARK-30049 Should not complain for quotes in commented with multi-lines (23 seconds, 30 milliseconds)
[info] ScalaTest
[info] Run completed in 5 minutes, 3 seconds.
[info] Total number of tests run: 24
[info] Suites: completed 1, aborted 0
[info] Tests: succeeded 24, failed 0, canceled 0, ignored 0, pending 0
[info] All tests passed.
[info] Passed: Total 24, Failed 0, Errors 0, Passed 24
[success] Total time: 331 s, completed 2020-4-27 14:13:28
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org