You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2019/04/02 02:33:22 UTC

[GitHub] [spark] dongjoon-hyun opened a new pull request #24268: [SPARK-26856][PYSPARK][FOLLOWUP] Fix wrong pattern for Kinesis assembly

dongjoon-hyun opened a new pull request #24268: [SPARK-26856][PYSPARK][FOLLOWUP] Fix wrong pattern for Kinesis assembly
URL: https://github.com/apache/spark/pull/24268
 
 
   ## What changes were proposed in this pull request?
   
   After SPARK-26856, `Kinesis` Python UT fails due to a wrong pattern.
   
   - https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/104171/console
   ```
   Exception: Found multiple JARs: 
   .../spark-streaming-kinesis-asl-assembly-3.0.0-SNAPSHOT.jar,
   .../spark-streaming-kinesis-asl-assembly_2.12-3.0.0-SNAPSHOT.jar;
   please remove all but one
   ```
   
   Since the assembly jar has different names, this PR recovers the pattern.
   ```
   -rw-r--r--   1 dongjoon  staff   8.6K Apr  1 18:55 spark-streaming-kinesis-asl-assembly_2.12-3.0.0-SNAPSHOT-sources.jar
   -rw-r--r--   1 dongjoon  staff   8.6K Apr  1 18:55 spark-streaming-kinesis-asl-assembly_2.12-3.0.0-SNAPSHOT-test-sources.jar
   -rw-r--r--   1 dongjoon  staff   8.7K Apr  1 18:55 spark-streaming-kinesis-asl-assembly_2.12-3.0.0-SNAPSHOT-tests.jar
   -rw-r--r--   1 dongjoon  staff    21M Apr  1 18:55 spark-streaming-kinesis-asl-assembly_2.12-3.0.0-SNAPSHOT.jar
   ```
   
   ```
   -rw-r--r--  1 dongjoon  staff  87459461 Apr  1 19:01 spark-streaming-kinesis-asl-assembly-3.0.0-SNAPSHOT.jar
   -rw-r--r--  1 dongjoon  staff       309 Apr  1 18:58 spark-streaming-kinesis-asl-assembly_2.12-3.0.0-SNAPSHOT-tests.jar
   -rw-r--r--  1 dongjoon  staff       309 Apr  1 18:58 spark-streaming-kinesis-asl-assembly_2.12-3.0.0-SNAPSHOT.jar
   ```
   
   ## How was this patch tested?
   
   Pass the Jenkins.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org