You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by xuanyuanking <gi...@git.apache.org> on 2018/02/28 07:32:16 UTC

[GitHub] spark pull request #20689: [SPARK-23533][SS] Add support for changing Contin...

GitHub user xuanyuanking opened a pull request:

    https://github.com/apache/spark/pull/20689

    [SPARK-23533][SS] Add support for changing ContinuousDataReader's startOffset

    ## What changes were proposed in this pull request?
    
    As discussion in #20675, we need add a new interface `ContinuousDataReaderFactory` to support the requirements of setting start offset in Continuous Processing.
    
    ## How was this patch tested?
    
    Existing UT.


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/xuanyuanking/spark SPARK-23533

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/20689.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #20689
    
----
commit 59cef98868586a4f039b04e74c32c94eaff965c0
Author: Yuanjian Li <xy...@...>
Date:   2018-02-28T07:29:57Z

    [SPARK-23533][SS] Add support for changing ContinousDataReader's startOffset

----


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    Merged build finished. Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    **[Test build #88253 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88253/testReport)** for PR 20689 at commit [`992e2c1`](https://github.com/apache/spark/commit/992e2c1de84b9e82875f47ecc21aad2a299038a7).


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    Test PASSed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88253/
    Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    Merged build finished. Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    Merged build finished. Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by xuanyuanking <gi...@git.apache.org>.
Github user xuanyuanking commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    retest this please


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request #20689: [SPARK-23533][SS] Add support for changing Contin...

Posted by xuanyuanking <gi...@git.apache.org>.
Github user xuanyuanking commented on a diff in the pull request:

    https://github.com/apache/spark/pull/20689#discussion_r174667490
  
    --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaContinuousReader.scala ---
    @@ -164,7 +164,15 @@ case class KafkaContinuousDataReaderFactory(
         startOffset: Long,
         kafkaParams: ju.Map[String, Object],
         pollTimeoutMs: Long,
    -    failOnDataLoss: Boolean) extends DataReaderFactory[UnsafeRow] {
    +    failOnDataLoss: Boolean) extends ContinuousDataReaderFactory[UnsafeRow] {
    +
    +  override def createDataReaderWithOffset(offset: PartitionOffset): DataReader[UnsafeRow] = {
    +    val kafkaOffset = offset.asInstanceOf[KafkaSourcePartitionOffset]
    +    assert(kafkaOffset.topicPartition == topicPartition)
    --- End diff --
    
    Got it.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    **[Test build #88253 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88253/testReport)** for PR 20689 at commit [`992e2c1`](https://github.com/apache/spark/commit/992e2c1de84b9e82875f47ecc21aad2a299038a7).
     * This patch passes all tests.
     * This patch merges cleanly.
     * This patch adds no public classes.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request #20689: [SPARK-23533][SS] Add support for changing Contin...

Posted by zsxwing <gi...@git.apache.org>.
Github user zsxwing commented on a diff in the pull request:

    https://github.com/apache/spark/pull/20689#discussion_r174585423
  
    --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaContinuousReader.scala ---
    @@ -164,7 +164,15 @@ case class KafkaContinuousDataReaderFactory(
         startOffset: Long,
         kafkaParams: ju.Map[String, Object],
         pollTimeoutMs: Long,
    -    failOnDataLoss: Boolean) extends DataReaderFactory[UnsafeRow] {
    +    failOnDataLoss: Boolean) extends ContinuousDataReaderFactory[UnsafeRow] {
    +
    +  override def createDataReaderWithOffset(offset: PartitionOffset): DataReader[UnsafeRow] = {
    +    val kafkaOffset = offset.asInstanceOf[KafkaSourcePartitionOffset]
    +    assert(kafkaOffset.topicPartition == topicPartition)
    --- End diff --
    
    This may happen. I prefer to use `require` like this:
    ```
    require(kafkaOffset.topicPartition == topicPartition, s"expected: $topicPartition actual: ${kafkaOffset.topicPartition}")
    ```


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    **[Test build #87767 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87767/testReport)** for PR 20689 at commit [`59cef98`](https://github.com/apache/spark/commit/59cef98868586a4f039b04e74c32c94eaff965c0).


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    **[Test build #87758 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87758/testReport)** for PR 20689 at commit [`59cef98`](https://github.com/apache/spark/commit/59cef98868586a4f039b04e74c32c94eaff965c0).


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request #20689: [SPARK-23533][SS] Add support for changing Contin...

Posted by zsxwing <gi...@git.apache.org>.
Github user zsxwing commented on a diff in the pull request:

    https://github.com/apache/spark/pull/20689#discussion_r174585843
  
    --- Diff: sql/core/src/main/java/org/apache/spark/sql/sources/v2/reader/ContinuousDataReaderFactory.java ---
    @@ -0,0 +1,38 @@
    +/*
    + * Licensed to the Apache Software Foundation (ASF) under one or more
    + * contributor license agreements.  See the NOTICE file distributed with
    + * this work for additional information regarding copyright ownership.
    + * The ASF licenses this file to You under the Apache License, Version 2.0
    + * (the "License"); you may not use this file except in compliance with
    + * the License.  You may obtain a copy of the License at
    + *
    + *    http://www.apache.org/licenses/LICENSE-2.0
    + *
    + * Unless required by applicable law or agreed to in writing, software
    + * distributed under the License is distributed on an "AS IS" BASIS,
    + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    + * See the License for the specific language governing permissions and
    + * limitations under the License.
    + */
    +
    +package org.apache.spark.sql.sources.v2.reader;
    +
    +import org.apache.spark.annotation.InterfaceStability;
    +import org.apache.spark.sql.sources.v2.reader.streaming.PartitionOffset;
    +
    +/**
    + * A mix-in interface for {@link DataReaderFactory}. Continuous data reader factories can
    + * implement this interface to provide creating {@link DataReader} with particular offset.
    + */
    +@InterfaceStability.Evolving
    +public interface ContinuousDataReaderFactory<T> extends DataReaderFactory<T> {
    +  /**
    +   * Create a DataReader with particular offset as its startOffset.
    +   *
    +   * @param offset offset want to set as the DataReader's startOffset.
    +   */
    +  default DataReader<T> createDataReaderWithOffset(PartitionOffset offset) {
    +    throw new IllegalStateException(
    --- End diff --
    
    +1 to make this one just abstract.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    Test FAILed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87758/
    Test FAILed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    **[Test build #87811 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87811/testReport)** for PR 20689 at commit [`4bf17a7`](https://github.com/apache/spark/commit/4bf17a738de1b705ee673b8e889394ccbe972f47).


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request #20689: [SPARK-23533][SS] Add support for changing Contin...

Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:

    https://github.com/apache/spark/pull/20689


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    Merged build finished. Test FAILed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    Test PASSed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87767/
    Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    Test PASSed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1175/
    Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    Merged build finished. Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by jose-torres <gi...@git.apache.org>.
Github user jose-torres commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    @tdas 
    
    @rdblue - this is a streaming DataSourceV2 API change specific to continuous processing (SPIP SPARK-20928). We're still iterating towards a solution that makes continuous processing compatible with all the existing Spark operations, so we don't have a full formal description of the API surface yet.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    Merged build finished. Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    Merged build finished. Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    **[Test build #87767 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87767/testReport)** for PR 20689 at commit [`59cef98`](https://github.com/apache/spark/commit/59cef98868586a4f039b04e74c32c94eaff965c0).
     * This patch passes all tests.
     * This patch merges cleanly.
     * This patch adds no public classes.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request #20689: [SPARK-23533][SS] Add support for changing Contin...

Posted by zsxwing <gi...@git.apache.org>.
Github user zsxwing commented on a diff in the pull request:

    https://github.com/apache/spark/pull/20689#discussion_r174585821
  
    --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/ContinuousRateStreamSource.scala ---
    @@ -106,7 +106,19 @@ case class RateStreamContinuousDataReaderFactory(
         partitionIndex: Int,
         increment: Long,
         rowsPerSecond: Double)
    -  extends DataReaderFactory[Row] {
    +  extends ContinuousDataReaderFactory[Row] {
    +
    +  override def createDataReaderWithOffset(offset: PartitionOffset): DataReader[Row] = {
    +    val rateStreamOffset = offset.asInstanceOf[RateStreamPartitionOffset]
    +    assert(rateStreamOffset.partition == partitionIndex)
    --- End diff --
    
    ditto


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    Test PASSed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87811/
    Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    Test PASSed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1141/
    Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by jose-torres <gi...@git.apache.org>.
Github user jose-torres commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    LGTM


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request #20689: [SPARK-23533][SS] Add support for changing Contin...

Posted by jose-torres <gi...@git.apache.org>.
Github user jose-torres commented on a diff in the pull request:

    https://github.com/apache/spark/pull/20689#discussion_r171332700
  
    --- Diff: sql/core/src/main/java/org/apache/spark/sql/sources/v2/reader/ContinuousDataReaderFactory.java ---
    @@ -0,0 +1,38 @@
    +/*
    + * Licensed to the Apache Software Foundation (ASF) under one or more
    + * contributor license agreements.  See the NOTICE file distributed with
    + * this work for additional information regarding copyright ownership.
    + * The ASF licenses this file to You under the Apache License, Version 2.0
    + * (the "License"); you may not use this file except in compliance with
    + * the License.  You may obtain a copy of the License at
    + *
    + *    http://www.apache.org/licenses/LICENSE-2.0
    + *
    + * Unless required by applicable law or agreed to in writing, software
    + * distributed under the License is distributed on an "AS IS" BASIS,
    + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    + * See the License for the specific language governing permissions and
    + * limitations under the License.
    + */
    +
    +package org.apache.spark.sql.sources.v2.reader;
    +
    +import org.apache.spark.annotation.InterfaceStability;
    +import org.apache.spark.sql.sources.v2.reader.streaming.PartitionOffset;
    +
    +/**
    + * A mix-in interface for {@link DataReaderFactory}. Continuous data reader factories can
    + * implement this interface to provide creating {@link DataReader} with particular offset.
    + */
    +@InterfaceStability.Evolving
    +public interface ContinuousDataReaderFactory<T> extends DataReaderFactory<T> {
    +  /**
    +   * Create a DataReader with particular offset as its startOffset.
    +   *
    +   * @param offset offset want to set as the DataReader's startOffset.
    +   */
    +  default DataReader<T> createDataReaderWithOffset(PartitionOffset offset) {
    +    throw new IllegalStateException(
    --- End diff --
    
    I don't know if we want a default here - it seems like subclasses should always be able to provide an implementation, and thus that we should always require them to.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    Test PASSed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1521/
    Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    Test PASSed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1134/
    Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    **[Test build #87758 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87758/testReport)** for PR 20689 at commit [`59cef98`](https://github.com/apache/spark/commit/59cef98868586a4f039b04e74c32c94eaff965c0).
     * This patch **fails due to an unknown error code, -9**.
     * This patch merges cleanly.
     * This patch adds no public classes.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    Merged build finished. Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    **[Test build #87811 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87811/testReport)** for PR 20689 at commit [`4bf17a7`](https://github.com/apache/spark/commit/4bf17a738de1b705ee673b8e889394ccbe972f47).
     * This patch passes all tests.
     * This patch merges cleanly.
     * This patch adds no public classes.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #20689: [SPARK-23533][SS] Add support for changing ContinuousDat...

Posted by zsxwing <gi...@git.apache.org>.
Github user zsxwing commented on the issue:

    https://github.com/apache/spark/pull/20689
  
    Thanks! Merging to master.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org