You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by gengliangwang <gi...@git.apache.org> on 2018/08/02 17:31:26 UTC

[GitHub] spark pull request #21974: [SPARK-25002][SQL] Avro: revise the output record...

GitHub user gengliangwang opened a pull request:

    https://github.com/apache/spark/pull/21974

    [SPARK-25002][SQL] Avro: revise the output record namespace

    ## What changes were proposed in this pull request?
    
    Currently the output namespace is starting with ".", e.g. `.topLevelRecord`
    
    Although it is valid according to Avro spec, we should remove the starting dot in case of failures when the output Avro file is read by other lib:
    
    https://github.com/linkedin/goavro/pull/96
    
    ## How was this patch tested?
    
    Unit test


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/gengliangwang/spark avro_namespace

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/21974.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #21974
    
----
commit 70ceb84910ae5e7ca8575f72935f2fce41c9c3cb
Author: Gengliang Wang <ge...@...>
Date:   2018-08-02T16:16:19Z

    revise avro namespace

----


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21974: [SPARK-25002][SQL] Avro: revise the output record namesp...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/21974
  
    Merged build finished. Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21974: [SPARK-25002][SQL] Avro: revise the output record namesp...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/21974
  
    **[Test build #94035 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94035/testReport)** for PR 21974 at commit [`70ceb84`](https://github.com/apache/spark/commit/70ceb84910ae5e7ca8575f72935f2fce41c9c3cb).


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21974: [SPARK-25002][SQL] Avro: revise the output record namesp...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/21974
  
    Test PASSed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/1683/
    Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21974: [SPARK-25002][SQL] Avro: revise the output record namesp...

Posted by cloud-fan <gi...@git.apache.org>.
Github user cloud-fan commented on the issue:

    https://github.com/apache/spark/pull/21974
  
    thanks, merging to master!


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21974: [SPARK-25002][SQL] Avro: revise the output record namesp...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/21974
  
    **[Test build #94035 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94035/testReport)** for PR 21974 at commit [`70ceb84`](https://github.com/apache/spark/commit/70ceb84910ae5e7ca8575f72935f2fce41c9c3cb).
     * This patch passes all tests.
     * This patch merges cleanly.
     * This patch adds no public classes.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21974: [SPARK-25002][SQL] Avro: revise the output record namesp...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/21974
  
    Test PASSed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94035/
    Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark pull request #21974: [SPARK-25002][SQL] Avro: revise the output record...

Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:

    https://github.com/apache/spark/pull/21974


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


[GitHub] spark issue #21974: [SPARK-25002][SQL] Avro: revise the output record namesp...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/21974
  
    Merged build finished. Test PASSed.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org