You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by witgo <gi...@git.apache.org> on 2016/08/22 13:42:18 UTC

[GitHub] spark pull request #14751: [WIP][SPARK-17184][[CORE]]Replace ByteBuf with In...

GitHub user witgo opened a pull request:

    https://github.com/apache/spark/pull/14751

    [WIP][SPARK-17184][[CORE]]Replace ByteBuf with InputStream

    ## What changes were proposed in this pull request?
    
    The size of ByteBuf can not be greater than 2G, should be replaced by InputStream.
    
    [WIP]
    
    ## How was this patch tested?
    
    [WIP]
    
    
    


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/witgo/spark SPARK-17184_ByteBuf_2_InputStream

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/14751.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #14751
    
----
commit b2294412bd75a83f8f55d531416cfc2bfff0111a
Author: Guoqiang Li <wi...@qq.com>
Date:   2016-08-16T08:43:51Z

    Replace ByteBuffer with ChunkedByteBuffer

commit 7ab9ba54320fd86cfa489e625fba489a987b49ff
Author: Guoqiang Li <wi...@qq.com>
Date:   2016-08-22T13:39:24Z

    Replace ByteBuf with InputStream

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org

[GitHub] spark issue #14751: [WIP][SPARK-17184][[CORE]]Replace ByteBuf with InputStre...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/14751
  
    **[Test build #64204 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64204/consoleFull)** for PR 14751 at commit [`7ab9ba5`](https://github.com/apache/spark/commit/7ab9ba54320fd86cfa489e625fba489a987b49ff).


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org

[GitHub] spark pull request #14751: [WIP][SPARK-17184][[CORE]]Replace ByteBuf with In...

Posted by witgo <gi...@git.apache.org>.
Github user witgo closed the pull request at:

    https://github.com/apache/spark/pull/14751


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org

[GitHub] spark issue #14751: [WIP][SPARK-17184][[CORE]]Replace ByteBuf with InputStre...

Posted by SparkQA <gi...@git.apache.org>.
Github user SparkQA commented on the issue:

    https://github.com/apache/spark/pull/14751
  
    **[Test build #64204 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64204/consoleFull)** for PR 14751 at commit [`7ab9ba5`](https://github.com/apache/spark/commit/7ab9ba54320fd86cfa489e625fba489a987b49ff).
     * This patch **fails MiMa tests**.
     * This patch merges cleanly.
     * This patch adds the following public classes _(experimental)_:
      * `public class InputStreamManagedBuffer extends ManagedBuffer `
      * `  public static class Longs `
      * `  public static class Doubles `
      * `  public static class Ints `
      * `  public static class Bytes `
      * `public class InputStreamByteBuf extends InputStream `
      * `public final class MessageDecoder extends MessageToMessageDecoder<LinkedList<ByteBuf>> `
      * `public abstract class BlockTransferMessage `


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org

[GitHub] spark issue #14751: [WIP][SPARK-17184][[CORE]]Replace ByteBuf with InputStre...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/14751
  
    Merged build finished. Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org

[GitHub] spark issue #14751: [WIP][SPARK-17184][[CORE]]Replace ByteBuf with InputStre...

Posted by AmplabJenkins <gi...@git.apache.org>.
Github user AmplabJenkins commented on the issue:

    https://github.com/apache/spark/pull/14751
  
    Test FAILed.
    Refer to this link for build results (access rights to CI server needed): 
    https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64204/
    Test FAILed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org