You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hivemall.apache.org by maropu <gi...@git.apache.org> on 2017/01/26 08:48:11 UTC

[GitHub] incubator-hivemall pull request #28: [HIVEMALL-30] Temporarily ignore a stre...

GitHub user maropu opened a pull request:

    https://github.com/apache/incubator-hivemall/pull/28

    [HIVEMALL-30] Temporarily ignore a streaming test

    ## What changes were proposed in this pull request?
    This test below fails sometimes (too flaky), so we temporarily ignore it.
    The stacktrace of this failure is:
    ```
    HivemallOpsWithFeatureSuite:
    Exception in thread "broadcast-exchange-60" java.lang.OutOfMemoryError: Java heap space
    	at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
    	at java.nio.ByteBuffer.allocate(ByteBuffer.java:331)
    	at org.apache.spark.broadcast.TorrentBroadcast$$anonfun$4.apply(TorrentBroadcast.scala:231)
    	at org.apache.spark.broadcast.TorrentBroadcast$$anonfun$4.apply(TorrentBroadcast.scala:231)
    	at org.apache.spark.util.io.ChunkedByteBufferOutputStream.allocateNewChunkIfNeeded(ChunkedByteBufferOutputStream.scala:78)
    	at org.apache.spark.util.io.ChunkedByteBufferOutputStream.write(ChunkedByteBufferOutputStream.scala:65)
    	at net.jpountz.lz4.LZ4BlockOutputStream.flushBufferedData(LZ4BlockOutputStream.java:205)
    	at net.jpountz.lz4.LZ4BlockOutputStream.finish(LZ4BlockOutputStream.java:235)
    	at net.jpountz.lz4.LZ4BlockOutputStream.close(LZ4BlockOutputStream.java:175)
    	at java.io.ObjectOutputStream$BlockDataOutputStream.close(ObjectOutputStream.java:1827)
    	at java.io.ObjectOutputStream.close(ObjectOutputStream.java:741)
    	at org.apache.spark.serializer.JavaSerializationStream.close(JavaSerializer.scala:57)
    	at org.apache.spark.broadcast.TorrentBroadcast$$anonfun$blockifyObject$1.apply$mcV$sp(TorrentBroadcast.scala:238)
    	at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1296)
    	at org.apache.spark.broadcast.TorrentBroadcast$.blockifyObject(TorrentBroadcast.scala:237)
    	at org.apache.spark.broadcast.TorrentBroadcast.writeBlocks(TorrentBroadcast.scala:107)
    	at org.apache.spark.broadcast.TorrentBroadcast.<init>(TorrentBroadcast.scala:86)
    	at org.apache.spark.broadcast.TorrentBroadcastFactory.newBroadcast(TorrentBroadcastFactory.scala:34)
    	at org.apache.spark.broadcast.BroadcastManager.newBroadcast(BroadcastManager.scala:56)
    	at org.apache.spark.SparkContext.broadcast(SparkContext.scala:1370)
    ```
    
    ## What type of PR is it?
    Bug Fix
    
    ### What is the Jira issue?
    https://issues.apache.org/jira/browse/HIVEMALL-30


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/maropu/incubator-hivemall HIVEMALL-30

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-hivemall/pull/28.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #28
    
----
commit db3de52892fee8027fab2a99499ee6658f1eb4fa
Author: Takeshi YAMAMURO <li...@gmail.com>
Date:   2017-01-26T08:44:23Z

    Temporarily ignore a streaming test

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-hivemall issue #28: [HIVEMALL-30] Temporarily ignore a streaming t...

Posted by coveralls <gi...@git.apache.org>.
Github user coveralls commented on the issue:

    https://github.com/apache/incubator-hivemall/pull/28
  
    
    [![Coverage Status](https://coveralls.io/builds/9851594/badge)](https://coveralls.io/builds/9851594)
    
    Coverage increased (+0.01%) to 35.842% when pulling **b0feb79c73d4abe6a2886673fbfaaec569937753 on maropu:HIVEMALL-30** into **79f92f4f2c6458ccf4133744a1654a46cbbb56cc on apache:master**.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-hivemall issue #28: [HIVEMALL-30] Temporarily ignore a streaming t...

Posted by maropu <gi...@git.apache.org>.
Github user maropu commented on the issue:

    https://github.com/apache/incubator-hivemall/pull/28
  
    @myui okay to merge this?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-hivemall issue #28: [HIVEMALL-30] Temporarily ignore a streaming t...

Posted by myui <gi...@git.apache.org>.
Github user myui commented on the issue:

    https://github.com/apache/incubator-hivemall/pull/28
  
    @maropu LGTM. Please merge it.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-hivemall pull request #28: [HIVEMALL-30] Temporarily ignore a stre...

Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:

    https://github.com/apache/incubator-hivemall/pull/28


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-hivemall issue #28: [HIVEMALL-30] Temporarily ignore a streaming t...

Posted by maropu <gi...@git.apache.org>.
Github user maropu commented on the issue:

    https://github.com/apache/incubator-hivemall/pull/28
  
    I turned off this test for now and keep looking into the root cause. If the cause found and fixed, I'll close the JIRA. So, I keep the JIRA ticket open.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-hivemall issue #28: [HIVEMALL-30] Temporarily ignore a streaming t...

Posted by maropu <gi...@git.apache.org>.
Github user maropu commented on the issue:

    https://github.com/apache/incubator-hivemall/pull/28
  
    Merged


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-hivemall issue #28: [HIVEMALL-30] Temporarily ignore a streaming t...

Posted by coveralls <gi...@git.apache.org>.
Github user coveralls commented on the issue:

    https://github.com/apache/incubator-hivemall/pull/28
  
    
    [![Coverage Status](https://coveralls.io/builds/9851471/badge)](https://coveralls.io/builds/9851471)
    
    Changes Unknown when pulling **b0feb79c73d4abe6a2886673fbfaaec569937753 on maropu:HIVEMALL-30** into ** on apache:master**.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---