You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2019/01/09 13:53:00 UTC
[jira] [Work logged] (BEAM-6396) PipelineTest:test_memory_usage fails with new urllib3 on some platforms

     [ https://issues.apache.org/jira/browse/BEAM-6396?focusedWorklogId=183071&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-183071 ]

ASF GitHub Bot logged work on BEAM-6396:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 09/Jan/19 13:52
            Start Date: 09/Jan/19 13:52
    Worklog Time Spent: 10m 
      Work Description: kadircet commented on pull request #7448: [BEAM-6396] Disables memory usage test
URL: https://github.com/apache/beam/pull/7448
 
 
   Disable memory usage test since it fails on some platforms with urllib3 v1.24.1
   
   After an update of urllib3 from 1.15.1 to 1.24.1 this test started to fail with about an 50% increase in memory. After my initial analysis through `objgraph` I have seen that there was an increase in amount of tuple's being used by the test which was proportional to `num_maps * num_elements`.
   
   I've also opened the issue urllib3/urllib3#1514
   
   Post-Commit Tests Status (on master branch)
   ------------------------------------------------------------------------------------------------
   
   Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark
   --- | --- | --- | --- | --- | --- | --- | ---
   Go | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/) | --- | --- | --- | --- | --- | ---
   Java | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/)<br>[![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/)<br>[![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/)
   Python | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/) | --- | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/) </br> [![Build Status](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/lastCompletedBuild/) | --- | --- | ---
   
   
   
   
   
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

            Worklog Id:     (was: 183071)
            Time Spent: 10m
    Remaining Estimate: 0h

> PipelineTest:test_memory_usage fails with new urllib3 on some platforms
> -----------------------------------------------------------------------
>
>                 Key: BEAM-6396
>                 URL: https://issues.apache.org/jira/browse/BEAM-6396
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-py-core
>            Reporter: kadir cetinkaya
>            Assignee: Ahmet Altay
>            Priority: Blocker
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Disable memory usage test since it fails on some platforms with urllib3 v1.24.1
> After an update of urllib3 from 1.15.1 to 1.24.1 this test started to fail with about an 50% increase in memory. After my initial analysis through `objgraph` I have seen that there was an increase in amount of tuple's being used by the test which was proportional to `num_maps * num_elements`.
> I've also opened the issue urllib3/urllib3#1514



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)