You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2020/09/01 22:13:00 UTC

[jira] [Work logged] (BEAM-9561) Run pandas tests with Beam Dataframe API

     [ https://issues.apache.org/jira/browse/BEAM-9561?focusedWorklogId=477491&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-477491 ]

ASF GitHub Bot logged work on BEAM-9561:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 01/Sep/20 22:12
            Start Date: 01/Sep/20 22:12
    Worklog Time Spent: 10m 
      Work Description: robertwb commented on pull request #12560:
URL: https://github.com/apache/beam/pull/12560#issuecomment-685161062


   The issue this is solving is when a `DeferredBase` gets packaged up as part of the environment (e.g. in globals, or as an attribute on a PTransform or DoFn, etc.) Given how pickling tries to find the transitive closure of reachable things, this can happen by accident (and can require contortions to avoid), so shouldn't be an error (as long as you don't try to use it). We do the same thing for PCollection: https://github.com/apache/beam/blob/master/sdks/python/apache_beam/pvalue.py#L170.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 477491)
    Time Spent: 3h  (was: 2h 50m)

> Run pandas tests with Beam Dataframe API
> ----------------------------------------
>
>                 Key: BEAM-9561
>                 URL: https://issues.apache.org/jira/browse/BEAM-9561
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-py-core
>            Reporter: Brian Hulette
>            Assignee: Robert Bradshaw
>            Priority: P2
>             Fix For: Not applicable
>
>          Time Spent: 3h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)