You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Ryan Thompson (Jira)" <ji...@apache.org> on 2021/12/06 16:28:00 UTC

[jira] [Created] (BEAM-13385) Test non default pickle library

Ryan Thompson created BEAM-13385:
------------------------------------

             Summary: Test non default pickle library
                 Key: BEAM-13385
                 URL: https://issues.apache.org/jira/browse/BEAM-13385
             Project: Beam
          Issue Type: Improvement
          Components: sdk-py-core
            Reporter: Ryan Thompson
            Assignee: Ryan Thompson


The python SDK recently added support for the cloudpickle library though the default is still dill. See [_https://s.apache.org/beam-picklers_] and https://issues.apache.org/jira/browse/BEAM-8123.

 

We intend to switch this over to cloudpickle as the default.

 

We should have a suite of E2E tests to make sure we don't introduce regressions into whichever pickle library is not the default.  That is to say:

First -  E2E tests for the using the cloudpickle library.

After cloudpickle library becomes the default - switch these E2E tests to cover dill.

 

This will allow test coverage while we hopefully transition to just supporting a single library.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)