[jira] [Created] (BEAM-2600) Artifact for Python SDK harness that can be referenced in pipeline definition

["Kenneth Knowles (JIRA)" <ji...@apache.org>]

Kenneth Knowles created BEAM-2600:
-------------------------------------

             Summary: Artifact for Python SDK harness that can be referenced in pipeline definition
                 Key: BEAM-2600
                 URL: https://issues.apache.org/jira/browse/BEAM-2600
             Project: Beam
          Issue Type: New Feature
          Components: sdk-py
            Reporter: Kenneth Knowles
            Assignee: Ahmet Altay


In order to build a pipeline that invokes a Python UDF, we need to be able to construct something like this:

{code}
SdkFunctionSpec {
  environment = <python SDK harness>,
  spec = {
    urn = <python SDK pickled DoFn>,
    data = <pickled DoFn>
  }
}
{code}

I do not know that there exists anything we can put for "<python SDK harness>" today. For prototyping, it could be just a symbol that runners have to know. But eventually it should be something that runners can instantiate without knowing anything about the SDK that put it there.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)