[jira] [Updated] (BEAM-12807) Java creates an incorrect pipeline proto when core-construction-java jar is not in the CLASSPATH

["Sachin Agarwal (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/BEAM-12807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sachin Agarwal updated BEAM-12807:
----------------------------------
    Status: Open  (was: Triage Needed)

> Java creates an incorrect pipeline proto when core-construction-java jar is not in the CLASSPATH
> ------------------------------------------------------------------------------------------------
>
>                 Key: BEAM-12807
>                 URL: https://issues.apache.org/jira/browse/BEAM-12807
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-core
>            Reporter: Chamikara Madhusanka Jayalath
>            Priority: P1
>
> Seems like Java ends up creating incorrect pipeline API proto segments when "core-construction-java" is not available in the system.
>  
> For example, this may create  a GBK transform without the URN. 
>  
> This can be reproduced by running the wordcount example in [1] after  removing the following dependency from the pom.xml file.
>     <dependency>
>       <groupId>org.apache.beam</groupId>
>       <artifactId>beam-runners-core-construction-java</artifactId>
>       <version>${beam.version}</version>
>     </dependency>
>  
> Seems like this is because Java is unable to register corresponding XYZTranslation classes (for example [2]). 
>  
> I think we should fail here instead of generating default incorrect proto segments.
>  
> [1] [https://github.com/chamikaramj/multi-language-pipelines]
> [2] [https://github.com/apache/beam/blob/master/runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/GroupByKeyTranslation.java]
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)