You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Kenneth Knowles (JIRA)" <ji...@apache.org> on 2018/02/12 19:14:00 UTC

[jira] [Commented] (BEAM-3647) Default Coder/Reading Coder From File

    [ https://issues.apache.org/jira/browse/BEAM-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16361303#comment-16361303 ] 

Kenneth Knowles commented on BEAM-3647:
---------------------------------------

I may not understand the request here. It sounds like you want PCollection schemas associated with non-Row objects. That is currently under discussion.

But on the other hand, templates with ValueProvider will not work with SQL because a SQL statement has a customized expansion, and a template has a fixed expansion currently.

> Default Coder/Reading Coder From File 
> --------------------------------------
>
>                 Key: BEAM-3647
>                 URL: https://issues.apache.org/jira/browse/BEAM-3647
>             Project: Beam
>          Issue Type: New Feature
>          Components: beam-model, dsl-sql
>    Affects Versions: 2.2.0
>            Reporter: Kishan Kumar
>            Assignee: Anton Kedin
>            Priority: Critical
>
> *Requirement*-: Need to Run Template With Same Logics on Different Tables Data.(Example is Given Below)
>  
> *Need*: Default Coder is Required So According to Data It Make All Fields as String and Read Data else Thier must be Dynamic Options to Read Coder From GCS as JSON FILE and Parse Data on Basis of That (But We can Pass Location Using ValueProvider) or SomeWhere Else so At Runtime Using ValueProvider.
>  
>  
> *Examples*: I Have Two Tables 1 is Having Column (NAME, CLASS, ROLL, SUB_PRICE)
> And 2 Table is (NAME, ROLL, SUB, TEST_MARKS)
>  
> On Both Tables, I am Just Sorting Table on Basis Of Roll Number so if We can Read Coder at Run Time The Same Template Can Be Used For Different Tables at Run Time.
>  
> Such Situations Make Our Work Easy and Make Our job Easy.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)