You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Stefan Richter <s....@data-artisans.com> on 2018/03/07 15:23:27 UTC

Re: Table Api and CSV builder

Hi,

I think you just need to specify a custom watermark extractor that constructs the watermark from the 3 fields, as described here: https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/event_timestamp_extractors.html <https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/event_timestamp_extractors.html>.

Best,
Stefan

> Am 07.03.2018 um 00:52 schrieb Karim Amer <ka...@gmail.com>:
> 
> Hi there 
> 
> I Have a CSV file with the timestamp deconstructed into 3 fields and I was wondering what is the best way to  specify the those 3 fields are the event  time ? Should I make extend  CsvTableSource and do the preprocessing or can CsvTableSource.builder() handle it. Or is there a better way in general to tackle this obstacle.
> 
> Thanks
>

Re: Table Api and CSV builder

Posted by Timo Walther <tw...@apache.org>.
Hi Karim,

the CsvTableSource and its builder are currently not able to specify 
event-time or processing-time. I'm sure this will change in the near 
future. Until then I would recommend to either extend it yourself or use 
the DataStream API first to do the parsing and watermarking and then 
convert it into a table.

This issue covers your case: 
https://issues.apache.org/jira/browse/FLINK-8536

Regards,
Timo



Am 3/7/18 um 4:23 PM schrieb Stefan Richter:
> Hi,
>
> I think you just need to specify a custom watermark extractor that 
> constructs the watermark from the 3 fields, as described here: 
> https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/event_timestamp_extractors.html.
>
> Best,
> Stefan
>
>> Am 07.03.2018 um 00:52 schrieb Karim Amer <karim.amer.sa@gmail.com 
>> <ma...@gmail.com>>:
>>
>> Hi there
>>
>> I Have a CSV file with the timestamp deconstructed into 3 fields and 
>> I was wondering what is the best way to  specify the those 3 fields 
>> are the event  time ? Should I make extend  CsvTableSource and do the 
>> preprocessing or can CsvTableSource.builder() handle it. Or is there 
>> a better way in general to tackle this obstacle.
>>
>> Thanks
>>
>