You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/11/08 21:49:01 UTC
[jira] [Commented] (BEAM-3161) Cannot output with timestamp XXXX
[ https://issues.apache.org/jira/browse/BEAM-3161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16244776#comment-16244776 ]
ASF GitHub Bot commented on BEAM-3161:
--------------------------------------
GitHub user XuMingmin opened a pull request:
https://github.com/apache/beam/pull/4101
[BEAM-3161] Cannot output with timestamp XXXX
R: @xumingming
CC: @takidau
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/XuMingmin/beam BEAM-3161
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/beam/pull/4101.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4101
----
commit b4e8494708d79d0a2a64e86619bd5b99fcf5799d
Author: mingmxu <mi...@ebay.com>
Date: 2017-11-08T21:44:18Z
change `withAllowedTimestampSkew`
----
> Cannot output with timestamp XXXX
> ---------------------------------
>
> Key: BEAM-3161
> URL: https://issues.apache.org/jira/browse/BEAM-3161
> Project: Beam
> Issue Type: Bug
> Components: dsl-sql
> Reporter: Xu Mingmin
> Assignee: Xu Mingmin
> Fix For: 2.3.0
>
>
> BeamSQL throws exception when running query
> {code}
> select siteId, count(*), TUMBLE_START(unix_timestamp_to_date(eventTimestamp), INTERVAL '1' HOUR) from RHEOS_SOJEVENT_TOTAL GROUP BY siteId, TUMBLE(unix_timestamp_to_date(eventTimestamp), INTERVAL '1' HOUR)
> {code}
> Exception details:
> {code}
> Caused by: java.lang.IllegalArgumentException: Cannot output with timestamp 2017-11-08T21:37:46.000Z. Output timestamps must be no earlier than the timestamp of the current input (2017-11-08T21:37:49.322Z) minus the allowed skew (0 milliseconds). See the DoFn#getAllowedTimestampSkew() Javadoc for details on changing the allowed skew.
> at org.apache.beam.runners.core.SimpleDoFnRunner$DoFnProcessContext.checkTimestamp(SimpleDoFnRunner.java:463)
> at org.apache.beam.runners.core.SimpleDoFnRunner$DoFnProcessContext.outputWithTimestamp(SimpleDoFnRunner.java:429)
> at org.apache.Caused by: java.lang.IllegalArgumentException: Cannot output with timestamp 2017-11-08T21:37:46.000Z. Output timestamps must be no earlier than the timestamp of the current input (2017-11-08T21:37:49.322Z) minus the allowed skew (0 milliseconds). See the DoFn#getAllowedTimestampSkew() Javadoc for details on changing the allowed skew.
> at org.apache.beam.runners.core.SimpleDoFnRunner$DoFnProcessContext.checkTimestamp(SimpleDoFnRunner.java:463)
> at org.apache.beam.runners.core.SimpleDoFnRunner$DoFnProcessContext.outputWithTimestamp(SimpleDoFnRunner.java:429)
> at org.apache.beam.sdk.transforms.WithTimestamps$AddTimestampsDoFn.processElement(WithTimestamps.java:138)beam.sdk.transforms.WithTimestamps$AddTimestampsDoFn.processElement(WithTimestamps.java:138)
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)