You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Lukasz Gajowy (Jira)" <ji...@apache.org> on 2019/12/19 15:23:00 UTC
[jira] [Assigned] (BEAM-7658) Synthetic unbounded source looses
(duplicates?) data while splitting
[ https://issues.apache.org/jira/browse/BEAM-7658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lukasz Gajowy reassigned BEAM-7658:
-----------------------------------
Assignee: (was: Lukasz Gajowy)
> Synthetic unbounded source looses (duplicates?) data while splitting
> --------------------------------------------------------------------
>
> Key: BEAM-7658
> URL: https://issues.apache.org/jira/browse/BEAM-7658
> Project: Beam
> Issue Type: Bug
> Components: testing
> Reporter: Lukasz Gajowy
> Priority: Major
>
> This came out while creating KafkaIOIT ingesting data generated using SyntheticUnboundedSource. Hashcode of data created by
> {code:java}
> .apply("Calculate hashcode", Combine.globally(new HashingFn()).withoutDefaults()){code}
> was different for 1000 records every time. When a number of splits was set to 1 the problem disappeared (sourceOptions.forceNumInitialBundles).
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)