You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Jonathan Vexler (Jira)" <ji...@apache.org> on 2022/11/01 20:12:00 UTC

[jira] [Closed] (HUDI-5099) Update stock data so that new records are added in batch_2

     [ https://issues.apache.org/jira/browse/HUDI-5099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Vexler closed HUDI-5099.
---------------------------------
    Resolution: Fixed

Too much stuff changes with docker demo so we're not going to do this

> Update stock data so that new records are added in batch_2
> ----------------------------------------------------------
>
>                 Key: HUDI-5099
>                 URL: https://issues.apache.org/jira/browse/HUDI-5099
>             Project: Apache Hudi
>          Issue Type: Test
>            Reporter: Jonathan Vexler
>            Assignee: Jonathan Vexler
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 0.12.2
>
>
> The record key isĀ  "\{stock name}_\{date} \{hour}". We have the data from 9:30-10:29 in batch_1 and batch_2 contains data from 10:30-10:59. This means that no new records are introduced, and therefore, only updates occur when ingesting batch_2. This makes validation of the data take too long for our testing. Proposed solution is to move the data from 10:00-10:29 into batch_2 so that we will have updates and inserts in both files



--
This message was sent by Atlassian Jira
(v8.20.10#820010)