You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Jack Moseley (Jira)" <ji...@apache.org> on 2022/10/21 20:53:00 UTC

[jira] [Updated] (GOBBLIN-1732) Search for dummy file in writer directory

     [ https://issues.apache.org/jira/browse/GOBBLIN-1732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jack Moseley updated GOBBLIN-1732:
----------------------------------
    Description: When sending change_property events, the GMCE publisher searches in the top level dataset directory for an example file. This could find files with other schemas/paths if there are different directories in the dataset directory. The search should only be under the directory written to by the pipeline that is sending the GMCE.

> Search for dummy file in writer directory
> -----------------------------------------
>
>                 Key: GOBBLIN-1732
>                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1732
>             Project: Apache Gobblin
>          Issue Type: Improvement
>            Reporter: Jack Moseley
>            Priority: Major
>          Time Spent: 40m
>  Remaining Estimate: 0h
>
> When sending change_property events, the GMCE publisher searches in the top level dataset directory for an example file. This could find files with other schemas/paths if there are different directories in the dataset directory. The search should only be under the directory written to by the pipeline that is sending the GMCE.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)