You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@seatunnel.apache.org by GitBox <gi...@apache.org> on 2022/09/27 13:42:58 UTC

[GitHub] [incubator-seatunnel] yuangjiang opened a new issue, #2919: The relational library supports upsert mode writing

yuangjiang opened a new issue, #2919:
URL: https://github.com/apache/incubator-seatunnel/issues/2919

### Search before asking

- [X] I had searched in the [feature](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

### Description

The relational library supports upsert mode writing, for example, when mysql->oracle is used, data is quickly imported into the main table through distributed distribution. When encountering an update failure, log the error to a file and the entire task does not stop. Record data of failed task synchronization after the task is completed. It turned out that we used the temporary table method to solve this problem. I don't know if seatunnel has a relatively complete and fast data import solution.

### Usage Scenario

_No response_

### Related issues

_No response_

### Are you willing to submit a PR?

- [ ] Yes I am willing to submit a PR!

### Code of Conduct

- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)

--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #2919: The relational library supports upsert mode writing

Posted by GitBox <gi...@apache.org>.

github-actions[bot] commented on issue #2919:
URL: https://github.com/apache/incubator-seatunnel/issues/2919#issuecomment-1295659778

   This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] github-actions[bot] closed issue #2919: The relational library supports upsert mode writing

Posted by GitBox <gi...@apache.org>.

github-actions[bot] closed issue #2919: The relational library supports upsert mode writing
URL: https://github.com/apache/incubator-seatunnel/issues/2919


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #2919: The relational library supports upsert mode writing

Posted by GitBox <gi...@apache.org>.

github-actions[bot] commented on issue #2919:
URL: https://github.com/apache/incubator-seatunnel/issues/2919#issuecomment-1304356179

   This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] CalvinKirs commented on issue #2919: The relational library supports upsert mode writing

Posted by GitBox <gi...@apache.org>.

CalvinKirs commented on issue #2919:
URL: https://github.com/apache/incubator-seatunnel/issues/2919#issuecomment-1259540182

   @ic4y Hi, do you have any idea?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] liugddx commented on issue #2919: The relational library supports upsert mode writing

Posted by GitBox <gi...@apache.org>.

liugddx commented on issue #2919:
URL: https://github.com/apache/incubator-seatunnel/issues/2919#issuecomment-1260327954

   i have an idea,when data synchronization fails,we can write drity data to a three-way store,need a dirtyManager module to do this job.And this module is pluggable,we can configure it in the env.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org