You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pegasus.apache.org by GitBox <gi...@apache.org> on 2021/12/30 03:36:05 UTC
[GitHub] [incubator-pegasus] hycdong opened a new issue #861: Avoid unnecessary repeated ingestion in bulk load
hycdong opened a new issue #861:
URL: https://github.com/apache/incubator-pegasus/issues/861
If one partition ingestion failed, all partitions will rollback to download stage, which will lead to repeated ingestion. However, if the primary and secondaries of a partition are not changed, and this partition has been ingested succeed, it should not ingest files again, because ingestion is heavy-disk-load operation and will reject user write requests. As a result, bulk load should avoid repeated ingestion.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@pegasus.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@pegasus.apache.org
For additional commands, e-mail: dev-help@pegasus.apache.org
[GitHub] [incubator-pegasus] hycdong closed issue #861: enhancemant(bulk_load): avoid unnecessary repeated ingestion
Posted by GitBox <gi...@apache.org>.
hycdong closed issue #861:
URL: https://github.com/apache/incubator-pegasus/issues/861
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@pegasus.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@pegasus.apache.org
For additional commands, e-mail: dev-help@pegasus.apache.org
[GitHub] [incubator-pegasus] hycdong closed issue #861: enhancemant(bulk_load): avoid unnecessary repeated ingestion
Posted by GitBox <gi...@apache.org>.
hycdong closed issue #861:
URL: https://github.com/apache/incubator-pegasus/issues/861
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@pegasus.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@pegasus.apache.org
For additional commands, e-mail: dev-help@pegasus.apache.org