You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "navina (via GitHub)" <gi...@apache.org> on 2023/03/21 19:16:40 UTC
[GitHub] [pinot] navina opened a new issue, #10452: Support delete record with upsert table
navina opened a new issue, #10452:
URL: https://github.com/apache/pinot/issues/10452
Upsert feature allows users to update existing records in Pinot. Deletes of existing records, however, are currently not supported.
Delete can be treated as a special kind of update operation and handled in Pinot's realtime engine. This will open up support for ingesting Change Data Capture (CDC) data like Debezium where the changes from a source (typically, transactional) will also contain a DELETE event.
The challenge here would be to handle out of order events correctly in the presence of deletes.
Design proposal: [link](https://docs.google.com/document/d/19s1AHCRjmqeVa0z_djYBTAt_meg6qWcUxwRO3y-G9O4/edit#)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] navina commented on issue #10452: Support delete record with upsert table
Posted by "navina (via GitHub)" <gi...@apache.org>.
navina commented on issue #10452:
URL: https://github.com/apache/pinot/issues/10452#issuecomment-1595141414
Thanks for the review @mcvsubbu . I have addressed your feedback.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] mcvsubbu commented on issue #10452: Support delete record with upsert table
Posted by "mcvsubbu (via GitHub)" <gi...@apache.org>.
mcvsubbu commented on issue #10452:
URL: https://github.com/apache/pinot/issues/10452#issuecomment-1593878626
> @Jackie-Jiang @npawar @yupeng9 @mcvsubbu Here is the updated design proposal for this issue - [design](https://docs.google.com/document/d/19s1AHCRjmqeVa0z_djYBTAt_meg6qWcUxwRO3y-G9O4/edit#)
>
> I have implemented the changes based on this design in this PR #10703 and it seems to work well. PTAL. Ty!
Thanks, Navina. I dropped some (relatively minor) querstions in the design doc. Could you please modify accordingly?
cc: @sajjad-moradi
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] navina commented on issue #10452: Support delete record with upsert table
Posted by "navina (via GitHub)" <gi...@apache.org>.
navina commented on issue #10452:
URL: https://github.com/apache/pinot/issues/10452#issuecomment-1612107496
Resolving this issue. Documentation updated here - https://docs.pinot.apache.org/basics/data-import/upsert#delete-column
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] navina closed issue #10452: Support delete record with upsert table
Posted by "navina (via GitHub)" <gi...@apache.org>.
navina closed issue #10452: Support delete record with upsert table
URL: https://github.com/apache/pinot/issues/10452
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] navina commented on issue #10452: Support delete record with upsert table
Posted by "navina (via GitHub)" <gi...@apache.org>.
navina commented on issue #10452:
URL: https://github.com/apache/pinot/issues/10452#issuecomment-1478455557
Labels: `feature` , `ingestion`
Assignee `navina`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] navina commented on issue #10452: Support delete record with upsert table
Posted by "navina (via GitHub)" <gi...@apache.org>.
navina commented on issue #10452:
URL: https://github.com/apache/pinot/issues/10452#issuecomment-1592414357
@Jackie-Jiang @npawar @yupeng9 @mcvsubbu
Here is the updated design proposal for this issue - [design](https://docs.google.com/document/d/19s1AHCRjmqeVa0z_djYBTAt_meg6qWcUxwRO3y-G9O4/edit#)
I have implemented the changes based on this design in this PR #10703 and it seems to work well. PTAL. Ty!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org