You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "rohityadav1993 (via GitHub)" <gi...@apache.org> on 2023/11/06 06:34:25 UTC
[I] INSERT INTO api support [pinot]
rohityadav1993 opened a new issue, #11954:
URL: https://github.com/apache/pinot/issues/11954
[11914](https://github.com/apache/pinot/issues/11914) will add support for adding segments to realtime tables.
There are several pros of directly ingesting data to realtime tables via an API similar to `INSERT INTO` statement.
As initial thoughts, there have been several minion based improvements that would solve the large number of small sized segment created, e.g. merge & roll up task for realtime tables, upsert compaction for upsert tables.
There are several challenges e.g. partitioning the incoming messages for upsert tables or exposing APIs for client to identify the right server to ingest to, interface layer for ingesting messages from an API, etc.
This also reduces the feature disparity from ES or [clickhouse](https://clickhouse.com/docs/en/guides/inserting-data) and allows for some of the existing use case migration to Pinot if needed.
Starting this conversation to understand the feasibility of such a feature
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] INSERT INTO api support [pinot]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #11954:
URL: https://github.com/apache/pinot/issues/11954#issuecomment-5657377059
This issue has been closed because it has been inactive for 180 days. If you believe this issue is still relevant, please feel free to reopen it or create a new issue. Thank you!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] INSERT INTO api support [pinot]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #11954:
URL: https://github.com/apache/pinot/issues/11954#issuecomment-5299398021
This issue has been automatically marked as stale because it has not had any activity in the last 150 days. It will be closed in 30 days if no further activity occurs. If this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] INSERT INTO api support [pinot]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #11954: INSERT INTO api support
URL: https://github.com/apache/pinot/issues/11954
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org