You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2020/05/05 09:48:13 UTC
[GitHub] [incubator-doris] decster opened a new issue #3468: [Memory Engine] Write pipeline external API and data format
decster opened a new issue #3468:
URL: https://github.com/apache/incubator-doris/issues/3468
This includes how a user can load/update/delete data into memory engine backed table
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] vagetablechicken commented on issue #3468: [Memory Engine] Write pipeline external API and data format
Posted by GitBox <gi...@apache.org>.
vagetablechicken commented on issue #3468:
URL: https://github.com/apache/incubator-doris/issues/3468#issuecomment-631195933
> Are all numeric values using string? Is it supported to use json number?
I've forgot to provide one such example. Ref https://github.com/apache/incubator-doris/pull/3553/files, json number is supported.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] vagetablechicken commented on issue #3468: [Memory Engine] Write pipeline external API and data format
Posted by GitBox <gi...@apache.org>.
vagetablechicken commented on issue #3468:
URL: https://github.com/apache/incubator-doris/issues/3468#issuecomment-630563767
Users can load/update/delete data by load JSON format rows, which can be converted to PartialRows. e.g. routine load from Kafka(will soon support JSON format load).
We support UPDATE, so JSON format source rows may fill different columns.
### Load case
**denotations**: key column -> kc, value column -> vc
We have a table, it has columns: kc1,kc2,vc1,vc2.
`{"kc1":"0","kc2":"0","vc1":"0"} `- kc1=0,kc2=0 is not exsited, so this row will be INSERT. "vc2" will fill with default value.
`{"kc1":"0","kc2":"0","vc2":"0"} `- inserted above. So this row will be UPDATE.
`{"kc1":"0","vc2":"0"} `- "kc2" is missing. Current policy is to fill "kc2" with default value.
`{"del_flag":"1", "kc1":"0","kc2":"0"}` - From a user perspective, del_flag column's name doesn't matter, We can support “customize the del_flag column name” when creating routine load.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] decster commented on issue #3468: [Memory Engine] Write pipeline external API and data format
Posted by GitBox <gi...@apache.org>.
decster commented on issue #3468:
URL: https://github.com/apache/incubator-doris/issues/3468#issuecomment-630802783
Are all numeric values using string? Is it supported to use json number?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org