You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2020/02/07 07:44:43 UTC

[GitHub] [incubator-doris] kangpinghuang opened a new issue #2855: [Proposal] support spark load

kangpinghuang opened a new issue #2855: [Proposal] support spark load
URL: https://github.com/apache/incubator-doris/issues/2855
 
 
   For many users who want to load data into doris for the first time, they have large amount of data, about 20G+,it is hard to support to load so large data into doris at one time. To resolve this problem, I proposal a new solution to load data by using spark cluster. Here is my design. please review it and give me some comments.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [incubator-doris] kangpinghuang commented on issue #2855: [Proposal] support spark load

Posted by GitBox <gi...@apache.org>.
kangpinghuang commented on issue #2855: [Proposal] support spark load
URL: https://github.com/apache/incubator-doris/issues/2855#issuecomment-583273169
 
 
   
   [spark_load.pdf](https://github.com/apache/incubator-doris/files/4169541/spark_load.pdf)
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [incubator-doris] kangpinghuang commented on issue #2855: [Proposal] support spark load

Posted by GitBox <gi...@apache.org>.
kangpinghuang commented on issue #2855: [Proposal] support spark load
URL: https://github.com/apache/incubator-doris/issues/2855#issuecomment-583285587
 
 
   ok, I will propose a pr

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


[GitHub] [incubator-doris] imay commented on issue #2855: [Proposal] support spark load

Posted by GitBox <gi...@apache.org>.
imay commented on issue #2855: [Proposal] support spark load
URL: https://github.com/apache/incubator-doris/issues/2855#issuecomment-583279169
 
 
   @kangpinghuang 
   Could you please give a PR for this design? Then others can make comment for this proposal.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org