[GitHub] [carbondata] BestP2P opened a new issue #4146: Multi hosts write to one hdfs file?

[GitBox <gi...@apache.org>]

BestP2P opened a new issue #4146:
URL: https://github.com/apache/carbondata/issues/4146


   if I use hdfs system, and the using sdk program running on multi hosts,  how can i let them write to one hdfs file?
   thank you


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [carbondata] QiangCai commented on issue #4146: Multi hosts write to one hdfs file?

[GitBox <gi...@apache.org>]

QiangCai commented on issue #4146:
URL: https://github.com/apache/carbondata/issues/4146#issuecomment-869277674


   I suggest using SDK to write data into the stage area and using insert into the stage to add it to the table. 
   
   https://github.com/apache/carbondata/blob/master/docs/flink-integration-guide.md
   
   Another way is using add segment function to support multiple formats in a table, but it has many limitations.
   
   https://github.com/apache/carbondata/blob/8740016917168777f1514ef4de0615f83b13c6d3/docs/addsegment-guide.md


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@carbondata.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org