You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@doris.apache.org by GitBox <gi...@apache.org> on 2019/08/13 16:43:22 UTC

[GitHub] [incubator-doris] yuanlihan opened a new pull request #1635: Enable parsing columns from file path for Broker Load (#1582)

yuanlihan opened a new pull request #1635: Enable parsing columns from file path for Broker Load (#1582)
URL: https://github.com/apache/incubator-doris/pull/1635
 
 
   Currently, we do not support parsing encoded/compressed columns in file path, eg: extract column k1 from file path /path/to/dir/k1=1/xxx.csv
   
   This patch is able to parse columns from file path like in Spark(Partition Discovery).
   
   This patch parse partition columns at BrokerScanNode.java and save parsing result of each file path as a property of TBrokerRangeDesc, then the broker reader of BE can read the value of specified partition column.
   
   (I'm sorry to create a new pr about this issue for being not familiar with `git rebase` )

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@doris.apache.org
For additional commands, e-mail: dev-help@doris.apache.org