[GitHub] [incubator-doris] wangbo edited a comment on issue #3010: Spark load etl interface

[GitBox <gi...@apache.org>]

wangbo edited a comment on issue #3010: Spark load etl interface
URL: https://github.com/apache/incubator-doris/issues/3010#issuecomment-592314531
 
 
   > I think JobConf should add the level relation(tree) of rollup indexes which can be decided better in FE.
   
   > Level relation for rollup data conversion is the strategy in ETL, if we update the strategy later, we can only update the ETL code, so i think it is better to deal with it in ETL.
   
   I think we can make a ```RollupUtil```,it read input info(table schema) and calculate the rollup relation,then we can package it into a jar which would be submitted with spark jar.
   So we can use it both in Fe and ```EtLJob```.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org