You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by lk_spark <lk...@163.com> on 2019/11/12 05:56:04 UTC

how to limit tasks num when read hive with orc

hi,all:
    I have a hive table STORED AS INPUTFORMAT 'org.apache.hadoop.hive.ql.io.orc.OrcInputFormat' , many files of it is very small , when I use spark to read it , thousands tasks will start , how can I limit the task num ?

2019-11-12


lk_spark