You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Yang <te...@gmail.com> on 2014/08/11 08:29:39 UTC
HIVE not creating _SUCCESS ?
I'm very surprised to find that HIVE actually does not create a _SUCCESS in
its output file dir..
I had thought that since every MR job by default creates a _SUCCESS, and
HIVE is compiled into MR anyway, HIVE kind of naturally behaves the same as
any MR program. I verified that the wc example and streaming job both
create _SUCCESS.
I checked hadoop and hive code, seems that they use a
param mapreduce.fileoutputcommitter.marksuccessfuljobs to control the file
creation, by default it's true. we never mess with this param anywhere, and
actually see it set to true on job tracker.
so, why is HIVE not creating _SUCCESS file?
thanks