[jira] [Created] (HIVE-19623) Inconsistency with Hive Logging DRFA

["seshukumar (JIRA)" <ji...@apache.org>]

seshukumar created HIVE-19623:
---------------------------------

             Summary: Inconsistency with Hive Logging DRFA
                 Key: HIVE-19623
                 URL: https://issues.apache.org/jira/browse/HIVE-19623
             Project: Hive
          Issue Type: Bug
    Affects Versions: 1.2.1
            Reporter: seshukumar


We have Hive job with set of Hive queries like truncate, insert statement, which is scheduled as daily job via azkaban. IN order to debug and analyse any issues we rely on hive logging.

In Hive, we have set up DRFA logging, with configuration something like this
hive.log.threshold=ALL
hive.root.logger=DEBUG,DRFA
hive.log.dir=<redacted>
hive.log.file=hive.loglog4j.rootLogger=${hive.root.logger}, EventCounter
log4j.appender.DRFA=org.apache.log4j.DailyRollingFileAppender
log4j.appender.DRFA.File=${hive.log.dir}/${hive.log.file}

We have noticed two issues with hive logging.
1) On certain days, there are more than one file into which logging is being done. Once the log rolls over to a new file, some entries are being written into old log file also.
2) Log entries for many days are missing. On certain days, even when the job executes correctly, there are no log entries in the hive-log file. On other days, the entries are present.

The hive version is 1.2.1. And the log4j jar is log4j-1.2.16.jar
Due to the above we are not able to debug any issues in a consistant manner. 
If this a known issue? please provide any workaround or resolution for this.

thanks
seshu



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)