[jira] [Created] (HIVE-16360) Improve "No delta files or original files found to compact in" message

["Eugene Koifman (JIRA)" <ji...@apache.org>]

Eugene Koifman created HIVE-16360:
-------------------------------------

             Summary: Improve "No delta files or original files found to compact in" message
                 Key: HIVE-16360
                 URL: https://issues.apache.org/jira/browse/HIVE-16360
             Project: Hive
          Issue Type: Improvement
          Components: Transactions
    Affects Versions: 1.2.0
            Reporter: Eugene Koifman


CompactorMR.run() produces
{noformat}
LOG.error("No delta files or original files found to compact in " + sd.getLocation() + " for compactionId=" + ci.id);
      {noformat}

in some cases even where there are plenty of delta directories in the partition.
The reason is that compactor won't compact anything above the level of an open transaction.  So if there is a very long running txn, it may filter out all deltas in a partition.  This looks very confusing when looking at the logs.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)