You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Gopal V (JIRA)" <ji...@apache.org> on 2016/03/09 04:09:40 UTC
[jira] [Created] (HIVE-13241) LLAP: Incremental Caching marks some
small chunks as "incomplete CB"
Gopal V created HIVE-13241:
------------------------------
Summary: LLAP: Incremental Caching marks some small chunks as "incomplete CB"
Key: HIVE-13241
URL: https://issues.apache.org/jira/browse/HIVE-13241
Project: Hive
Issue Type: Bug
Reporter: Gopal V
Run #3 of a query with 1 node still has cache misses.
{code}
LLAP IO Summary
----------------------------------------------------------------------------------------------
VERTICES ROWGROUPS META_HIT META_MISS DATA_HIT DATA_MISS ALLOCATION USED TOTAL_IO
----------------------------------------------------------------------------------------------
Map 1 11 1116 0 1.65GB 93.61MB 0B 0B 32.72s
----------------------------------------------------------------------------------------------
{code}
{code}
2016-03-08T21:05:39,417 INFO [IO-Elevator-Thread-9[attempt_1455662455106_2688_3_00_000001_0]]: encoded.EncodedReaderImpl (EncodedReaderImpl.java:prepareRangesForCompressedRead(695)) - Locking 0x1c44401d(1) due to reuse
2016-03-08T21:05:39,417 INFO [IO-Elevator-Thread-9[attempt_1455662455106_2688_3_00_000001_0]]: encoded.EncodedReaderImpl (EncodedReaderImpl.java:prepareRangesForCompressedRead(701)) - Adding an already-uncompressed buffer 0x1c44401d(2)
2016-03-08T21:05:39,417 INFO [IO-Elevator-Thread-9[attempt_1455662455106_2688_3_00_000001_0]]: encoded.EncodedReaderImpl (EncodedReaderImpl.java:prepareRangesForCompressedRead(695)) - Locking 0x4e51b032(1) due to reuse
2016-03-08T21:05:39,417 INFO [IO-Elevator-Thread-9[attempt_1455662455106_2688_3_00_000001_0]]: encoded.EncodedReaderImpl (EncodedReaderImpl.java:prepareRangesForCompressedRead(701)) - Adding an already-uncompressed buffer 0x4e51b032(2)
2016-03-08T21:05:39,418 INFO [IO-Elevator-Thread-9[attempt_1455662455106_2688_3_00_000001_0]]: encoded.EncodedReaderImpl (EncodedReaderImpl.java:addOneCompressionBuffer(1161)) - Found CB at 1373931, chunk length 86587, total 86590, compressed
2016-03-08T21:05:39,418 INFO [IO-Elevator-Thread-9[attempt_1455662455106_2688_3_00_000001_0]]: encoded.EncodedReaderImpl (EncodedReaderImpl.java:addIncompleteCompressionBuffer(1241)) - Replacing data range [1373931, 1408408), size: 34474(!) type: direct (and 0 previous chunks) with incomplete CB start: 1373931 end: 1408408 in the buffers
2016-03-08T21:05:39,418 INFO [IO-Elevator-Thread-9[attempt_1455662455106_2688_3_00_000001_0]]: encoded.EncodedReaderImpl (EncodedReaderImpl.java:createRgColumnStreamData(441)) - Getting data for column 7 RG 14 stream DATA at 1460521, 319811 index position 0: compressed [1626961, 1780332)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)