You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Hive QA (JIRA)" <ji...@apache.org> on 2015/08/06 23:38:04 UTC

[jira] [Commented] (HIVE-11475) Bad rename of directory during commit, when using HCat dynamic-partitioning.

    [ https://issues.apache.org/jira/browse/HIVE-11475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660846#comment-14660846 ] 

Hive QA commented on HIVE-11475:
--------------------------------



{color:red}Overall{color}: -1 no tests executed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12748944/HIVE-11475.1.patch

Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4849/testReport
Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4849/console
Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4849/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Tests exited with: ExecutionException: java.util.concurrent.ExecutionException: org.apache.hive.ptest.execution.ssh.SSHExecutionException: RSyncResult [localFile=/data/hive-ptest/logs/PreCommit-HIVE-TRUNK-Build-4849/succeeded/TestJdbcWithMiniHS2, remoteFile=/home/hiveptest/54.146.159.23-hiveptest-1/logs/, getExitCode()=12, getException()=null, getUser()=hiveptest, getHost()=54.146.159.23, getInstance()=1]: 'Address 54.146.159.23 maps to ec2-54-146-159-23.compute-1.amazonaws.com, but this does not map back to the address - POSSIBLE BREAK-IN ATTEMPT!
receiving incremental file list
./
TEST-TestJdbcWithMiniHS2-TEST-org.apache.hive.jdbc.TestJdbcWithMiniHS2.xml
           0   0%    0.00kB/s    0:00:00
        5799 100%    5.53MB/s    0:00:00 (xfer#1, to-check=3/5)
hive.log
           0   0%    0.00kB/s    0:00:00
    43384832   0%   41.38MB/s    0:05:58
    90177536   0%   43.02MB/s    0:05:43
   139001856   0%   44.22MB/s    0:05:33
   187334656   1%   44.68MB/s    0:05:28
   235732992   1%   45.85MB/s    0:05:19
   283541504   1%   46.09MB/s    0:05:16
   330530816   2%   45.65MB/s    0:05:18
   376111104   2%   45.01MB/s    0:05:22
   419135488   2%   43.75MB/s    0:05:30
   457211904   3%   41.44MB/s    0:05:48
   492863488   3%   38.73MB/s    0:06:11
   528449536   3%   36.35MB/s    0:06:34
   561774592   3%   34.02MB/s    0:07:00
   599326720   3%   33.88MB/s    0:07:01
   635011072   4%   33.87MB/s    0:07:00
   671154176   4%   34.01MB/s    0:06:57
   706478080   4%   34.37MB/s    0:06:52
   742981632   4%   34.14MB/s    0:06:54
   778862592   5%   34.19MB/s    0:06:52
   814710784   5%   34.12MB/s    0:06:52
   850558976   5%   34.33MB/s    0:06:48
   886308864   5%   34.15MB/s    0:06:49
   922058752   6%   34.14MB/s    0:06:49
   956399616   6%   33.78MB/s    0:06:52
   992477184   6%   33.84MB/s    0:06:50
  1028849664   6%   34.00MB/s    0:06:47
  1039106048   6%   27.86MB/s    0:08:17
  1046544384   6%   21.45MB/s    0:10:45
  1090256896   7%   23.24MB/s    0:09:53
  1133019136   7%   24.76MB/s    0:09:15
  1176043520   7%   32.63MB/s    0:07:00
  1219526656   8%   41.20MB/s    0:05:31
  1253605376   8%   38.95MB/s    0:05:50
  1292730368   8%   38.08MB/s    0:05:57
  1336770560   8%   38.31MB/s    0:05:54
  1370324992   9%   35.94MB/s    0:06:16
  1410990080   9%   37.51MB/s    0:05:59
  1446674432   9%   36.69MB/s    0:06:06
  1482588160   9%   34.77MB/s    0:06:26
  1518272512   9%   35.23MB/s    0:06:19
  1553793024  10%   33.99MB/s    0:06:32
  1588854784  10%   33.12MB/s    0:06:42
  1627947008  10%   33.86MB/s    0:06:32
  1663664128  10%   33.94MB/s    0:06:30
  1699282944  11%   33.97MB/s    0:06:28
  1734934528  11%   34.83MB/s    0:06:18
  1770782720  11%   34.04MB/s    0:06:26
  1806499840  11%   34.02MB/s    0:06:25
  1842249728  12%   33.95MB/s    0:06:24
  1878392832  12%   34.09MB/s    0:06:22
  1914109952  12%   34.08MB/s    0:06:21
  1949532160  12%   34.03MB/s    0:06:21
  1985216512  13%   34.09MB/s    0:06:19
  2020868096  13%   33.99MB/s    0:06:19
  2045214720  13%   31.27MB/s    0:06:51
  2053996544  13%   24.89MB/s    0:08:36
  2061762560  13%   18.24MB/s    0:11:44
  2069135360  13%   11.50MB/s    0:18:37
  2076344320  13%    7.41MB/s    0:28:52
  2083258368  13%    6.97MB/s    0:30:41
  2090008576  13%    6.72MB/s    0:31:47
  2103148544  13%    8.10MB/s    0:26:22
  2138898432  14%   14.90MB/s    0:14:17
  2174484480  14%   21.74MB/s    0:09:46
  2210365440  14%   28.70MB/s    0:07:22
  2246148096  14%   34.09MB/s    0:06:11
  2281996288  14%   34.12MB/s    0:06:10
  2317713408  15%   34.15MB/s    0:06:09
  2353496064  15%   34.13MB/s    0:06:08
  2389180416  15%   34.11MB/s    0:06:07
  2424537088  15%   33.98MB/s    0:06:07
  2460418048  16%   34.01MB/s    0:06:06
  2496135168  16%   34.00MB/s    0:06:05
  2531885056  16%   33.99MB/s    0:06:04
  2567766016  16%   34.11MB/s    0:06:02
  2603581440  17%   34.12MB/s    0:06:01
  2639331328  17%   34.12MB/s    0:06:00
  2675179520  17%   34.16MB/s    0:05:58
  2710831104  17%   34.11MB/s    0:05:58
  2746679296  18%   34.11MB/s    0:05:57
  2782429184  18%   34.12MB/s    0:05:56
  2817359872  18%   33.89MB/s    0:05:57
  2852552704  18%   33.78MB/s    0:05:57
  2888925184  18%   33.91MB/s    0:05:55
  2924773376  19%   33.89MB/s    0:05:54
  2957017088  19%   33.26MB/s    0:06:00
  2992930816  19%   33.44MB/s    0:05:57
  3030810624  19%   33.79MB/s    0:05:52
  3066527744  20%   33.80MB/s    0:05:51
  3101949952  20%   34.55MB/s    0:05:42
  3137830912  20%   34.56MB/s    0:05:41
  3173449728  20%   34.02MB/s    0:05:45
  3206021120  21%   33.26MB/s    0:05:52
  3243507712  21%   33.28MB/s    0:05:51
  3279355904  21%   33.25MB/s    0:05:50
  3316318208  21%   33.57MB/s    0:05:46
  3351937024  22%   34.28MB/s    0:05:38
  3387588608  22%   34.35MB/s    0:05:36
  3423272960  22%   34.31MB/s    0:05:35
  3459055616  22%   34.01MB/s    0:05:37
  3494445056  22%   33.88MB/s    0:05:38
  3527966720  23%   33.38MB/s    0:05:42
  3565748224  23%   33.88MB/s    0:05:36
  3594780672  23%   30.99MB/s    0:06:06
  3636199424  23%   32.41MB/s    0:05:49
  3677814784  24%   34.26MB/s    0:05:29
  3713499136  24%   33.78MB/s    0:05:32
  3748986880  24%   36.77MB/s    0:05:04
  3784867840  24%   35.45MB/s    0:05:15
  3820519424  25%   34.03MB/s    0:05:27
  3856039936  25%   33.99MB/s    0:05:26
  3891560448  25%   33.99MB/s    0:05:25
  3927277568  25%   33.95MB/s    0:05:24
  3958079488  25%   32.79MB/s    0:05:35
  3994812416  26%   32.82MB/s    0:05:34
  4033413120  26%   33.54MB/s    0:05:25
  4069130240  26%   33.55MB/s    0:05:24
  4104683520  26%   34.69MB/s    0:05:13
  4140564480  27%   34.75MB/s    0:05:11
  4176117760  27%   34.02MB/s    0:05:17
  4211900416  27%   33.99MB/s    0:05:16
  4247781376  27%   34.07MB/s    0:05:14
  4283432960  28%   34.02MB/s    0:05:14
  4319084544  28%   34.05MB/s    0:05:12
  4354736128  28%   34.06MB/s    0:05:11
  4390387712  28%   34.01MB/s    0:05:11
  4426039296  29%   34.00MB/s    0:05:10
  4461002752  29%   33.84MB/s    0:05:10
  4492361728  29%   32.57MB/s    0:05:21
  4533190656  29%   33.79MB/s    0:05:08
  4567662592  30%   33.52MB/s    0:05:10
  4597579776  30%   32.34MB/s    0:05:20
  4631560192  30%   33.19MB/s    0:05:11
  4673470464  30%   33.45MB/s    0:05:08
  4709089280  30%   33.72MB/s    0:05:04
  4744773632  31%   35.09MB/s    0:04:51
  4780457984  31%   35.52MB/s    0:04:47
  4816076800  31%   34.01MB/s    0:04:58
  4851728384  31%   34.01MB/s    0:04:57
  4881809408  32%   32.67MB/s    0:05:09
  4921556992  32%   33.64MB/s    0:04:59
  4957175808  32%   33.63MB/s    0:04:58
  4992991232  32%   33.66MB/s    0:04:56
  5028675584  33%   35.00MB/s    0:04:44
  5064294400  33%   34.01MB/s    0:04:51
  5099880448  33%   34.03MB/s    0:04:50
  5135564800  33%   34.01MB/s    0:04:49
  5168332800  33%   33.31MB/s    0:04:54
  5206081536  34%   33.83MB/s    0:04:49
  5241896960  34%   33.87MB/s    0:04:47
  5277483008  34%   33.84MB/s    0:04:47
  5313298432  34%   34.56MB/s    0:04:40
  5349015552  35%   34.08MB/s    0:04:43
  5384634368  35%   34.03MB/s    0:04:42
  5420351488  35%   34.07MB/s    0:04:41
  5455839232  35%   33.99MB/s    0:04:40
  5488345088  36%   33.23MB/s    0:04:46
  5526257664  36%   33.77MB/s    0:04:40
  5562236928  36%   33.85MB/s    0:04:38
  5597921280  36%   33.88MB/s    0:04:37
  5633638400  37%   34.64MB/s    0:04:30
  5669158912  37%   34.07MB/s    0:04:33
  5704974336  37%   34.02MB/s    0:04:33
  5740363776  37%   33.97MB/s    0:04:32
  5772771328  37%   33.18MB/s    0:04:38
  5810421760  38%   33.68MB/s    0:04:32
  5846335488  38%   33.70MB/s    0:04:31
  5879529472  38%   33.18MB/s    0:04:35
  5911412736  38%   33.05MB/s    0:04:35
  5952241664  39%   33.80MB/s    0:04:27
  5987434496  39%   33.63MB/s    0:04:28
  6023413760  39%   34.30MB/s    0:04:22
  6058967040  39%   35.15MB/s    0:04:14
  6094880768  40%   34.00MB/s    0:04:22
  6129975296  40%   33.98MB/s    0:04:21
  6160318464  40%   32.63MB/s    0:04:31
  6200000512  40%   33.62MB/s    0:04:22
  6235815936  40%   33.60MB/s    0:04:21
  6271434752  41%   33.73MB/s    0:04:19
  6306660352  41%   34.89MB/s    0:04:09
  6342836224  41%   34.05MB/s    0:04:14
  6378225664  41%   33.94MB/s    0:04:14
  6408306688  42%   32.62MB/s    0:04:23
  6438748160  42%   31.49MB/s    0:04:32
  6480691200  42%   32.87MB/s    0:04:19
  6518734848  42%   33.52MB/s    0:04:13
  6553993216  43%   34.75MB/s    0:04:03
  6590955520  43%   36.31MB/s    0:03:52
  6626639872  43%   34.81MB/s    0:04:01
  6662291456  43%   34.24MB/s    0:04:04
  6697975808  43%   34.34MB/s    0:04:02
  6733627392  44%   34.02MB/s    0:04:03
  6764888064  44%   32.70MB/s    0:04:12
  6803947520  44%   33.51MB/s    0:04:05
  6841466880  44%   33.94MB/s    0:04:01
  6876495872  45%   33.79MB/s    0:04:01
  6912737280  45%   35.26MB/s    0:03:50
  6948454400  45%   34.46MB/s    0:03:54
  6983843840  45%   33.95MB/s    0:03:57
  7019757568  46%   34.17MB/s    0:03:54
  7055376384  46%   34.02MB/s    0:03:54
  7087325184  46%   33.11MB/s    0:04:00
  7126712320  46%   34.05MB/s    0:03:52
  7162363904  47%   33.98MB/s    0:03:51
  7197884416  47%   33.96MB/s    0:03:50
  7233667072  47%   34.89MB/s    0:03:43
  7269351424  47%   34.01MB/s    0:03:48
  7305003008  47%   34.02MB/s    0:03:47
  7340654592  48%   34.06MB/s    0:03:46
  7376338944  48%   34.02MB/s    0:03:45
  7411957760  48%   34.01MB/s    0:03:44
  7446167552  48%   33.66MB/s    0:03:45
  7482277888  49%   33.77MB/s    0:03:43
  7518650368  49%   33.94MB/s    0:03:41
  7554301952  49%   33.95MB/s    0:03:40
  7589953536  49%   34.29MB/s    0:03:37
  7625572352  50%   34.17MB/s    0:03:37
  7661289472  50%   34.01MB/s    0:03:37
  7696744448  50%   33.97MB/s    0:03:36
  7728431104  50%   33.02MB/s    0:03:41
  7766114304  51%   33.52MB/s    0:03:37
  7802290176  51%   33.62MB/s    0:03:35
  7837483008  51%   33.55MB/s    0:03:35
  7873101824  51%   34.49MB/s    0:03:28
  7908753408  51%   34.02MB/s    0:03:29
  7944437760  52%   33.91MB/s    0:03:29
  7979433984  52%   33.84MB/s    0:03:29
  8015839232  52%   34.03MB/s    0:03:26
  8050900992  52%   33.87MB/s    0:03:26
  8083832832  53%   33.21MB/s    0:03:30
  8121057280  53%   33.75MB/s    0:03:25
  8157429760  53%   33.75MB/s    0:03:24
  8193048576  53%   33.89MB/s    0:03:22
  8228700160  54%   34.55MB/s    0:03:17
  8264318976  54%   34.18MB/s    0:03:18
  8299937792  54%   34.00MB/s    0:03:18
  8332771328  54%   32.95MB/s    0:03:24
  8372617216  54%   33.93MB/s    0:03:17
  8408203264  55%   33.92MB/s    0:03:16
  8443920384  55%   33.94MB/s    0:03:15
  8479571968  55%   35.00MB/s    0:03:08
  8515190784  55%   34.00MB/s    0:03:12
  8550875136  56%   34.02MB/s    0:03:11
  8586526720  56%   34.01MB/s    0:03:10
  8622145536  56%   34.01MB/s    0:03:09
  8657305600  56%   33.89MB/s    0:03:09
  8693153792  57%   33.94MB/s    0:03:07
  8726511616  57%   33.38MB/s    0:03:10
  8764424192  57%   33.94MB/s    0:03:05
  8800075776  57%   34.05MB/s    0:03:04
  8835727360  58%   34.00MB/s    0:03:03
  8871444480  58%   34.55MB/s    0:02:59
  8907030528  58%   33.99MB/s    0:03:01
  8942780416  58%   34.00MB/s    0:03:00
  8978563072  58%   34.02MB/s    0:02:59
  9009332224  59%   32.87MB/s    0:03:04
  9047670784  59%   33.53MB/s    0:02:59
  9084141568  59%   33.70MB/s    0:02:57
  9119793152  59%   33.67MB/s    0:02:57
  9155543040  60%   34.86MB/s    0:02:50
  9191194624  60%   34.22MB/s    0:02:52
  9226846208  60%   34.04MB/s    0:02:52
  9262432256  60%   34.02MB/s    0:02:51
  9297920000  61%   33.95MB/s    0:02:50
  9333735424  61%   33.99MB/s    0:02:49
  9367945216  61%   33.64MB/s    0:02:50
  9404710912  61%   33.92MB/s    0:02:47
  9440395264  62%   33.98MB/s    0:02:46
  9476177920  62%   33.97MB/s    0:02:45
  9511829504  62%   34.31MB/s    0:02:42
  9547350016  62%   34.02MB/s    0:02:42
  9582739456  62%   33.95MB/s    0:02:42
  9618489344  63%   33.93MB/s    0:02:41
  9653157888  63%   33.70MB/s    0:02:41
  9689137152  63%   33.81MB/s    0:02:39
  9724493824  63%   33.29MB/s    0:02:41
  9762308096  64%   33.79MB/s    0:02:37
  9798189056  64%   34.07MB/s    0:02:35
  9833873408  64%   34.00MB/s    0:02:34
  9869459456  64%   34.55MB/s    0:02:31
  9905274880  65%   34.08MB/s    0:02:32
  9940893696  65%   34.02MB/s    0:02:31
  9970417664  65%   32.55MB/s    0:02:37
 10008952832  65%   33.27MB/s    0:02:33
 10046373888  65%   33.64MB/s    0:02:30
 10082123776  66%   33.67MB/s    0:02:29
 10117808128  66%   35.14MB/s    0:02:21
 10153394176  66%   34.43MB/s    0:02:23
 10189012992  66%   34.02MB/s    0:02:24
 10224664576  67%   34.00MB/s    0:02:23
 10259267584  67%   33.75MB/s    0:02:23
 10295607296  67%   33.93MB/s    0:02:21
 10331324416  67%   33.96MB/s    0:02:20
 10365763584  68%   33.67MB/s    0:02:20
 10402430976  68%   34.15MB/s    0:02:17
 10438246400  68%   33.98MB/s    0:02:17
 10474127360  68%   34.02MB/s    0:02:16
 10509778944  69%   34.31MB/s    0:02:14
 10545430528  69%   34.05MB/s    0:02:14
 10581049344  69%   34.05MB/s    0:02:13
 10616766464  69%   34.01MB/s    0:02:12
 10648289280  69%   33.02MB/s    0:02:15
 10683056128  70%   32.81MB/s    0:02:15
 10721230848  70%   33.43MB/s    0:02:11
 10756816896  70%   33.40MB/s    0:02:10
 10792468480  70%   34.39MB/s    0:02:05
 10827956224  71%   34.56MB/s    0:02:04
 10863771648  71%   33.96MB/s    0:02:05
 10896474112  71%   33.27MB/s    0:02:07
 10933960704  71%   33.72MB/s    0:02:04
 10969219072  72%   33.65MB/s    0:02:03
 11004739584  72%   33.62MB/s    0:02:02
 11040653312  72%   34.38MB/s    0:01:58
 11076206592  72%   33.91MB/s    0:01:59
 11111956480  72%   34.03MB/s    0:01:58
 11146854400  73%   33.88MB/s    0:01:57
 11178606592  73%   32.88MB/s    0:02:00
 11216879616  73%   33.52MB/s    0:01:56
 11247419392  73%   32.30MB/s    0:02:00
 11287265280  74%   33.48MB/s    0:01:54
 11322425344  74%   34.30MB/s    0:01:51
 11358437376  74%   33.77MB/s    0:01:51
 11394121728  74%   34.99MB/s    0:01:46
 11429740544  75%   33.99MB/s    0:01:49
 11462115328  75%   33.32MB/s    0:01:50
 11499798528  75%   33.72MB/s    0:01:47
 11535417344  75%   33.70MB/s    0:01:46
 11571134464  75%   33.73MB/s    0:01:45
 11606786048  76%   34.51MB/s    0:01:42
 11642404864  76%   34.00MB/s    0:01:42
 11678121984  76%   34.02MB/s    0:01:41
 11709415424  76%   32.97MB/s    0:01:44
 11748048896  77%   33.68MB/s    0:01:40
 11781013504  77%   33.06MB/s    0:01:41
 11817975808  77%   33.35MB/s    0:01:39
 11853594624  77%   34.38MB/s    0:01:35
 11889278976  78%   33.68MB/s    0:01:36
 11924963328  78%   34.33MB/s    0:01:33
 11958943744  78%   33.63MB/s    0:01:34
 11996168192  78%   34.01MB/s    0:01:32
 12029493248  79%   33.43MB/s    0:01:33
 12061638656  79%   32.59MB/s    0:01:34
 12097290240  79%   32.96MB/s    0:01:32
 12135956480  79%   33.28MB/s    0:01:30
 12171739136  79%   33.88MB/s    0:01:28
 12207456256  80%   34.70MB/s    0:01:24
 12243140608  80%   34.74MB/s    0:01:23
 12278726656  80%   34.03MB/s    0:01:24
 12301238272  80%   30.84MB/s    0:01:32
 12333088768  81%   29.72MB/s    0:01:35
 12368936960  81%   29.77MB/s    0:01:33
 12413403136  81%   31.86MB/s    0:01:26
 12454035456  81%   36.19MB/s    0:01:14
 12489752576  82%   37.35MB/s    0:01:11
 12525436928  82%   37.30MB/s    0:01:10
 12561154048  82%   35.22MB/s    0:01:13
 12596772864  82%   34.00MB/s    0:01:15
 12631867392  82%   33.87MB/s    0:01:14
 12663390208  83%   32.86MB/s    0:01:16
 12702711808  83%   33.69MB/s    0:01:13
 12738363392  83%   33.72MB/s    0:01:12
 12774014976  83%   33.85MB/s    0:01:10
 12809699328  84%   34.87MB/s    0:01:07
 12845383680  84%   34.02MB/s    0:01:08
 12881035264  84%   34.03MB/s    0:01:07
 12915834880  84%   33.83MB/s    0:01:06
 12952272896  85%   34.01MB/s    0:01:05
 12987564032  85%   33.92MB/s    0:01:04
 13023576064  85%   33.98MB/s    0:01:03
 13059293184  85%   34.21MB/s    0:01:01
 13094879232  86%   34.01MB/s    0:01:01
 13130596352  86%   34.10MB/s    0:00:59
 13166346240  86%   34.04MB/s    0:00:59
 13201866752  86%   33.99MB/s    0:00:58
 13237649408  86%   34.03MB/s    0:00:57
 13273202688  87%   34.00MB/s    0:00:56
 13302530048  87%   32.45MB/s    0:00:57
 13333921792  87%   31.47MB/s    0:00:58
 13377110016  87%   33.24MB/s    0:00:54
 13413023744  88%   33.34MB/s    0:00:53
 13448806400  88%   34.88MB/s    0:00:49
 13484523520  88%   35.91MB/s    0:00:47
 13519486976  88%   33.95MB/s    0:00:49
 13544718336  88%   31.39MB/s    0:00:52
 13575651328  89%   29.50MB/s    0:00:54
 13604585472  89%   27.91MB/s    0:00:56
 13629325312  89%   25.54MB/s    0:01:01
 13672153088  89%   29.63MB/s    0:00:51
 13715931136  90%   33.41MB/s    0:00:44
 13759610880  90%   36.94MB/s    0:00:38
 13799751680  90%   40.59MB/s    0:00:34
 13833863168  90%   37.95MB/s    0:00:35
 13865680896  91%   35.16MB/s    0:00:37
 13895204864  91%   31.36MB/s    0:00:41
 13923319808  91%   28.59MB/s    0:00:44
 13945077760  91%   26.12MB/s    0:00:47
 13965721600  91%   23.00MB/s    0:00:53
 14007336960  92%   26.17MB/s    0:00:45
 14049345536  92%   29.41MB/s    0:00:39
 14092304384  92%   34.36MB/s    0:00:32
 14134837248  92%   40.32MB/s    0:00:26
 14182088704  93%   41.62MB/s    0:00:24
 14191689728  93%   33.84MB/s    0:00:29
 14207877120  93%   27.47MB/s    0:00:36
 14235140096  93%   23.83MB/s    0:00:40
 14242807808  93%   14.34MB/s    0:01:06
 14261878784  93%   16.60MB/s    0:00:56
 14304870400  93%   22.94MB/s    0:00:39
 14347829248  94%   26.68MB/s    0:00:32
 14391869440  94%   35.55MB/s    0:00:22
 14432993280  94%   40.81MB/s    0:00:18
 14466121728  95%   38.47MB/s    0:00:19
 14477131776  95%   30.83MB/s    0:00:23
 14487158784  95%   22.71MB/s    0:00:31
 14499971072  95%   15.69MB/s    0:00:45
 14517796864  95%   12.03MB/s    0:00:57
 14560460800  95%   19.41MB/s    0:00:33
 14602141696  95%   26.78MB/s    0:00:22
 14643953664  96%   34.11MB/s    0:00:16
 14686945280  96%   40.32MB/s    0:00:13
 14730395648  96%   40.47MB/s    0:00:11
 14736687104  96%   30.33MB/s    0:00:15
 14764376064  96%   27.14MB/s    0:00:16
 14774173696  97%   19.34MB/s    0:00:22
rsync: write failed on "/data/hive-ptest/logs/PreCommit-HIVE-TRUNK-Build-4849/succeeded/TestJdbcWithMiniHS2/hive.log": No space left on device (28)
rsync error: error in file IO (code 11) at receiver.c(301) [receiver=3.0.6]
rsync: connection unexpectedly closed (198 bytes received so far) [generator]
rsync error: error in rsync protocol data stream (code 12) at io.c(600) [generator=3.0.6]
Address 54.146.159.23 maps to ec2-54-146-159-23.compute-1.amazonaws.com, but this does not map back to the address - POSSIBLE BREAK-IN ATTEMPT!
receiving incremental file list
./
hive.log
           0   0%    0.00kB/s    0:00:00
rsync: write failed on "/data/hive-ptest/logs/PreCommit-HIVE-TRUNK-Build-4849/succeeded/TestJdbcWithMiniHS2/hive.log": No space left on device (28)
rsync error: error in file IO (code 11) at receiver.c(301) [receiver=3.0.6]
rsync: connection unexpectedly closed (198 bytes received so far) [generator]
rsync error: error in rsync protocol data stream (code 12) at io.c(600) [generator=3.0.6]
Address 54.146.159.23 maps to ec2-54-146-159-23.compute-1.amazonaws.com, but this does not map back to the address - POSSIBLE BREAK-IN ATTEMPT!
receiving incremental file list
./
hive.log
           0   0%    0.00kB/s    0:00:00
rsync: write failed on "/data/hive-ptest/logs/PreCommit-HIVE-TRUNK-Build-4849/succeeded/TestJdbcWithMiniHS2/hive.log": No space left on device (28)
rsync error: error in file IO (code 11) at receiver.c(301) [receiver=3.0.6]
rsync: connection unexpectedly closed (198 bytes received so far) [generator]
rsync error: error in rsync protocol data stream (code 12) at io.c(600) [generator=3.0.6]
Address 54.146.159.23 maps to ec2-54-146-159-23.compute-1.amazonaws.com, but this does not map back to the address - POSSIBLE BREAK-IN ATTEMPT!
receiving incremental file list
./
hive.log
           0   0%    0.00kB/s    0:00:00
rsync: write failed on "/data/hive-ptest/logs/PreCommit-HIVE-TRUNK-Build-4849/succeeded/TestJdbcWithMiniHS2/hive.log": No space left on device (28)
rsync error: error in file IO (code 11) at receiver.c(301) [receiver=3.0.6]
rsync: connection unexpectedly closed (198 bytes received so far) [generator]
rsync error: error in rsync protocol data stream (code 12) at io.c(600) [generator=3.0.6]
Address 54.146.159.23 maps to ec2-54-146-159-23.compute-1.amazonaws.com, but this does not map back to the address - POSSIBLE BREAK-IN ATTEMPT!
receiving incremental file list
./
hive.log
           0   0%    0.00kB/s    0:00:00
rsync: write failed on "/data/hive-ptest/logs/PreCommit-HIVE-TRUNK-Build-4849/succeeded/TestJdbcWithMiniHS2/hive.log": No space left on device (28)
rsync error: error in file IO (code 11) at receiver.c(301) [receiver=3.0.6]
rsync: connection unexpectedly closed (198 bytes received so far) [generator]
rsync error: error in rsync protocol data stream (code 12) at io.c(600) [generator=3.0.6]
'
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12748944 - PreCommit-HIVE-TRUNK-Build

> Bad rename of directory during commit, when using HCat dynamic-partitioning.
> ----------------------------------------------------------------------------
>
>                 Key: HIVE-11475
>                 URL: https://issues.apache.org/jira/browse/HIVE-11475
>             Project: Hive
>          Issue Type: Bug
>          Components: HCatalog
>    Affects Versions: 1.2.0
>            Reporter: Mithun Radhakrishnan
>            Assignee: Mithun Radhakrishnan
>            Priority: Critical
>         Attachments: HIVE-11475.1.patch
>
>
> Here's one that [~knoguchi] found and root-caused. This one's a doozy. 
> Under seemingly random conditions, the temporary output (under {{_SCRATCH1.234*}}) for HCat's dynamic partitioner isn't promoted correctly to the final table directory.
> The namenode logs indicated a botched directory-rename:
> {noformat}
> 2015-08-02 03:24:29,090 INFO FSNamesystem.audit: allowed=true ugi=myth (auth:TOKEN) via wrkflow@GRID.MYTH.NET (auth:TOKEN) ip=/10.192.100.117 cmd=rename src=/projects/hive/myth.db/myth_table_15m/_SCRATCH2.8772158158263395E-4/tc=1/utc_time=201508020145/part-r-00000 dst=/projects/hive/myth.db/myth_table_15mE-4/tc=1/utc_time=201508020145/part-r-00000 perm=myth:madcaps:rw-r-r- proto=rpc
> {noformat}
> Note that the table-directory name {{"myth_table_15m"}} is appended with {{"E-4"}}. This'll break anything that uses HDFS-based polling.
> [~knoguchi] points out the following code:
> {code:title=HCatOutputFormat.java}
> 119   if ((idHash = conf.get(HCatConstants.HCAT_OUTPUT_ID_HASH)) == null) {
> 120         idHash = String.valueOf(Math.random());
> 121   }
> {code}
> {code:title=FileOutputCommitterContainer.java}
> 370       String finalLocn = jobLocation.replaceAll(Path.SEPARATOR + SCRATCH_DIR_NAME + "\\d\\.?\\d+","");
> {code}
> The problem is that when {{Math.random()}} produces a number <= 10 ^-3^, {{String.valueOf(double)}} uses exponential notation. The regex doesn't capture or handle this notation.
> The fix belies the debugging-effort.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)