You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tajo.apache.org by "Hyunsik Choi (JIRA)" <ji...@apache.org> on 2014/02/08 05:29:19 UTC
[jira] [Comment Edited] (TAJO-559) CTAS with partition causes OOM
[ https://issues.apache.org/jira/browse/TAJO-559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13895428#comment-13895428 ]
Hyunsik Choi edited comment on TAJO-559 at 2/8/14 4:27 AM:
-----------------------------------------------------------
It was fixed by TAJO-574.
was (Author: hyunsik):
It was fixed by TAJO-584.
> CTAS with partition causes OOM
> ------------------------------
>
> Key: TAJO-559
> URL: https://issues.apache.org/jira/browse/TAJO-559
> Project: Tajo
> Issue Type: Bug
> Components: operator/expression, planner/optimizer
> Reporter: Hyunsik Choi
> Assignee: Hyunsik Choi
> Fix For: 0.8-incubating
>
>
> CREATE TABLE AS SELECT with PARTITION BY causes OOM.
> {code}
> 2014-01-28 10:28:34,827 INFO worker.TaskAttemptContext (TaskAttemptContext.java:setState(106)) - Query status of ta_1390814036442_0004_000002_000004_00 is changed to TA_SUCCEEDED
> 2014-01-28 10:28:34,827 INFO worker.Task (Task.java:run(430)) - Task Counter - total:8, succeeded: 8, failed: 0
> 2014-01-28 10:28:34,828 INFO querymaster.SubQuery (SubQuery.java:transition(894)) - eb_1390814036442_0004_000002 SubQuery Succeeded 1/3 on local05.gruter.com:36108
> java.lang.OutOfMemoryError: unable to create new native thread
> at java.lang.Thread.start0(Native Method)
> at java.lang.Thread.start(Thread.java:693)
> at org.apache.hadoop.hdfs.DFSOutputStream.start(DFSOutputStream.java:1814)
> at org.apache.hadoop.hdfs.DFSOutputStream.newStreamForCreate(DFSOutputStream.java:1405)
> at org.apache.hadoop.hdfs.DFSClient.create(DFSClient.java:1382)
> at org.apache.hadoop.hdfs.DFSClient.create(DFSClient.java:1307)
> at org.apache.hadoop.hdfs.DistributedFileSystem$6.doCall(DistributedFileSystem.java:384)
> at org.apache.hadoop.hdfs.DistributedFileSystem$6.doCall(DistributedFileSystem.java:380)
> at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at org.apache.hadoop.hdfs.DistributedFileSystem.create(DistributedFileSystem.java:380)
> at org.apache.hadoop.hdfs.DistributedFileSystem.create(DistributedFileSystem.java:324)
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:905)
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:886)
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:783)2014-01-28 10:28:34,830 INFO physical.ColumnPartitionedTableStoreExec (ColumnPartitionedTableStoreExec.java:getAppender(126)) - Add subpartition path directory :hdfs://127.0.0.1:8020/tmp/tajo-hyunsik/staging/q_1390814036442_0004/RESULT/receiptdate=1995-02-04
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:772)
> at org.apache.tajo.storage.CSVFile$CSVAppender.init(CSVFile.java:124)
> at org.apache.tajo.engine.planner.physical.ColumnPartitionedTableStoreExec.getAppender(ColumnPartitionedTableStoreExec.java:137)
> at org.apache.tajo.engine.planner.physical.ColumnPartitionedTableStoreExec.next(ColumnPartitionedTableStoreExec.java:169)
> at org.apache.tajo.worker.Task.run(Task.java:370)
> at org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:392)
> at java.lang.Thread.run(Thread.java:724)
> {code}
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)