You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Khurram Faraaz (JIRA)" <ji...@apache.org> on 2015/03/10 18:48:39 UTC
[jira] [Created] (DRILL-2417) Exception seen when system parameter
is set to `store.parquet.compression` = 'snappy'
Khurram Faraaz created DRILL-2417:
-------------------------------------
Summary: Exception seen when system parameter is set to `store.parquet.compression` = 'snappy'
Key: DRILL-2417
URL: https://issues.apache.org/jira/browse/DRILL-2417
Project: Apache Drill
Issue Type: Bug
Components: Storage - Parquet
Affects Versions: 0.8.0
Environment: Administrators-MacBook-Pro-11:log kfaraaz$ uname -a
Darwin Administrators-MacBook-Pro-11.local 14.0.0 Darwin Kernel Version 14.0.0: Fri Sep 19 00:26:44 PDT 2014; root:xnu-2782.1.97~2/RELEASE_X86_64 x86_64
Reporter: Khurram Faraaz
Assignee: Steven Phillips
Attempt to, alter system set `store.parquet.compression` = 'snappy'
results in an Exception
Details of driblet version that I am working with are
0: jdbc:drill:zk=local> select * from sys.version;
+------------+----------------+-------------+-------------+------------+
| commit_id | commit_message | commit_time | build_email | build_time |
+------------+----------------+-------------+-------------+------------+
| a84f7b9e88b1827e6b4da8cdd25c6d4f12dcdadc | DRILL-2338: Fix Decimal38/Decimal28 vector's get() to copy the scale and precision into the holder | 02.03.2015 @ 14:13:27 EST | Unknown | 02.03.2015 @ 15:43:47 EST |
+------------+----------------+-------------+-------------+------------+
1 row selected (0.334 seconds)
Failing alter system set statement
0: jdbc:drill:zk=local> alter system set `store.parquet.compression`='snappy';
+------------+------------+
| ok | summary |
+------------+------------+
| true | store.parquet.compression updated. |
Query failed: RemoteRpcException: Failure while running fragment., Failure while closing accountor. Expected private and shared pools to be set to initial values. However, one or more were not. Stats are
zone init allocated delta
private 1000000 738112 261888
shared 9999000000 9999261888 -261888. [ 669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ]
[ 669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ]
java.lang.RuntimeException: java.sql.SQLException: Failure while executing query.
at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2514)
at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2148)
at sqlline.SqlLine.print(SqlLine.java:1809)
at sqlline.SqlLine$Commands.execute(SqlLine.java:3766)
at sqlline.SqlLine$Commands.sql(SqlLine.java:3663)
at sqlline.SqlLine.dispatch(SqlLine.java:889)
at sqlline.SqlLine.begin(SqlLine.java:763)
at sqlline.SqlLine.start(SqlLine.java:498)
at sqlline.SqlLine.main(SqlLine.java:460)
0: jdbc:drill:zk=local>
>From the log file
2015-03-10 10:29:05,183 [2b00d61d-b6c2-e7a4-2baa-6bb5f23f6098:frag:0:0] ERROR o.a.d.e.w.f.AbstractStatusReporter - Error 669998c2-d44f-446d-85b1-bc19b0a33003: Failure while running fragment.
java.lang.IllegalStateException: Failure while closing accountor. Expected private and shared pools to be set to initial values. However, one or more were not. Stats are
zone init allocated delta
private 1000000 738112 261888
shared 9999000000 9999261888 -261888.
at org.apache.drill.exec.memory.AtomicRemainder.close(AtomicRemainder.java:200) ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at org.apache.drill.exec.memory.Accountor.close(Accountor.java:376) ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.close(TopLevelAllocator.java:284) ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at org.apache.drill.exec.ops.OperatorContext.close(OperatorContext.java:118) ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at org.apache.drill.exec.physical.impl.ScanBatch.cleanup(ScanBatch.java:351) ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.cleanup(IteratorValidatorBatchIterator.java:148) ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.internalStop(ScreenCreator.java:178) ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:124) ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57) ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:121) ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303) [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_75]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_75]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
2015-03-10 10:29:05,183 [2b00d61d-b6c2-e7a4-2baa-6bb5f23f6098:frag:0:0] INFO o.a.drill.exec.work.foreman.Foreman - State change requested. RUNNING --> FAILED
org.apache.drill.exec.rpc.RemoteRpcException: Failure while running fragment., Failure while closing accountor. Expected private and shared pools to be set to initial values. However, one or more were not. Stats are
zone init allocated delta
private 1000000 738112 261888
shared 9999000000 9999261888 -261888. [ 669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ]
[ 669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ]
at org.apache.drill.exec.work.foreman.QueryManager.statusUpdate(QueryManager.java:95) [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at org.apache.drill.exec.work.foreman.QueryManager$RootStatusReporter.statusChange(QueryManager.java:154) [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(AbstractStatusReporter.java:114) [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(AbstractStatusReporter.java:110) [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at org.apache.drill.exec.work.fragment.FragmentExecutor.internalFail(FragmentExecutor.java:176) [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:136) [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303) [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_75]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_75]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
...
2015-03-10 10:29:05,191 [2b00d61d-b6c2-e7a4-2baa-6bb5f23f6098:frag:0:0] WARN o.a.d.e.w.fragment.FragmentExecutor - Failure while closing out resources.
java.lang.IllegalStateException: Failure while trying to close child allocator: Child level allocators not closed. Fragment 0:0. Stack trace:
org.apache.drill.exec.ops.OperatorContext.<init>(OperatorContext.java:43)
org.apache.drill.exec.physical.impl.ScanBatch.<init>(ScanBatch.java:112)
org.apache.drill.exec.store.direct.DirectBatchCreator.getBatch(DirectBatchCreator.java:35)
org.apache.drill.exec.store.direct.DirectBatchCreator.getBatch(DirectBatchCreator.java:29)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitSubScan(AbstractPhysicalVisitor.java:125)
org.apache.drill.exec.physical.base.AbstractSubScan.accept(AbstractSubScan.java:39)
org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitIteratorValidator(AbstractPhysicalVisitor.java:208)
org.apache.drill.exec.physical.config.IteratorValidator.accept(IteratorValidator.java:34)
org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:59)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitStore(AbstractPhysicalVisitor.java:130)
org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitScreen(AbstractPhysicalVisitor.java:188)
org.apache.drill.exec.physical.config.Screen.accept(Screen.java:97)
org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:87)
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:109)
org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
java.lang.Thread.run(Thread.java:745)
at org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.close(TopLevelAllocator.java:273) ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at org.apache.drill.exec.ops.FragmentContext.close(FragmentContext.java:317) ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at org.apache.drill.exec.work.fragment.FragmentExecutor.closeOutResources(FragmentExecutor.java:163) [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:142) [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303) [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_75]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_75]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)