You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@impala.apache.org by "Tim Armstrong (Code Review)" <ge...@cloudera.org> on 2016/05/12 18:03:41 UTC
[Impala-CR](cdh5-trunk) WIP only: port backend exec to use buffer pool
Tim Armstrong has uploaded a new change for review.
http://gerrit.cloudera.org:8080/3047
Change subject: WIP only: port backend exec to use buffer pool
......................................................................
WIP only: port backend exec to use buffer pool
Convert BufferedTupleStream and HashTable to use the new BufferPool.
Update the exec nodes that depend on BufferedTupleStream and HashTable
to use BufferPool instead of BufferedBlockMgr.
Update HashTable to use a Suballocator.
Update TestEnv to support creating BufferPool with parameters. This
required some refactoring of the interface.
TODO:
* Spilling support
* Testing and validation
* Performance
* Improve spilling algorithms to make better use of reservations
* Integrate with MemTrackers.
Change-Id: I7fc7fe1c04e9dfb1a0c749fb56a5e0f2bf9c6c3e
---
M be/src/exec/analytic-eval-node.cc
M be/src/exec/analytic-eval-node.h
M be/src/exec/hash-table-test.cc
M be/src/exec/hash-table.cc
M be/src/exec/hash-table.h
M be/src/exec/kudu-scan-node-test.cc
M be/src/exec/kudu-table-sink-test.cc
M be/src/exec/partitioned-aggregation-node.cc
M be/src/exec/partitioned-aggregation-node.h
M be/src/exec/partitioned-hash-join-node.cc
M be/src/exec/partitioned-hash-join-node.h
M be/src/runtime/buffered-block-mgr-test.cc
M be/src/runtime/buffered-tuple-stream-test.cc
M be/src/runtime/buffered-tuple-stream.cc
M be/src/runtime/buffered-tuple-stream.h
M be/src/runtime/buffered-tuple-stream.inline.h
M be/src/runtime/data-stream-test.cc
M be/src/runtime/exec-env.cc
M be/src/runtime/exec-env.h
M be/src/runtime/plan-fragment-executor.cc
M be/src/runtime/runtime-state.cc
M be/src/runtime/runtime-state.h
M be/src/runtime/test-env.cc
M be/src/runtime/test-env.h
M be/src/service/fe-support.cc
25 files changed, 886 insertions(+), 930 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala refs/changes/47/3047/1
--
To view, visit http://gerrit.cloudera.org:8080/3047
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: I7fc7fe1c04e9dfb1a0c749fb56a5e0f2bf9c6c3e
Gerrit-PatchSet: 1
Gerrit-Project: Impala
Gerrit-Branch: cdh5-trunk
Gerrit-Owner: Tim Armstrong <ta...@cloudera.com>