[Impala-ASF-CR] IMPALA-4135: Thrift threaded server times-out connections during high load

["Thomas Tauber-Marshall (Code Review)" <ge...@cloudera.org>]

Thomas Tauber-Marshall has posted comments on this change.

Change subject: IMPALA-4135: Thrift threaded server times-out connections during high load
......................................................................


Patch Set 5:

The patch passed an exhaustive run on Jenkins:
http://sandbox.jenkins.cloudera.com/job/impala-umbrella-build-and-test/4911/

I have also now, with Mostafa's help, come up with a query that reliably reproduces the issue on the 16 node cluster and succeeds on the 16 node with this patch deployed:

 select /* +straight_join */ count(*) from
 tpch_300_parquet.orders A join /* +shuffle */  tpch_300_parquet.orders B on A.o_orderkey = B.o_orderkey 
 join /* +shuffle */   tpch_300_parquet.orders C on c.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders D on d.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders E on e.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders F on f.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders G on g.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders H on h.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders I on i.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders J on j.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders K on k.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders L on l.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders M on m.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders N on n.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders O on o.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders P on p.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders Q on q.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders R on r.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders S on s.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders T on t.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders U on u.o_orderkey = B.o_orderkey
 join /* +shuffle */   tpch_300_parquet.orders V on v.o_orderkey = B.o_orderkey
 where a.o_orderkey < 100000;

Currently working on testing it with Kerberos on.

-- 
To view, visit http://gerrit.cloudera.org:8080/4519
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ie50e728974ef31a9d49132a0b3f7cde2a4f3356d
Gerrit-PatchSet: 5
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-Owner: Thomas Tauber-Marshall <tm...@cloudera.com>
Gerrit-Reviewer: Henry Robinson <he...@cloudera.com>
Gerrit-Reviewer: Juan Yu <jy...@cloudera.com>
Gerrit-Reviewer: Matthew Jacobs <mj...@cloudera.com>
Gerrit-Reviewer: Sailesh Mukil <sa...@cloudera.com>
Gerrit-Reviewer: Thomas Tauber-Marshall <tm...@cloudera.com>
Gerrit-HasComments: No