You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@impala.apache.org by "Sailesh Mukil (Code Review)" <ge...@cloudera.org> on 2018/05/21 21:56:39 UTC

[Impala-ASF-CR] IMPALA-6813: Hedged reads metrics broken when scanning non-HDFS based table

Sailesh Mukil has posted comments on this change. ( http://gerrit.cloudera.org:8080/9966 )

Change subject: IMPALA-6813: Hedged reads metrics broken when scanning non-HDFS based table
......................................................................


Patch Set 1:

> > Patch Set 1:
 > >
 > > > Patch Set 1:
 > > >
 > > > I haven't added a custom cluster test for this since hedged
 > reads are not deterministic, and we'd be dealing with a bunch of
 > flakiness.
 > >
 > > I'm uncomfortable that we've got a flag with no testing of the
 > code path behind it.
 > >
 > > Can you force a hedged read by "kill -STOP"'ing a datanode before
 > the query and "kill -CONT" afterwards?
 > 
 > Thanks for the suggestion, Phil. I will try this.

I picked this up again and spent some time trying to force hedged reads. However, I found that even if you SIGSTOP any combination of DataNodes while leaving only one running, and then run a query against HDFS, since all the DataNodes are on the same node in a minicluster, it doesn't count them as hedged reads.

This means that we can only have a hedged read test in a remote cluster setting.


-- 
To view, visit http://gerrit.cloudera.org:8080/9966
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I48fe80dfd9a1ed68a8f2b7038e5f42b5a3df3baa
Gerrit-Change-Number: 9966
Gerrit-PatchSet: 1
Gerrit-Owner: Sailesh Mukil <sa...@cloudera.com>
Gerrit-Reviewer: Philip Zeyliger <ph...@cloudera.com>
Gerrit-Reviewer: Sailesh Mukil <sa...@cloudera.com>
Gerrit-Comment-Date: Mon, 21 May 2018 21:56:39 +0000
Gerrit-HasComments: No