You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@phoenix.apache.org by "Hadoop QA (Jira)" <ji...@apache.org> on 2020/10/28 04:10:00 UTC
[jira] [Commented] (PHOENIX-6207) Paged server side grouped
aggregate operations
[ https://issues.apache.org/jira/browse/PHOENIX-6207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17221945#comment-17221945 ]
Hadoop QA commented on PHOENIX-6207:
------------------------------------
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 5m 54s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m 0s{color} | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m 0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m 0s{color} | {color:green} The patch appears to include 1 new or modified test files. {color} |
|| || || || {color:brown} 4.x Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 6m 5s{color} | {color:green} 4.x passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 58s{color} | {color:green} 4.x passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m 6s{color} | {color:green} 4.x passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 41s{color} | {color:green} 4.x passed {color} |
| {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 2m 56s{color} | {color:blue} phoenix-core in 4.x has 953 extant spotbugs warnings. {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m 20s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m 53s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m 53s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} checkstyle {color} | {color:red} 1m 6s{color} | {color:red} phoenix-core: The patch generated 48 new + 1618 unchanged - 23 fixed = 1666 total (was 1641) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m 43s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} spotbugs {color} | {color:red} 3m 10s{color} | {color:red} phoenix-core generated 1 new + 953 unchanged - 0 fixed = 954 total (was 953) {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red}121m 22s{color} | {color:red} phoenix-core in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 33s{color} | {color:green} The patch does not generate ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black}151m 29s{color} | {color:black} {color} |
\\
\\
|| Reason || Tests ||
| FindBugs | module:phoenix-core |
| | Unread field:GroupedAggregateRegionObserver.java:[line 426] |
| Failed junit tests | phoenix.end2end.CostBasedDecisionIT |
| | phoenix.schema.stats.TxStatsCollectorIT |
| | phoenix.schema.stats.NonTxStatsCollectorIT |
| | phoenix.end2end.join.HashJoinNoIndexIT |
| | phoenix.schema.stats.NamespaceEnabledStatsCollectorIT |
| | phoenix.end2end.AggregateIT |
| | phoenix.end2end.SpillableGroupByIT |
| | phoenix.schema.stats.NamespaceDisabledStatsCollectorIT |
| | phoenix.end2end.join.HashJoinLocalIndexIT |
| | phoenix.end2end.join.HashJoinGlobalIndexIT |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/PreCommit-PHOENIX-Build/119/artifact/patchprocess/Dockerfile |
| JIRA Issue | PHOENIX-6207 |
| JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/13014243/PHOENIX-6207.4.x.001.patch |
| Optional Tests | dupname asflicense javac javadoc unit spotbugs hbaseanti checkstyle compile |
| uname | Linux 7879a4a8c1b6 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev/phoenix-personality.sh |
| git revision | 4.x / ac0538b |
| Default Java | Private Build-1.8.0_242-8u242-b08-0ubuntu3~16.04-b08 |
| checkstyle | https://ci-hadoop.apache.org/job/PreCommit-PHOENIX-Build/119/artifact/patchprocess/diff-checkstyle-phoenix-core.txt |
| spotbugs | https://ci-hadoop.apache.org/job/PreCommit-PHOENIX-Build/119/artifact/patchprocess/new-spotbugs-phoenix-core.html |
| unit | https://ci-hadoop.apache.org/job/PreCommit-PHOENIX-Build/119/artifact/patchprocess/patch-unit-phoenix-core.txt |
| Test Results | https://ci-hadoop.apache.org/job/PreCommit-PHOENIX-Build/119/testReport/ |
| Max. process+thread count | 6984 (vs. ulimit of 30000) |
| modules | C: phoenix-core U: phoenix-core |
| Console output | https://ci-hadoop.apache.org/job/PreCommit-PHOENIX-Build/119/console |
| versions | git=2.7.4 maven=3.3.9 spotbugs=4.1.3 |
| Powered by | Apache Yetus 0.12.0 https://yetus.apache.org |
This message was automatically generated.
> Paged server side grouped aggregate operations
> ----------------------------------------------
>
> Key: PHOENIX-6207
> URL: https://issues.apache.org/jira/browse/PHOENIX-6207
> Project: Phoenix
> Issue Type: Improvement
> Affects Versions: 5.0.0, 4.14.3
> Reporter: Kadir OZDEMIR
> Assignee: Kadir OZDEMIR
> Priority: Major
> Fix For: 4.16.0
>
> Attachments: PHOENIX-6207.4.x.001.patch
>
>
> Phoenix provides the option of performing query operations on the client or server side. This is decided by the Phoenix optimizer based on configuration parameters. For the server side option, the table operation is parallelized such that multiple table regions are scanned. However, currently there is no paging capability and the server side operation can take long enough lead to HBase client timeouts. Putting a limit on the number of rows to be processed within a single RPC call (i.e., the next operation on the scanner) on the server side using a Phoenix level paging is highly desirable. This paging mechanism has been already implemented for index rebuild and verification operations and proven to be effective to prevent timeouts. This Jira is for implementing this paging for the server side grouped aggregate operations.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)