[jira] [Commented] (PHOENIX-1598) Encode column names to save space and improve performance

["Hudson (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PHOENIX-1598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15885511#comment-15885511 ] 

Hudson commented on PHOENIX-1598:
---------------------------------

FAILURE: Integrated in Jenkins build Phoenix-master #1564 (See [https://builds.apache.org/job/Phoenix-master/1564/])
PHOENIX-1598 Encode column names to save space and improve performance (samarth: rev 3c7ff99bfb958774c3e2ba5d3714ccfc46bd2367)
* (edit) phoenix-core/src/main/java/org/apache/phoenix/expression/util/regex/JONIPattern.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/coprocessor/MetaDataEndpointImpl.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/util/SchemaUtil.java
* (add) phoenix-core/src/it/java/org/apache/phoenix/tx/ParameterizedTransactionIT.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/execute/LiteralResultIteratorPlanTest.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/ClientTimeArithmeticQueryIT.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/CaseStatementIT.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/index/IndexIT.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/DerivedTableIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/filter/ColumnProjectionFilter.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/expression/ProjectedColumnExpression.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/salted/SaltedTableIT.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/query/BaseTest.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/filter/MultiKeyValueComparisonFilter.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/execute/UnnestArrayPlanTest.java
* (add) phoenix-core/src/main/java/org/apache/phoenix/schema/tuple/EncodedColumnQualiferCellsList.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/expression/ArrayConstructorExpression.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/coprocessor/ScanRegionObserver.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/compile/CreateTableCompiler.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/index/PhoenixTransactionalIndexer.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/DateTimeIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/compile/TraceQueryPlan.java
* (add) phoenix-core/src/main/java/org/apache/phoenix/filter/EncodedQualifiersColumnProjectionFilter.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/coprocessor/MetaDataRegionObserver.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/query/BaseConnectionlessQueryTest.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/ColumnRef.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/compile/SelectStatementRewriterTest.java
* (add) phoenix-core/src/main/java/org/apache/phoenix/schema/ColumnValueEncoder.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/execute/SortMergeJoinPlan.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/tuple/MultiKeyValueTuple.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/PointInTimeQueryIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/expression/visitor/CloneExpressionVisitor.java
* (add) phoenix-core/src/it/java/org/apache/phoenix/end2end/MutableQueryIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/iterate/LookAheadResultIterator.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/expression/ExpressionType.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/compile/HavingCompilerTest.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/util/PhoenixRuntimeTest.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/index/MutableIndexIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/index/IndexMetaDataCacheFactory.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/DynamicColumnIT.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/RowValueConstructorIT.java
* (add) phoenix-core/src/main/java/org/apache/phoenix/schema/tuple/PositionBasedResultTuple.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/BaseJoinIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/util/PhoenixRuntime.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/MetaDataClient.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/execute/CorrelatePlanTest.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/compile/PostDDLCompiler.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/QueryDatabaseMetaDataIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/compile/DeleteCompiler.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/ScanQueryIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/mapreduce/index/PhoenixIndexPartialBuildMapper.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/hbase/index/ValueGetter.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/compile/ExpressionCompiler.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/index/IndexMetaDataCacheClient.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/coprocessor/ServerCachingEndpointImpl.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/compile/ListJarsQueryPlan.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/query/QueryServices.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/tx/TxCheckpointIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/ProjectedColumn.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/ReadIsolationLevelIT.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/VariableLengthPKIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/compile/ProjectionCompiler.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/DelegateColumn.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/compile/JoinCompiler.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/UpsertValuesIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/util/MetaDataUtil.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/util/ScanUtil.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/index/PhoenixIndexCodec.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/tuple/DelegateTuple.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/CastAndCoerceIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/execute/BaseQueryPlan.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/coprocessor/ServerCachingProtocol.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/execute/MutationState.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/PColumnFamily.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/expression/function/ArrayElemRefExpression.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/iterate/BaseResultIterators.java
* (add) phoenix-core/src/main/java/org/apache/phoenix/schema/types/PArrayDataTypeEncoder.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/expression/function/ArrayIndexFunction.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/tuple/BaseTuple.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/compile/TupleProjectionCompiler.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/compile/WhereCompilerTest.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/query/QueryServicesOptions.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/expression/LiteralExpression.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/compile/FromCompiler.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/query/ConnectionQueryServicesImpl.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/compile/QueryOptimizerTest.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/expression/ColumnExpressionTest.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/filter/SingleCQKeyValueComparisonFilter.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/expression/visitor/StatelessTraverseAllExpressionVisitor.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/coprocessor/MetaDataProtocol.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/execute/UnnestArrayPlan.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/PTable.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/index/IndexMaintainer.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/expression/ArrayConstructorExpressionTest.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/AlterMultiTenantTableWithViewsIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/exception/SQLExceptionCode.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/FunkyNamesIT.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/index/ImmutableIndexIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/mapreduce/FormatToBytesWritableMapper.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/StatsCollectorIT.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/schema/types/PDataTypeForArraysTest.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/hbase/index/util/KeyValueBuilder.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/coprocessor/BaseScannerRegionObserver.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/GroupByIT.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/AlterTableWithViewsIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/cache/TenantCacheImpl.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/index/IndexTestUtil.java
* (edit) phoenix-protocol/src/main/ServerCachingService.proto
* (edit) phoenix-core/src/main/java/org/apache/phoenix/iterate/RegionScannerResultIterator.java
* (add) phoenix-core/src/test/java/org/apache/phoenix/util/QualifierEncodingSchemeTest.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/expression/visitor/BaseExpressionVisitor.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/SaltingUtil.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/NativeHBaseTypesIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/index/PhoenixIndexFailurePolicy.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/compile/WhereCompiler.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/index/IndexExpressionIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/coprocessor/generated/ServerCachingProtos.java
* (add) phoenix-core/src/main/java/org/apache/phoenix/expression/SingleCellConstructorExpression.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/execute/TupleProjector.java
* (add) phoenix-core/src/main/java/org/apache/phoenix/schema/tuple/PositionBasedMultiKeyValueTuple.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/tx/TransactionIT.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/compile/QueryCompilerTest.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/jdbc/PhoenixDatabaseMetaData.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/AlterTableIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/mapreduce/FormatToKeyValueReducer.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/cache/ServerCacheClient.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/filter/SingleKeyValueComparisonFilter.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/util/ResultUtil.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/NotQueryIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/coprocessor/GroupedAggregateRegionObserver.java
* (edit) pom.xml
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/TableProperty.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/query/ConnectionlessQueryServicesImpl.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/OrderByIT.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/StoreNullsIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/tuple/Tuple.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/join/HashCacheFactory.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/DistinctCountIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/PTableKey.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/cache/TenantCacheTest.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/ProductMetricsIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/PColumnFamilyImpl.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/CreateTableIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/util/KeyValueUtil.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/execute/MutationStateTest.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/index/PhoenixIndexBuilder.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/DefaultColumnValueIT.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/SysTableNamespaceMappedStatsCollectorIT.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/query/ConnectionlessTest.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/index/PhoenixIndexMetaData.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/expression/visitor/StatelessTraverseNoExpressionVisitor.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/ArrayIT.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/AggregateQueryIT.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/UserDefinedFunctionsIT.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/PhoenixRuntimeIT.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/CountDistinctCompressionIT.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/util/TestUtil.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/PColumn.java
* (add) phoenix-core/src/main/java/org/apache/phoenix/schema/types/PArrayDataTypeDecoder.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/PMetaDataImpl.java
* (add) phoenix-core/src/main/java/org/apache/phoenix/schema/ColumnValueDecoder.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/expression/KeyValueColumnExpression.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/PColumnImpl.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/coprocessor/generated/PTableProtos.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/PTableImpl.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/compile/UpsertCompiler.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/TopNIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/types/PArrayDataType.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/cache/TenantCache.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/BaseQueryIT.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/UpsertSelectIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/iterate/MappedByteBufferQueue.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/query/QueryConstants.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/index/DropMetadataIT.java
* (delete) phoenix-core/src/it/java/org/apache/phoenix/end2end/ImmutableTablePropIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/compile/UnionCompiler.java
* (add) phoenix-core/src/main/java/org/apache/phoenix/expression/SingleCellColumnExpression.java
* (add) phoenix-core/src/it/java/org/apache/phoenix/end2end/ColumnEncodedBytesPropIT.java
* (add) phoenix-core/src/it/java/org/apache/phoenix/end2end/ImmutableTablePropertiesIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/expression/visitor/ExpressionVisitor.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/tuple/ResultTuple.java
* (add) phoenix-core/src/main/java/org/apache/phoenix/util/EncodedColumnsUtil.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/PercentileIT.java
* (add) phoenix-core/src/test/java/org/apache/phoenix/query/EncodedColumnQualifierCellsListTest.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/schema/DelegateTable.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/coprocessor/UngroupedAggregateRegionObserver.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/coprocessor/HashJoinRegionScanner.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/jdbc/PhoenixResultSet.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/iterate/OrderedResultIterator.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/execute/CorrelatePlan.java
* (add) phoenix-core/src/it/java/org/apache/phoenix/end2end/StoreNullsPropIT.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/expression/visitor/CloneNonDeterministicExpressionVisitor.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/index/IndexMaintainerTest.java
* (edit) phoenix-protocol/src/main/PTable.proto
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/QueryIT.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/index/MutableIndexFailureIT.java
* (edit) phoenix-core/src/it/java/org/apache/phoenix/end2end/ExtendedQueryExecIT.java
* (add) phoenix-core/src/main/java/org/apache/phoenix/filter/MultiEncodedCQKeyValueComparisonFilter.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/util/IndexUtil.java
* (edit) phoenix-core/src/main/java/org/apache/phoenix/compile/PostLocalIndexDDLCompiler.java
* (add) phoenix-core/src/test/java/org/apache/phoenix/schema/ImmutableStorageSchemeTest.java
* (edit) phoenix-core/src/test/java/org/apache/phoenix/iterate/AggregateResultScannerTest.java


> Encode column names to save space and improve performance 
> ----------------------------------------------------------
>
>                 Key: PHOENIX-1598
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-1598
>             Project: Phoenix
>          Issue Type: Improvement
>            Reporter: noam bulvik
>            Assignee: Samarth Jain
>             Fix For: 4.10.0
>
>         Attachments: PHOENIX-1598-4.x-HBase-0.98.patch, PHOENIX-1598_master.patch
>
>
> when creating table using phoenix DDL replace the column names that the user give with shorter names to save space. the user will still the full name is his select statements and will get them in the result set but under the hood the infra will translate the names to their sorter version.
> example:
> when creating table with my_column_1, my_column_2 ... the table will be created with a as first column , b as the second one etc'



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)