You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@carbondata.apache.org by gi...@apache.org on 2021/08/11 09:43:38 UTC
[carbondata] branch
dependabot/maven/integration/presto/com.fasterxml.jackson.core-jackson-databind-2.10.5.1
updated (2b35046 -> 0e6d5f3)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/maven/integration/presto/com.fasterxml.jackson.core-jackson-databind-2.10.5.1
in repository https://gitbox.apache.org/repos/asf/carbondata.git.
discard 2b35046 Bump jackson-databind from 2.10.0 to 2.10.5.1 in /integration/presto
add d4ddd07 [CARBONDATA-4225] Fix Update performance issues when auto merge compaction is enabled
add 899b7ae [HOTFIX] Correct CI build status
add 5e2adad [HOTFIX] Correct CI build status This closes #4166
add 65462ff [CARBONDATA-4230] table properties not updated with lower-case and table comment is not working in carbon spark3.1
add aefa977 [maven-release-plugin] prepare release apache-carbondata-2.2.0-rc1
add 718490e [maven-release-plugin] prepare for next development iteration
add c7a3d6d [HOTFIX]Revert wrong pom changes commit during prepare release process.
add 88fdf60 [CARBONDATA-4232] Add missing doc change for secondary index.
add 02e7723 [CARBONDATA-4210] Handle 3.1 parsing failures related to alter complex types
add c9a5231 [CARBONDATA-4204][CARBONDATA-4231] Fix add segment error message, index server failed testcases and dataload fail error on update
add 0337c32 [CARBONDATA-4250] Ignoring presto random test cases
add 9aaeba5 [CARBONDATA-4251][CARBONDATA-4253] Optimize Clean Files Performance
add f2698fe [CARBONDATA-4248] Fixed upper case column name in explain command
add feb0521 [CARBONDATA-4247][CARBONDATA-4241] Fix Wrong timestamp value query results for data before 1900 years with Spark 3.1
add 1e2fc4c [CARBONDATA-4242]Improve cdc performance and introduce new APIs for UPSERT, DELETE, INSERT and UPDATE
add 3c81c7a [CARBONDATA-4255] Prohibit Create/Drop Database when databaselocation is inconsistent
add aceaa44 add new ways of "contact us" in README.md
add 62354e3 [CARBONDATA-4261][Doc][summer-2021] Add new ways of slack in README.md This closes #4190
add 7b0d8f6 [maven-release-plugin] prepare for next development iteration
add 11dab76 [Doc] Add new dev mailing list (website) link and update the Nabble address.
add a5bb652 [CARBONDATA-4268][Doc][summer-2021] Add new dev mailing list (website) link and update the Nabble address This closes #4195
add e8f8c02 [Doc][summer-2021] Add TOC and format how-to-contribute-to-apache-carbondata.md
add d4abe76 [CARBONDATA-4266][Doc][summer-2021] Add TOC and format how-to-contribute-to-apache-carbondata.md This closes #4192
add 926b67b Update quick-start-guide.md
add fac48be [CARBONDATA-4267][Doc][summer-2021]Update and modify some content in quick-start-guide.md This closes #4197
add bdd4a8c [CARBONDATA-4256] Fixed parsing failure on SI creation for complex column
add 1ccf295 [CARBONDATA-4091] support prestosql 333 integartion with carbon
add 0e6d5f3 Bump jackson-databind from 2.10.0 to 2.10.5.1 in /integration/presto
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (2b35046)
\
N -- N -- N refs/heads/dependabot/maven/integration/presto/com.fasterxml.jackson.core-jackson-databind-2.10.5.1 (0e6d5f3)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
README.md | 19 +-
assembly/pom.xml | 2 +-
common/pom.xml | 2 +-
conf/carbon.properties.template | 3 -
conf/dataload.properties.template | 4 -
core/pom.xml | 2 +-
.../core/constants/CarbonCommonConstants.java | 33 ++
.../core/datastore/block/AbstractIndex.java | 7 +
.../core/datastore/block/TableBlockInfo.java | 15 +
.../dimension/v3/DimensionChunkReaderV3.java | 1 +
.../reader/measure/v3/MeasureChunkReaderV3.java | 1 +
.../carbondata/core/index/IndexInputFormat.java | 20 +
.../carbondata/core/indexstore/Blocklet.java | 2 +-
.../core/indexstore/ExtendedBlocklet.java | 62 ++-
.../core/indexstore/ExtendedBlockletWrapper.java | 25 +-
.../ExtendedBlockletWrapperContainer.java | 24 +-
.../core/indexstore/blockletindex/BlockIndex.java | 11 +-
.../indexstore/blockletindex/IndexWrapper.java | 2 -
.../carbondata/core/metadata/SegmentFileStore.java | 6 +-
.../core/metadata/blocklet/DataFileFooter.java | 13 +
.../org/apache/carbondata/core/mutate/CdcVO.java | 80 ++++
.../FilePathMinMaxVO.java} | 38 +-
.../carbondata/core/range/BlockMinMaxTree.java | 213 ++++++++++
.../apache/carbondata/core/range/MinMaxNode.java | 125 ++++++
.../impl/DictionaryBasedVectorResultCollector.java | 2 +
.../scan/executor/impl/AbstractQueryExecutor.java | 1 +
.../CDCBlockImplicitExpression.java} | 47 ++-
.../carbondata/core/scan/filter/FilterUtil.java | 7 +
...utor.java => CDCBlockImplicitExecutorImpl.java} | 71 ++--
.../core/scan/processor/DataBlockIterator.java | 3 +
.../carbondata/core/scan/result/RowBatch.java | 13 +
.../AbstractDetailQueryResultIterator.java | 4 +
.../scan/result/iterator/ChunkRowIterator.java | 4 +
.../result/iterator/DetailQueryResultIterator.java | 1 +
.../scan/result/vector/CarbonColumnVector.java | 2 +
.../scan/result/vector/CarbonColumnarBatch.java | 13 +
.../core/scan/result/vector/ColumnVectorInfo.java | 1 +
.../result/vector/impl/CarbonColumnVectorImpl.java | 5 +
...ColumnarVectorWrapperDirectWithDeleteDelta.java | 5 +
...lumnarVectorWrapperDirectWithInvertedIndex.java | 5 +
.../apache/carbondata/core/util/CarbonUtil.java | 14 +
.../core/util/DataFileFooterConverterV3.java | 5 +
.../apache/carbondata/core/util/DataTypeUtil.java | 113 +++++
docs/configuration-parameters.md | 3 +-
docs/ddl-of-carbondata.md | 7 +-
docs/file-structure-of-carbondata.md | 2 +-
docs/how-to-contribute-to-apache-carbondata.md | 68 ++-
docs/images/QRCode_WechatGroup.png | Bin 0 -> 95421 bytes
docs/index/secondary-index-guide.md | 8 +-
docs/prestosql-guide.md | 36 +-
docs/quick-start-guide.md | 32 +-
docs/s3-guide.md | 6 +-
docs/scd-and-cdc-guide.md | 46 +-
examples/flink/pom.xml | 2 +-
examples/spark/pom.xml | 2 +-
.../carbondata/examples/DataUPSERTExample.scala | 99 +++++
format/pom.xml | 2 +-
geo/pom.xml | 2 +-
hadoop/pom.xml | 2 +-
.../carbondata/hadoop/CarbonRecordReader.java | 5 +
index/bloom/pom.xml | 2 +-
index/examples/pom.xml | 2 +-
index/lucene/pom.xml | 2 +-
index/secondary-index/pom.xml | 2 +-
.../CarbonIndexFileMergeTestCaseWithSI.scala | 2 +-
.../TestSIWithComplexArrayType.scala | 257 ++++++------
integration/flink-build/pom.xml | 2 +-
integration/flink-proxy/pom.xml | 2 +-
integration/flink/pom.xml | 2 +-
integration/hive/pom.xml | 2 +-
integration/presto/pom.xml | 28 +-
.../presto/ColumnarVectorWrapperDirect.java | 5 +
.../carbondata/presto/CarbonDataConnector.java | 85 ++++
.../carbondata/presto/CarbonDataFileWriter.java | 8 +-
.../presto/CarbonDataFileWriterFactory.java | 4 +-
.../presto/CarbonDataLocationService.java | 2 +-
.../carbondata/presto/CarbonDataMetaData.java | 40 +-
.../presto/CarbonDataPageSinkProvider.java | 23 +-
.../carbondata/presto/CarbonDataWriterFactory.java | 6 +-
.../carbondata/presto/CarbonMetadataFactory.java | 133 ++++--
.../presto/CarbondataConnectorFactory.java | 221 +++-------
.../apache/carbondata/presto/CarbondataModule.java | 88 ++--
.../carbondata/presto/CarbondataPageSource.java | 17 +-
.../presto/CarbondataPageSourceProvider.java | 29 +-
.../apache/carbondata/presto/CarbondataPlugin.java | 7 +-
.../carbondata/presto/CarbondataSplitManager.java | 20 +-
.../presto/InternalCarbonDataConnectorFactory.java | 184 ++++++++
.../carbondata/presto/server/PrestoServer.scala | 24 +-
.../PrestoTestUsingSparkStore.scala | 3 +-
integration/spark-common-cluster-test/pom.xml | 2 +-
integration/spark/pom.xml | 2 +-
.../org/apache/spark/sql/SparkVersionAdapter.scala | 15 +-
.../spark/sql/parser/CarbonSparkSqlParser.scala | 12 +-
.../spark/vectorreader/ColumnarVectorWrapper.java | 11 +-
.../vectorreader/ColumnarVectorWrapperDirect.java | 11 +-
.../indexserver/DistributedPruneRDD.scala | 3 +-
.../indexserver/DistributedRDDUtils.scala | 3 +-
.../apache/carbondata/indexserver/IndexJobs.scala | 6 +-
.../spark/rdd/CarbonDataRDDFactory.scala | 20 +-
.../carbondata/spark/rdd/CarbonScanRDD.scala | 95 ++++-
.../carbondata/spark/util/CarbonSparkUtil.scala | 7 +
.../scala/org/apache/spark/sql/CarbonEnv.scala | 7 +
.../scala/org/apache/spark/sql/CarbonSession.scala | 26 +-
.../spark/sql/catalyst/CarbonParserUtil.scala | 47 +++
.../command/management/CarbonAddLoadCommand.scala | 3 +
.../command/management/CommonLoadUtils.scala | 22 +-
.../mutation/merge/CarbonMergeDataSetCommand.scala | 440 ++++++++++++++-----
.../mutation/merge/CarbonMergeDataSetUtil.scala | 465 +++++++++++++++++++++
.../command/mutation/merge/MergeHandler.scala | 219 ++++++++++
...SetException.scala => MergeOperationType.scala} | 19 +-
.../command/mutation/merge/MergeProjection.scala | 92 ++--
.../command/mutation/merge/MergeUtil.scala | 127 ++++++
.../command/mutation/merge/MutationAction.scala | 11 +-
...eDataSetException.scala => UpsertBuilder.scala} | 18 +-
.../command/mutation/merge/udf/BlockPathsUDF.scala | 16 +-
.../schema/CarbonAlterTableRenameCommand.scala | 5 -
.../spark/sql/execution/strategy/DDLHelper.scala | 25 +-
.../spark/sql/execution/strategy/DDLStrategy.scala | 3 +-
.../execution/command/CarbonHiveCommands.scala | 20 +-
.../apache/spark/sql/optimizer/CarbonFilters.scala | 17 +-
.../spark/sql/parser/CarbonSpark2SqlParser.scala | 34 +-
.../sql/parser/CarbonSparkSqlParserUtil.scala | 41 +-
.../apache/spark/sql/CarbonToSparkAdapter.scala | 14 +-
.../org/apache/spark/sql/SparkVersionAdapter.scala | 21 +-
.../spark/sql/hive/CarbonSqlAstBuilder.scala | 2 +-
.../spark/sql/parser/CarbonSparkSqlParser.scala | 4 +-
.../dataload/SparkStoreCreatorForPresto.scala | 3 +-
.../testsuite/dataload/TestLoadDataGeneral.scala | 17 +
.../testsuite/addsegment/AddSegmentTestCase.scala | 9 +
.../alterTable/TestAlterTableAddColumns.scala | 25 +-
.../cleanfiles/TestCleanFileCommand.scala | 9 +
.../createTable/TestRenameTableWithIndex.scala | 8 +-
.../deleteTable/TestDeleteTableNewDDL.scala | 47 +++
.../TimestampNoDictionaryColumnTestCase.scala | 56 +--
.../testsuite/iud/UpdateCarbonTableTestCase.scala | 25 ++
.../spark/testsuite/merge/MergeTestCase.scala | 134 ++++++
.../AlterTableColumnRenameTestCase.scala | 384 ++++++++---------
mv/plan/pom.xml | 2 +-
pom.xml | 10 +-
processing/pom.xml | 2 +-
sdk/sdk/pom.xml | 2 +-
streaming/pom.xml | 2 +-
.../streaming/parser/FieldConverter.scala | 3 +-
.../SparkStreamingUtil.scala | 6 +
.../carbondata/util/SparkStreamingUtil.scala | 13 +
tools/cli/pom.xml | 2 +-
146 files changed, 3976 insertions(+), 1218 deletions(-)
create mode 100644 core/src/main/java/org/apache/carbondata/core/mutate/CdcVO.java
copy core/src/main/java/org/apache/carbondata/core/{index/dev/IndexModel.java => mutate/FilePathMinMaxVO.java} (59%)
create mode 100644 core/src/main/java/org/apache/carbondata/core/range/BlockMinMaxTree.java
create mode 100644 core/src/main/java/org/apache/carbondata/core/range/MinMaxNode.java
copy core/src/main/java/org/apache/carbondata/core/scan/expression/{MatchExpression.java => conditional/CDCBlockImplicitExpression.java} (57%)
copy core/src/main/java/org/apache/carbondata/core/scan/filter/executer/{TrueFilterExecutor.java => CDCBlockImplicitExecutorImpl.java} (57%)
create mode 100644 docs/images/QRCode_WechatGroup.png
create mode 100644 examples/spark/src/main/scala/org/apache/carbondata/examples/DataUPSERTExample.scala
create mode 100755 integration/presto/src/main/prestosql/org/apache/carbondata/presto/CarbonDataConnector.java
create mode 100755 integration/presto/src/main/prestosql/org/apache/carbondata/presto/InternalCarbonDataConnectorFactory.java
create mode 100644 integration/spark/src/main/scala/org/apache/spark/sql/execution/command/mutation/merge/CarbonMergeDataSetUtil.scala
create mode 100644 integration/spark/src/main/scala/org/apache/spark/sql/execution/command/mutation/merge/MergeHandler.scala
copy integration/spark/src/main/scala/org/apache/spark/sql/execution/command/mutation/merge/{CarbonMergeDataSetException.scala => MergeOperationType.scala} (71%)
create mode 100644 integration/spark/src/main/scala/org/apache/spark/sql/execution/command/mutation/merge/MergeUtil.scala
copy integration/spark/src/main/scala/org/apache/spark/sql/execution/command/mutation/merge/{CarbonMergeDataSetException.scala => UpsertBuilder.scala} (68%)
copy core/src/main/java/org/apache/carbondata/core/metadata/schema/ColumnRangeInfo.java => integration/spark/src/main/scala/org/apache/spark/sql/execution/command/mutation/merge/udf/BlockPathsUDF.scala (78%)