You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by xi...@apache.org on 2020/03/03 00:46:51 UTC

[incubator-pinot] branch release-0.3.0 updated (1859a6b -> 79402cf)

This is an automated email from the ASF dual-hosted git repository.

xiangfu pushed a change to branch release-0.3.0
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.


 discard 1859a6b  Update license and notice
    omit 9abf0a4  Adding PinotClusterConfig APIs in controller and corresponding Pinot Admin SubCommand: OperateClusterConfig (#5073)
    omit 16e6fbf  [Cleanup] Remove the old broker routing (#5101)
    omit 9f33abe  [TE] Add additional safeguard around jira description length (#5100)
    omit b880c47  Fix the duplicate broker refresh message (#5102)
    omit 754532e9 [TE] Change the jetty version to be compatible of loading the certificate for HTTPS (#5099)
    omit 00fd911  [TE][subscription] destroy jira connections after use (#5097)
    omit 3c91a6d  Remove the support of the old Star-Tree (#5086)
    omit 3126d56  Support non-literal expressions for right-side operand in predicate comparison (#5070)
    omit fdfb97e  [TE][subscription] Dimension Recipient Alerter should be agnostic to individual errors; Emit metrics to track emails and jiras (#5091)
    omit 26ead7d  [TE] add dependencies for enabling ThirdEye https connections (#5095)
    omit 0e56960  Fix a typo in RoutingConfig (#5096)
    omit b2608ad  [TE] Upgrade mysql version to 5.1.41 to fix compatibility issues connectin with 8.* (#5093)
    omit ef6509e  Minor improvement for RoutingManager (#5092)
    omit f247e77  Plug in the new routing introduced in #5046 (#5082)
    omit e44192e  Support embedded parsing in PinotDataAndQueryAnonymizer (#5088)
    omit 4124563  Support segment reload for text index (#5074)
    omit d5c8398  Support creation of inverted index on a new column in V1 segment (#5087)
    omit 21850ba  Support text index load for V1 segment format (#5085)
    omit 35f2117  [TE][subscription] Minor bug fix in the empty email check (#5084)
    omit ef69b75  [TE][subscription] Fix duplicate anomaly report issue and clean up subscription pipelines (#5081)
    omit 7dfc5c1  Adding quickstart into Pinot admin command (#5080)
    omit c613f46  [TE] Adjust dectection window using expected delay (#5059)
    omit 3c78a8c  [TE] add initial delay upon receiving events in scheduling (#5060)
    omit 4779341  Disbale text query realtime integration test (#5079)
    omit 884af43  [TE] Remove fromAddress as a compulsory field from subscription group (#5078)
    omit 94122e8  [TE] frontend - harleyjj/alerts - update application filter for many-to-many relationship (#5062)
    omit 9c65deb  Reduce the non-determinism in lucene integration test (#5077)
    omit 4be7490  Use getResourceAsStream to load test resource file packaged inside (#5072)
    omit a257935  Support no global-dictionary columns in data anonymizer (#5071)
    omit 2a79531  Support Text Search (#4993)
    omit 344bade  Re-design the broker routing (#5046)
    omit 7f6afdf  [TE] detection health - generate task status in monitoring task (#5065)
     new 79402cf  update pinot assembly scripts

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (1859a6b)
            \
             N -- N -- N   refs/heads/release-0.3.0 (79402cf)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 LICENSE-binary                                     |   131 +-
 NOTICE                                             |     2 +-
 NOTICE-binary                                      |   448 +-
 licenses-binary/LICENSE-fusesource.txt             |    27 -
 licenses-binary/LICENSE-py4j.txt                   |    26 -
 licenses-binary/LICENSE-threeten.txt               |    29 -
 .../broker/api/resources/PinotBrokerDebug.java     |   111 +-
 .../api/resources/PinotBrokerHealthCheck.java      |    17 +-
 .../broker/api/resources/PinotBrokerRouting.java   |    76 -
 .../broker/api/resources/PinotClientRequest.java   |     2 +-
 .../broker/broker/BrokerAdminApiApplication.java   |    14 +-
 .../pinot/broker/broker/BrokerServerBuilder.java   |   144 +
 ...okerResourceOnlineOfflineStateModelFactory.java |    77 +-
 .../BrokerUserDefineMessageHandlerFactory.java     |    92 -
 .../broker/broker/helix/HelixBrokerStarter.java    |   170 +-
 .../TimeboundaryRefreshMessageHandlerFactory.java  |   145 +
 .../HelixExternalViewBasedQueryQuotaManager.java   |    10 +-
 .../requesthandler/BaseBrokerRequestHandler.java   |    46 +-
 .../SingleConnectionBrokerRequestHandler.java      |    11 +-
 .../routing/HelixExternalViewBasedRouting.java     |   625 +
 .../HelixExternalViewBasedTimeBoundaryService.java |   148 +
 .../pinot/broker/routing/RoutingManager.java       |   520 -
 .../apache/pinot/broker/routing/RoutingTable.java  |    56 +
 .../broker/routing/RoutingTableBuilderFactory.java |   143 +
 .../broker/routing/RoutingTableLookupRequest.java  |    79 +
 .../pinot/broker/routing/TimeBoundaryService.java  |    65 +
 .../builder/BalancedRandomRoutingTableBuilder.java |    62 +
 .../BasePartitionAwareRoutingTableBuilder.java     |   160 +
 .../routing/builder/BaseRoutingTableBuilder.java   |   220 +
 .../builder/DefaultOfflineRoutingTableBuilder.java |   139 +
 .../DefaultRealtimeRoutingTableBuilder.java        |   119 +
 .../builder/GeneratorBasedRoutingTableBuilder.java |   293 +
 .../HighLevelConsumerBasedRoutingTableBuilder.java |    95 +
 .../routing/builder/InstanceConfigManager.java     |    81 +
 .../builder/LargeClusterRoutingTableBuilder.java   |    63 +
 .../LowLevelConsumerRoutingTableBuilder.java       |   139 +
 .../builder/LowLevelRoutingTableBuilderUtil.java   |    81 +
 .../PartitionAwareOfflineRoutingTableBuilder.java  |   209 +
 .../PartitionAwareRealtimeRoutingTableBuilder.java |   145 +
 .../routing/builder/RoutingTableBuilder.java       |    64 +
 .../instanceselector/BalancedInstanceSelector.java |    55 -
 .../instanceselector/BaseInstanceSelector.java     |   179 -
 .../routing/instanceselector/InstanceSelector.java |    60 -
 .../instanceselector/InstanceSelectorFactory.java  |    49 -
 .../ReplicaGroupInstanceSelector.java              |    65 -
 .../segmentpruner/PartitionSegmentPruner.java      |   191 -
 .../routing/segmentpruner/SegmentPruner.java       |    57 -
 .../segmentpruner/SegmentPrunerFactory.java        |   100 -
 .../segmentselector/OfflineSegmentSelector.java    |    52 -
 .../segmentselector/RealtimeSegmentSelector.java   |   165 -
 .../routing/segmentselector/SegmentSelector.java   |    62 -
 .../routing/selector/MergedSegmentSelector.java    |    95 +
 .../SegmentSelector.java}                          |    37 +-
 .../SegmentSelectorProvider.java}                  |    31 +-
 .../routing/timeboundary/TimeBoundaryInfo.java     |    37 -
 .../routing/timeboundary/TimeBoundaryManager.java  |   193 -
 .../broker/broker/HelixBrokerStarterTest.java      |    37 +-
 ...elixExternalViewBasedQueryQuotaManagerTest.java |     4 +-
 ...ixExternalViewBasedTimeBoundaryServiceTest.java |   167 +
 .../broker/routing/RandomRoutingTableTest.java     |   107 +
 .../pinot/broker/routing/RoutingTableTest.java     |   303 +
 .../BalancedRandomRoutingTableBuilderTest.java     |   126 +
 .../HighLevelConsumerRoutingTableBuilderTest.java  |   119 +
 .../LargeClusterRoutingTableBuilderTest.java       |   275 +
 .../LowLevelConsumerRoutingTableBuilderTest.java   |   271 +
 ...rtitionAwareOfflineRoutingTableBuilderTest.java |   404 +
 ...titionAwareRealtimeRoutingTableBuilderTest.java |   374 +
 .../instanceselector/InstanceSelectorTest.java     |   400 -
 .../routing/segmentpruner/SegmentPrunerTest.java   |   222 -
 .../segmentselector/SegmentSelectorTest.java       |   126 -
 .../selector/MergedSegmentSelectorTest.java        |   149 +
 .../timeboundary/TimeBoundaryManagerTest.java      |   169 -
 .../antlr4/org/apache/pinot/pql/parsers/PQL2.g4    |     5 -
 .../apache/pinot/common/config/IndexingConfig.java |    10 +
 .../apache/pinot/common/config/RoutingConfig.java  |    26 +-
 .../SegmentsValidationAndRetentionConfig.java      |    10 +
 .../apache/pinot/common/config/TableConfig.java    |     6 -
 .../common/config/TextIndexConfigValidator.java    |    46 -
 .../pinot/common/data/StarTreeIndexSpec.java       |   128 +
 .../common/messages/SegmentRefreshMessage.java     |    46 +-
 .../messages/TimeboundaryRefreshMessage.java       |    45 +
 .../common/metadata/segment/SegmentZKMetadata.java |    22 +-
 .../apache/pinot/common/metrics/BrokerMeter.java   |     3 -
 .../pinot/common/request/FilterOperator.java       |    11 +-
 .../common/response/BrokerResponseFactory.java     |   117 +
 .../pinot/common/segment/SegmentMetadata.java      |    19 +
 .../pinot/common/segment/StarTreeMetadata.java     |    73 +
 .../apache/pinot/common/utils/CommonConstants.java |     8 +
 .../pinot/common/utils/request/RequestUtils.java   |    29 +-
 .../parsers/PinotQuery2BrokerRequestConverter.java |     2 -
 .../apache/pinot/pql/parsers/Pql2AstListener.java  |    11 -
 .../org/apache/pinot/pql/parsers/Pql2Compiler.java |     1 +
 .../pinot/pql/parsers/pql2/ast/FilterKind.java     |     3 +-
 .../pql/parsers/pql2/ast/InPredicateAstNode.java   |     4 -
 .../pql2/ast/TextMatchPredicateAstNode.java        |    93 -
 .../apache/pinot/sql/parsers/CalciteSqlParser.java |   100 +-
 .../org/apache/pinot/startree/hll/HllConfig.java   |   131 +
 .../apache/pinot/startree/hll/HllConstants.java    |     8 +-
 .../apache/pinot/startree/hll/HllSizeUtils.java    |    60 +
 .../pinot/common/config/IndexingConfigTest.java    |    48 +
 .../pinot/common/config/TableConfigTest.java       |   156 +-
 .../apache/pinot/common/data/FieldSpecTest.java    |    19 +
 .../org/apache/pinot/common/data/SchemaTest.java   |    56 +-
 .../common/metadata/SegmentZKMetadataTest.java     |     6 +-
 .../apache/pinot/pql/parsers/Pql2CompilerTest.java |    12 -
 .../pinot/sql/parsers/CalciteSqlCompilerTest.java  |    95 +-
 pinot-common/src/thrift/request.thrift             |     3 +-
 .../pinot/controller/api/resources/Constants.java  |     1 -
 .../api/resources/PinotClusterConfigs.java         |   121 -
 .../helix/core/PinotHelixResourceManager.java      |   122 +-
 .../realtime/PinotLLCRealtimeSegmentManager.java   |     2 +-
 .../SegmentSizeBasedFlushThresholdUpdater.java     |     2 +-
 .../helix/core/util/ZKMetadataUtils.java           |     2 +-
 .../validation/OfflineSegmentIntervalChecker.java  |     2 +-
 .../RealtimeSegmentValidationManager.java          |     6 +-
 .../PinotLLCRealtimeSegmentManagerTest.java        |     4 +-
 .../segment/FlushThresholdUpdaterTest.java         |     4 +-
 .../controller/utils/SegmentMetadataMockUtils.java |     4 +-
 .../validation/ValidationManagerTest.java          |     6 +-
 pinot-core/pom.xml                                 |    15 -
 .../org/apache/pinot/core/common/Predicate.java    |     6 +-
 .../core/data/manager/BaseTableDataManager.java    |     4 +-
 .../realtime/HLRealtimeSegmentDataManager.java     |     2 +-
 .../realtime/LLRealtimeSegmentDataManager.java     |    19 +-
 .../data/readers/PinotSegmentRecordReader.java     |     2 +-
 .../generator/SegmentGeneratorConfig.java          |   110 +-
 .../immutable/ImmutableSegmentLoader.java          |     6 +-
 .../indexsegment/mutable/MutableSegmentImpl.java   |   116 +-
 .../io/reader/impl/v1/SortedIndexReaderImpl.java   |     8 -
 .../pinot/core/minion/BackfillDateTimeColumn.java  |     7 +
 .../apache/pinot/core/minion/SegmentConverter.java |    10 +-
 .../apache/pinot/core/minion/SegmentPurger.java    |    16 +-
 .../core/operator/CombineGroupByOperator.java      |     2 +-
 .../operator/CombineGroupByOrderByOperator.java    |     4 +-
 .../pinot/core/operator/CombineOperator.java       |     2 +-
 .../pinot/core/operator/ExecutionStatistics.java   |    14 +-
 .../operator/blocks/IntermediateResultsBlock.java  |    43 +-
 .../operator/filter/ExpressionFilterOperator.java  |     2 +-
 .../core/operator/filter/FilterOperatorUtils.java  |    14 +-
 .../operator/filter/TextMatchFilterOperator.java   |    75 -
 .../predicate/PredicateEvaluatorProvider.java      |     8 -
 .../TextMatchPredicateEvaluatorFactory.java        |    58 -
 .../operator/query/AggregationGroupByOperator.java |    14 +-
 .../query/AggregationGroupByOrderByOperator.java   |    14 +-
 .../core/operator/query/AggregationOperator.java   |    12 +-
 .../query/DictionaryBasedAggregationOperator.java  |    14 +-
 .../operator/query/EmptySelectionOperator.java     |     2 +-
 .../query/MetadataBasedAggregationOperator.java    |    10 +-
 .../core/operator/query/SelectionOnlyOperator.java |     5 +-
 .../operator/query/SelectionOrderByOperator.java   |     9 +-
 .../AggregationFunctionInitializer.java}           |    28 +-
 .../plan/AggregationGroupByOrderByPlanNode.java    |     7 +-
 .../core/plan/AggregationGroupByPlanNode.java      |     6 +-
 .../pinot/core/plan/AggregationPlanNode.java       |     6 +-
 .../plan/DictionaryBasedAggregationPlanNode.java   |     2 +-
 .../org/apache/pinot/core/plan/FilterPlanNode.java |     9 +-
 .../core/plan/maker/BrokerRequestPreProcessor.java |    97 +
 .../core/plan/maker/InstancePlanMakerImplV2.java   |     7 +-
 .../function/AggregationFunctionUtils.java         |     8 +
 .../DistinctCountRawHLLAggregationFunction.java    |     2 +-
 .../function/FastHLLAggregationFunction.java       |   111 +-
 .../function/customobject/SerializedHLL.java       |    24 +-
 .../query/executor/ServerQueryExecutorV1Impl.java  |    12 +-
 .../core/query/reduce/BrokerReduceService.java     |    13 +-
 .../converter/RealtimeSegmentConverter.java        |    37 +-
 .../stats/RealtimeSegmentStatsContainer.java       |    15 +-
 .../core/realtime/impl/RealtimeSegmentConfig.java  |    52 +-
 .../invertedindex/RealtimeInvertedIndexReader.java |     8 -
 .../RealtimeLuceneIndexReaderRefreshThread.java    |   151 -
 .../RealtimeLuceneIndexRefreshState.java           |   139 -
 .../RealtimeLuceneTextIndexReader.java             |   162 -
 .../core/segment/creator/InvertedIndexCreator.java |    13 +-
 .../segment/creator/SegmentIndexCreationInfo.java  |    27 +
 .../creator/SegmentPreIndexStatsCollector.java     |     3 +
 .../creator/SegmentPreIndexStatsContainer.java     |     4 +
 .../creator/impl/SegmentColumnarIndexCreator.java  |   124 +-
 .../impl/SegmentIndexCreationDriverImpl.java       |   199 +-
 .../core/segment/creator/impl/V1Constants.java     |    22 +-
 .../inv/OffHeapBitmapInvertedIndexCreator.java     |     5 -
 .../impl/inv/OnHeapBitmapInvertedIndexCreator.java |     5 -
 .../impl/inv/text/LuceneTextIndexCreator.java      |   163 -
 .../stats/AbstractColumnStatisticsCollector.java   |    12 +-
 .../stats/BytesColumnPredIndexStatsCollector.java  |    94 +-
 .../stats/DoubleColumnPreIndexStatsCollector.java  |   114 +-
 .../stats/FloatColumnPreIndexStatsCollector.java   |   114 +-
 .../stats/IntColumnPreIndexStatsCollector.java     |   111 +-
 .../stats/LongColumnPreIndexStatsCollector.java    |   114 +-
 .../stats/SegmentPreIndexStatsCollectorImpl.java   |    32 +-
 .../stats/StringColumnPreIndexStatsCollector.java  |   135 +-
 .../pinot/core/segment/index/ColumnMetadata.java   |   146 +-
 .../core/segment/index/SegmentMetadataImpl.java    |   102 +-
 .../index/column/PhysicalColumnIndexContainer.java |    16 +-
 .../converter/SegmentV1V2ToV3FormatConverter.java  |    44 +-
 .../index/data/source/ColumnDataSource.java        |     6 +-
 .../segment/index/loader/IndexLoadingConfig.java   |    53 -
 .../segment/index/loader/SegmentPreProcessor.java  |    13 +-
 .../defaultcolumn/BaseDefaultColumnHandler.java    |   111 +-
 .../loader/defaultcolumn/DefaultColumnHandler.java |     5 +-
 .../defaultcolumn/DefaultColumnHandlerFactory.java |     2 +-
 .../defaultcolumn/V1DefaultColumnHandler.java      |    19 +-
 .../defaultcolumn/V3DefaultColumnHandler.java      |    40 +-
 .../loader/invertedindex/TextIndexHandler.java     |   179 -
 .../index/readers/BitmapInvertedIndexReader.java   |     8 -
 .../segment/index/readers/InvertedIndexReader.java |     7 -
 .../index/readers/text/LuceneDocIdCollector.java   |    73 -
 .../index/readers/text/LuceneTextIndexReader.java  |   173 -
 .../core/segment/store/ColumnIndexDirectory.java   |     6 +
 .../pinot/core/segment/store/ColumnIndexType.java  |     3 +-
 .../core/segment/store/FilePerIndexDirectory.java  |     4 -
 .../pinot/core/segment/store/SegmentDirectory.java |    33 +-
 .../core/segment/store/SegmentDirectoryPaths.java  |    27 +-
 .../segment/store/SegmentLocalFSDirectory.java     |    85 +-
 .../segment/store/SingleFileIndexDirectory.java    |    22 -
 .../virtualcolumn/DocIdVirtualColumnProvider.java  |     9 -
 .../SingleStringVirtualColumnProvider.java         |     8 -
 .../pinot/core/startree/DimensionBuffer.java       |    77 +
 .../apache/pinot/core/startree/MetricBuffer.java   |   150 +
 .../core/startree/OffHeapStarTreeBuilder.java      |   855 +
 .../pinot/core/startree/StarTreeBuilder.java       |    85 +
 .../pinot/core/startree/StarTreeBuilderConfig.java |   125 +
 .../pinot/core/startree/StarTreeDataTable.java     |   216 +
 .../apache/pinot/core/startree/StarTreeNode.java   |     1 +
 .../apache/pinot/core/startree/StarTreeUtils.java  |    14 +-
 .../apache/pinot/core/startree/hll/HllUtil.java    |   157 +
 .../startree/v2/builder/BaseSingleTreeBuilder.java |     2 +-
 .../startree/v2/builder/MultipleTreesBuilder.java  |     3 +
 .../startree/v2/store/StarTreeIndexContainer.java  |    37 +-
 .../startree/v2/store/StarTreeLoaderUtils.java     |    60 +
 ...adataAndDictionaryAggregationPlanMakerTest.java |   103 +-
 .../core/segment/index/ColumnMetadataTest.java     |    43 +-
 .../segment/index/SegmentMetadataImplTest.java     |     2 +
 .../SegmentV1V2ToV3FormatConverterTest.java        |     7 +
 .../core/segment/index/loader/LoaderTest.java      |   155 -
 .../index/loader/SegmentPreProcessorTest.java      |   175 +-
 .../store/ColumnIndexDirectoryTestHelper.java      |     3 +-
 .../segment/store/SegmentLocalFSDirectoryTest.java |    29 +
 .../pinot/core/startree/BaseStarTreeIndexTest.java |   128 +
 .../core/startree/OffHeapStarTreeBuilderTest.java  |   126 +
 .../pinot/core/startree/StarTreeDataTableTest.java |    79 +
 .../startree/StarTreeIndexTestSegmentHelper.java   |   108 +
 .../pinot/core/startree/SumStarTreeIndexTest.java  |   114 +
 .../pinot/core/startree/TestStarTreeMetadata.java  |   116 +
 .../pinot/core/startree/hll/HllFieldSizeTest.java  |    53 +
 .../core/startree/hll/HllIndexCreationTest.java    |   182 +
 .../core/startree/hll/HllStarTreeIndexTest.java    |   138 +
 .../core/startree/hll/HllTypeConversionTest.java   |    72 +
 .../OffHeapStarTreeBuilderWithHllFieldTest.java    |   252 +
 .../hll/SegmentWithHllIndexCreateHelper.java       |   187 +
 .../apache/pinot/queries/FastHllQueriesTest.java   |   102 +-
 ...InnerSegmentSelectionMultiValueQueriesTest.java |    16 +-
 ...nnerSegmentSelectionSingleValueQueriesTest.java |    20 +-
 ...terSegmentAggregationMultiValueQueriesTest.java |    30 +-
 ...erSegmentAggregationSingleValueQueriesTest.java |     8 +-
 ...terSegmentResultTableMultiValueQueriesTest.java |    20 +-
 ...erSegmentResultTableSingleValueQueriesTest.java |    41 +-
 .../org/apache/pinot/queries/QueriesTestUtils.java |    18 +-
 .../pinot/queries/TestTextSearchQueries.java       |  1116 -
 .../DefaultAggregationExecutorTest.java            |    16 +-
 .../segments/v1/creator/DictionariesTest.java      |    48 +-
 .../test/java/org/apache/pinot/util/TestUtils.java |    19 +-
 .../resources/data/newColumnsWithTextSchema.json   |    76 -
 .../text_search_data/group_by_grep_results.out     |    26 -
 .../resources/data/text_search_data/pql_query1.txt | 24150 -------------------
 .../resources/data/text_search_data/skills.txt     |    23 -
 pinot-distribution/pinot-assembly.xml              |    88 +-
 .../tests/BaseClusterIntegrationTest.java          |     6 +-
 .../tests/BaseClusterIntegrationTestSet.java       |   115 +-
 .../tests/ClusterIntegrationTestUtils.java         |    14 +-
 .../pinot/integration/tests/ClusterTest.java       |    14 +-
 .../ControllerPeriodicTasksIntegrationTests.java   |     6 +-
 .../tests/HybridClusterIntegrationTest.java        |    31 +-
 ...ridClusterIntegrationTestCommandLineRunner.java |     8 +-
 .../LuceneRealtimeClusterIntegrationTest.java      |   191 -
 .../tests/MapTypeClusterIntegrationTest.java       |     4 +-
 ...onaryAggregationPlanClusterIntegrationTest.java |     6 +-
 .../tests/OfflineClusterIntegrationTest.java       |     7 +-
 .../tests/StarTreeClusterIntegrationTest.java      |    89 +-
 ....java => StarTreeV2ClusterIntegrationTest.java} |   148 +-
 .../src/test/resources/OnTimeStarTreeQueries.txt   |  1000 +
 ...rformance_2014_100k_subset.test_queries_10K.sql |     7 +-
 .../apache/pinot/hadoop/io/PinotOutputFormat.java  |    97 +-
 .../pinot/hadoop/io/PinotOutputFormatTest.java     |    19 +-
 pinot-plugins/pom.xml                              |     1 -
 .../server/starter/helix/HelixServerStarter.java   |     6 -
 .../java/org/apache/pinot/spi/data/FieldSpec.java  |     3 +
 .../org/apache/pinot/spi/data/MetricFieldSpec.java |   115 +-
 .../java/org/apache/pinot/spi/data/Schema.java     |    19 +
 .../org/apache/pinot/spi/data/TimeFieldSpec.java   |     1 +
 .../org/apache/pinot/tools/HybridQuickstart.java   |     3 +
 .../java/org/apache/pinot/tools/Quickstart.java    |     2 +
 .../org/apache/pinot/tools/RealtimeQuickStart.java |     3 +
 .../pinot/tools/admin/PinotAdministrator.java      |     4 -
 .../admin/command/AbstractBaseAdminCommand.java    |    24 +-
 .../tools/admin/command/CreateSegmentCommand.java  |    80 +-
 .../admin/command/OperateClusterConfigCommand.java |   149 -
 .../tools/admin/command/QuickStartCommand.java     |    91 -
 .../anonymizer/PinotDataAndQueryAnonymizer.java    |   122 +-
 .../tools/query/comparison/ClusterStarter.java     |    18 +-
 .../query/comparison/StarQueryComparison.java      |   130 +
 .../query/comparison/StarTreeQueryGenerator.java   |    57 +
 .../realtime/provisioning/MemoryEstimator.java     |     4 +-
 .../converter/ColumnarToStarTreeConverter.java     |   170 +
 .../converter/DictionaryToRawIndexConverter.java   |     4 +-
 .../pinot/tools/TestDataAndQueryAnonymizer.java    |     6 +-
 pinot-tools/src/test/resources/columns.mapping     |     4 +-
 pinot-tools/src/test/resources/queries.generated   |     4 +-
 pinot-tools/src/test/resources/queries.raw         |     4 +-
 pom.xml                                            |     1 -
 thirdeye/pom.xml                                   |     4 +-
 .../app/pods/manage/alerts/index/controller.js     |    20 +-
 .../app/pods/manage/alerts/index/route.js          |    12 +-
 thirdeye/thirdeye-pinot/pom.xml                    |     5 -
 .../anomaly/ThirdEyeAnomalyApplication.java        |     3 +-
 .../trigger/DataAvailabilityTaskScheduler.java     |    29 +-
 .../DataAvailabilitySchedulingConfiguration.java   |    10 -
 .../trigger/utils/DatasetTriggerInfoRepo.java      |     2 +-
 .../anomaly/utils/ThirdeyeMetricsUtil.java         |    18 -
 .../thirdeye/datalayer/pojo/DatasetConfigBean.java |     6 +-
 .../thirdeye/detection/DetectionPipelineJob.java   |    11 +
 .../apache/pinot/thirdeye/detection/TaskUtils.java |    11 +-
 .../detection/alert/DetectionAlertTaskRunner.java  |    12 +-
 .../alert/StatefulDetectionAlertFilter.java        |     9 +-
 ...ter.java => DimensionDetectionAlertFilter.java} |    91 +-
 .../filter/DimensionsRecipientAlertFilter.java     |     4 +-
 .../alert/filter/PerUserDimensionAlertFilter.java  |    51 +-
 .../detection/alert/filter/SubscriptionUtils.java  |    17 +-
 .../ToAllRecipientsDetectionAlertFilter.java       |    18 +-
 .../alert/scheme/DetectionAlertScheme.java         |     9 +-
 .../alert/scheme/DetectionEmailAlerter.java        |    15 +-
 .../alert/scheme/DetectionJiraAlerter.java         |    29 +-
 .../thirdeye/detection/health/DetectionHealth.java |     7 +-
 .../detection/health/DetectionTaskStatus.java      |    51 +-
 .../validators/SubscriptionConfigValidator.java    |     1 +
 .../formatter/DetectionConfigFormatter.java        |    12 +-
 .../notification/commons/ThirdEyeJiraClient.java   |    10 +-
 .../apache/pinot/thirdeye/util/ThirdEyeUtils.java  |    22 -
 .../trigger/DataAvailabilityTaskSchedulerTest.java |    35 +-
 .../detection/alert/filter/AlertFilterUtils.java   |    12 -
 ...java => DimensionDetectionAlertFilterTest.java} |   116 +-
 .../filter/PerUserDimensionAlertFilterTest.java    |    17 +-
 .../ToAllRecipientsDetectionAlertFilterTest.java   |    42 +-
 341 files changed, 14809 insertions(+), 33817 deletions(-)
 delete mode 100644 licenses-binary/LICENSE-fusesource.txt
 delete mode 100644 licenses-binary/LICENSE-py4j.txt
 delete mode 100644 licenses-binary/LICENSE-threeten.txt
 delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/api/resources/PinotBrokerRouting.java
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/broker/BrokerServerBuilder.java
 delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/broker/helix/BrokerUserDefineMessageHandlerFactory.java
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/broker/helix/TimeboundaryRefreshMessageHandlerFactory.java
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/HelixExternalViewBasedRouting.java
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/HelixExternalViewBasedTimeBoundaryService.java
 delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/RoutingManager.java
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/RoutingTable.java
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/RoutingTableBuilderFactory.java
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/RoutingTableLookupRequest.java
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/TimeBoundaryService.java
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/BalancedRandomRoutingTableBuilder.java
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/BasePartitionAwareRoutingTableBuilder.java
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/BaseRoutingTableBuilder.java
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/DefaultOfflineRoutingTableBuilder.java
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/DefaultRealtimeRoutingTableBuilder.java
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/GeneratorBasedRoutingTableBuilder.java
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/HighLevelConsumerBasedRoutingTableBuilder.java
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/InstanceConfigManager.java
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/LargeClusterRoutingTableBuilder.java
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/LowLevelConsumerRoutingTableBuilder.java
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/LowLevelRoutingTableBuilderUtil.java
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/PartitionAwareOfflineRoutingTableBuilder.java
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/PartitionAwareRealtimeRoutingTableBuilder.java
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/RoutingTableBuilder.java
 delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/instanceselector/BalancedInstanceSelector.java
 delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/instanceselector/BaseInstanceSelector.java
 delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/instanceselector/InstanceSelector.java
 delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/instanceselector/InstanceSelectorFactory.java
 delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/instanceselector/ReplicaGroupInstanceSelector.java
 delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/segmentpruner/PartitionSegmentPruner.java
 delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/segmentpruner/SegmentPruner.java
 delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/segmentpruner/SegmentPrunerFactory.java
 delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/segmentselector/OfflineSegmentSelector.java
 delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/segmentselector/RealtimeSegmentSelector.java
 delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/segmentselector/SegmentSelector.java
 create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/selector/MergedSegmentSelector.java
 copy pinot-broker/src/main/java/org/apache/pinot/broker/routing/{segmentselector/SegmentSelectorFactory.java => selector/SegmentSelector.java} (50%)
 rename pinot-broker/src/main/java/org/apache/pinot/broker/routing/{segmentselector/SegmentSelectorFactory.java => selector/SegmentSelectorProvider.java} (51%)
 delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/timeboundary/TimeBoundaryInfo.java
 delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/timeboundary/TimeBoundaryManager.java
 create mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/HelixExternalViewBasedTimeBoundaryServiceTest.java
 create mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/RandomRoutingTableTest.java
 create mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/RoutingTableTest.java
 create mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/builder/BalancedRandomRoutingTableBuilderTest.java
 create mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/builder/HighLevelConsumerRoutingTableBuilderTest.java
 create mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/builder/LargeClusterRoutingTableBuilderTest.java
 create mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/builder/LowLevelConsumerRoutingTableBuilderTest.java
 create mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/builder/PartitionAwareOfflineRoutingTableBuilderTest.java
 create mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/builder/PartitionAwareRealtimeRoutingTableBuilderTest.java
 delete mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/instanceselector/InstanceSelectorTest.java
 delete mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/segmentpruner/SegmentPrunerTest.java
 delete mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/segmentselector/SegmentSelectorTest.java
 create mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/selector/MergedSegmentSelectorTest.java
 delete mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/timeboundary/TimeBoundaryManagerTest.java
 delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/TextIndexConfigValidator.java
 create mode 100644 pinot-common/src/main/java/org/apache/pinot/common/data/StarTreeIndexSpec.java
 create mode 100644 pinot-common/src/main/java/org/apache/pinot/common/messages/TimeboundaryRefreshMessage.java
 create mode 100644 pinot-common/src/main/java/org/apache/pinot/common/response/BrokerResponseFactory.java
 create mode 100644 pinot-common/src/main/java/org/apache/pinot/common/segment/StarTreeMetadata.java
 delete mode 100644 pinot-common/src/main/java/org/apache/pinot/pql/parsers/pql2/ast/TextMatchPredicateAstNode.java
 create mode 100644 pinot-common/src/main/java/org/apache/pinot/startree/hll/HllConfig.java
 rename pinot-core/src/main/java/org/apache/pinot/core/segment/creator/TextIndexType.java => pinot-common/src/main/java/org/apache/pinot/startree/hll/HllConstants.java (81%)
 create mode 100644 pinot-common/src/main/java/org/apache/pinot/startree/hll/HllSizeUtils.java
 delete mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotClusterConfigs.java
 delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/filter/TextMatchFilterOperator.java
 delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/filter/predicate/TextMatchPredicateEvaluatorFactory.java
 rename pinot-core/src/main/java/org/apache/pinot/core/{common/predicate/TextMatchPredicate.java => plan/AggregationFunctionInitializer.java} (55%)
 create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/plan/maker/BrokerRequestPreProcessor.java
 delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/impl/invertedindex/RealtimeLuceneIndexReaderRefreshThread.java
 delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/impl/invertedindex/RealtimeLuceneIndexRefreshState.java
 delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/impl/invertedindex/RealtimeLuceneTextIndexReader.java
 delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/creator/impl/inv/text/LuceneTextIndexCreator.java
 delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/loader/invertedindex/TextIndexHandler.java
 delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/readers/text/LuceneDocIdCollector.java
 delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/readers/text/LuceneTextIndexReader.java
 create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/startree/DimensionBuffer.java
 create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/startree/MetricBuffer.java
 create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/startree/OffHeapStarTreeBuilder.java
 create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/startree/StarTreeBuilder.java
 create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/startree/StarTreeBuilderConfig.java
 create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/startree/StarTreeDataTable.java
 create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/startree/hll/HllUtil.java
 create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/BaseStarTreeIndexTest.java
 create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/OffHeapStarTreeBuilderTest.java
 create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/StarTreeDataTableTest.java
 create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/StarTreeIndexTestSegmentHelper.java
 create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/SumStarTreeIndexTest.java
 create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/TestStarTreeMetadata.java
 create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/hll/HllFieldSizeTest.java
 create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/hll/HllIndexCreationTest.java
 create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/hll/HllStarTreeIndexTest.java
 create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/hll/HllTypeConversionTest.java
 create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/hll/OffHeapStarTreeBuilderWithHllFieldTest.java
 create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/hll/SegmentWithHllIndexCreateHelper.java
 delete mode 100644 pinot-core/src/test/java/org/apache/pinot/queries/TestTextSearchQueries.java
 delete mode 100644 pinot-core/src/test/resources/data/newColumnsWithTextSchema.json
 delete mode 100644 pinot-core/src/test/resources/data/text_search_data/group_by_grep_results.out
 delete mode 100644 pinot-core/src/test/resources/data/text_search_data/pql_query1.txt
 delete mode 100644 pinot-core/src/test/resources/data/text_search_data/skills.txt
 delete mode 100644 pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/LuceneRealtimeClusterIntegrationTest.java
 copy pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/{StarTreeClusterIntegrationTest.java => StarTreeV2ClusterIntegrationTest.java} (55%)
 create mode 100644 pinot-integration-tests/src/test/resources/OnTimeStarTreeQueries.txt
 delete mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/admin/command/OperateClusterConfigCommand.java
 delete mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/admin/command/QuickStartCommand.java
 create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/query/comparison/StarQueryComparison.java
 create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/segment/converter/ColumnarToStarTreeConverter.java
 copy thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/alert/filter/{PerUserDimensionAlertFilter.java => DimensionDetectionAlertFilter.java} (57%)
 copy thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/alert/filter/{PerUserDimensionAlertFilterTest.java => DimensionDetectionAlertFilterTest.java} (52%)


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[incubator-pinot] 01/01: update pinot assembly scripts

Posted by xi...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

xiangfu pushed a commit to branch release-0.3.0
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git

commit 79402cf5d38a0aa637fe35cad10be641bd989784
Author: Xiang Fu <fx...@gmail.com>
AuthorDate: Mon Mar 2 16:38:24 2020 -0800

    update pinot assembly scripts
---
 pinot-distribution/pinot-assembly.xml | 88 +++++++++++++++++++++++++----------
 pinot-plugins/pom.xml                 |  1 -
 2 files changed, 64 insertions(+), 25 deletions(-)

diff --git a/pinot-distribution/pinot-assembly.xml b/pinot-distribution/pinot-assembly.xml
index 1bc4051..c78889b 100644
--- a/pinot-distribution/pinot-assembly.xml
+++ b/pinot-distribution/pinot-assembly.xml
@@ -43,10 +43,74 @@
     <file>
       <source>${pinot.root}/DISCLAIMER</source>
     </file>
+    <!-- Include Pinot All-in-one jar -->
     <file>
       <source>${pinot.root}/pinot-distribution/target/pinot-distribution-${project.version}-shaded.jar</source>
       <destName>lib/pinot-all-${project.version}-jar-with-dependencies.jar</destName>
     </file>
+    <!-- Start Include Pinot Plugins-->
+    <!-- Start Include Pinot Stream Ingestion Plugins-->
+    <!-- Only Include Specified Kafka Version Plugin-->
+    <file>
+      <source>${pinot.root}/pinot-plugins/pinot-stream-ingestion/pinot-kafka-${kafka.version}/target/pinot-kafka-${kafka.version}-${project.version}-shaded.jar</source>
+      <destName>plugins/pinot-stream-ingestion/pinot-kafka-${kafka.version}/pinot-kafka-${kafka.version}-${project.version}-shaded.jar</destName>
+    </file>
+    <!-- End Include Pinot Stream Ingestion Plugins-->
+    <!-- Start Include Pinot Batch Ingestion Plugins-->
+    <file>
+      <source>${pinot.root}/pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-standalone/target/pinot-batch-ingestion-standalone-${project.version}-shaded.jar</source>
+      <destName>plugins/pinot-batch-ingestion/pinot-batch-ingestion-standalone/pinot-batch-ingestion-standalone-${project.version}-shaded.jar</destName>
+    </file>
+    <file>
+      <source>${pinot.root}/pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-hadoop/target/pinot-batch-ingestion-hadoop-${project.version}-shaded.jar</source>
+      <destName>plugins/pinot-batch-ingestion/pinot-batch-ingestion-hadoop/pinot-batch-ingestion-hadoop-${project.version}-shaded.jar</destName>
+    </file>
+    <file>
+      <source>${pinot.root}/pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-spark/target/pinot-batch-ingestion-spark-${project.version}-shaded.jar</source>
+      <destName>plugins/pinot-batch-ingestion/pinot-batch-ingestion-spark/pinot-batch-ingestion-spark-${project.version}-shaded.jar</destName>
+    </file>
+    <!-- End Include Pinot Batch Ingestion Plugins-->
+    <!-- Start Include Pinot File System Plugins-->
+    <file>
+      <source>${pinot.root}/pinot-plugins/pinot-file-system/pinot-adls/target/pinot-adls-${project.version}-shaded.jar</source>
+      <destName>plugins/pinot-file-system/pinot-adls/pinot-adls-${project.version}-shaded.jar</destName>
+    </file>
+    <file>
+      <source>${pinot.root}/pinot-plugins/pinot-file-system/pinot-gcs/target/pinot-gcs-${project.version}-shaded.jar</source>
+      <destName>plugins/pinot-file-system/pinot-gcs/pinot-gcs-${project.version}-shaded.jar</destName>
+    </file>
+    <file>
+      <source>${pinot.root}/pinot-plugins/pinot-file-system/pinot-hdfs/target/pinot-hdfs-${project.version}-shaded.jar</source>
+      <destName>plugins/pinot-file-system/pinot-hdfs/pinot-hdfs-${project.version}-shaded.jar</destName>
+    </file>
+    <!-- End Include Pinot File System Plugins-->
+    <!-- Start Include Pinot Input Format Plugins-->
+    <file>
+      <source>${pinot.root}/pinot-plugins/pinot-input-format/pinot-avro/target/pinot-avro-${project.version}-shaded.jar</source>
+      <destName>plugins/pinot-input-format/pinot-avro/pinot-avro-${project.version}-shaded.jar</destName>
+    </file>
+    <file>
+      <source>${pinot.root}/pinot-plugins/pinot-input-format/pinot-csv/target/pinot-csv-${project.version}-shaded.jar</source>
+      <destName>plugins/pinot-input-format/pinot-csv/pinot-csv-${project.version}-shaded.jar</destName>
+    </file>
+    <file>
+      <source>${pinot.root}/pinot-plugins/pinot-input-format/pinot-json/target/pinot-json-${project.version}-shaded.jar</source>
+      <destName>plugins/pinot-input-format/pinot-json/pinot-json-${project.version}-shaded.jar</destName>
+    </file>
+    <file>
+      <source>${pinot.root}/pinot-plugins/pinot-input-format/pinot-orc/target/pinot-orc-${project.version}-shaded.jar</source>
+      <destName>plugins/pinot-input-format/pinot-orc/pinot-orc-${project.version}-shaded.jar</destName>
+    </file>
+    <file>
+      <source>${pinot.root}/pinot-plugins/pinot-input-format/pinot-parquet/target/pinot-parquet-${project.version}-shaded.jar</source>
+      <destName>plugins/pinot-input-format/pinot-parquet/pinot-parquet-${project.version}-shaded.jar</destName>
+    </file>
+    <file>
+      <source>${pinot.root}/pinot-plugins/pinot-input-format/pinot-thrift/target/pinot-thrift-${project.version}-shaded.jar</source>
+      <destName>plugins/pinot-input-format/pinot-thrift/pinot-thrift-${project.version}-shaded.jar</destName>
+    </file>
+    <!-- End Include Pinot Input Format Plugins-->
+    <!-- End Include Pinot Plugins-->
   </files>
   <fileSets>
     <!-- Rename licenses-binary directory to licenses and include it to a distribution tarbell -->
@@ -86,29 +150,5 @@
       <outputDirectory>bin</outputDirectory>
       <fileMode>0755</fileMode>
     </fileSet>
-    <fileSet>
-      <useDefaultExcludes>false</useDefaultExcludes>
-      <directory>${pinot.root}/pinot-plugins/target/plugins/</directory>
-      <outputDirectory>plugins</outputDirectory>
-      <excludes>
-        <exclude>**/*.pom</exclude>
-        <exclude>**/pinot-plugins/**</exclude>
-        <exclude>**/pinot-file-system/pinot-file-system/**</exclude>
-        <exclude>**/pinot-input-format/pinot-input-format/**</exclude>
-        <exclude>**/pinot-stream-ingestion/pinot-stream-ingestion/**</exclude>
-        <exclude>**/pinot-stream-ingestion/pinot-kafka-*/**</exclude>
-        <exclude>**/pinot-batch-ingestion/pinot-batch-ingestion/**</exclude>
-        <exclude>**/pinot-batch-ingestion/pinot-batch-ingestion-common/**</exclude>
-        <exclude>**/pinot-batch-ingestion/pinot-ingestion-common/**</exclude>
-        <exclude>**/pinot-batch-ingestion/pinot-hadoop/**</exclude>
-        <exclude>**/pinot-batch-ingestion/pinot-spark/**</exclude>
-        <exclude>**/pinot-batch-ingestion/v0_deprecated/**</exclude>
-      </excludes>
-    </fileSet>
-    <fileSet>
-      <useDefaultExcludes>false</useDefaultExcludes>
-      <directory>${pinot.root}/pinot-plugins/target/plugins/pinot-stream-ingestion/pinot-kafka-${kafka.version}</directory>
-      <outputDirectory>plugins/pinot-stream-ingestion/pinot-kafka-${kafka.version}</outputDirectory>
-    </fileSet>
   </fileSets>
 </assembly>
diff --git a/pinot-plugins/pom.xml b/pinot-plugins/pom.xml
index c92ac1e..24f20c3 100644
--- a/pinot-plugins/pom.xml
+++ b/pinot-plugins/pom.xml
@@ -102,7 +102,6 @@
                       <shadedPattern>shaded.org.apache.http</shadedPattern>
                     </relocation>
                   </relocations>
-                  <outputDirectory>${pinot.root}/pinot-plugins/target/plugins/${plugin.type}/${project.artifactId}</outputDirectory>
                 </configuration>
               </execution>
             </executions>


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org